\u2018Tis the week for small AI models, it seems. <\/p>\n
On Thursday, Ai2, the nonprofit AI research institute, released<\/a> Olmo 2 1B, a 1-billion-parameter model that Ai2 claims beats similarly-sized models from Google, Meta, and Alibaba on several benchmarks. Parameters, sometimes referred to as weights, are the internal components of a model that guide its behavior.<\/p>\n Olmo 2 1B is available under a permissive Apache 2.0 license on the AI dev platform Hugging Face. Unlike most models, Olmo 2 1B can be replicated from scratch; Ai2 has provided the code and data sets (Olmo-mix-1124<\/a>, Dolmino-mix-1124<\/a>) used to develop it. <\/p>\n Small models might not be as capable as their behemoth counterparts, but importantly, they don\u2019t require beefy hardware to run. That makes them much more accessible for developers and hobbyists contending with the limitations of lower-end and consumer machines. <\/p>\n There\u2019s been a raft of small model launches over the past few days, from Microsoft\u2019s Phi 4 reasoning family<\/a> to Qwen\u2019s 2.5 Omni 3B<\/a>. Most of these \u2014 and Olmo 2 1B \u2014 can easily run on a modern laptop or even a mobile device.<\/p>\n Ai2 says that Olmo 2 1B was trained on a data set of 4 trillion tokens from publicly available, AI-generated, and manually created sources. Tokens are the raw bits of data models ingest and generate \u2014 1 million tokens is equivalent to about 750,000 words. <\/p>\n On a benchmark measuring arithmetic reasoning, GSM8K, Olmo 2 1B scores better than Google\u2019s Gemma 3 1B, Meta\u2019s Llama 3.2 1B, and Alibaba\u2019s Qwen 2.5 1.5B. Olmo 2 1B also eclipses the performance of those three models on TruthfulQA, a test for evaluating factual accuracy. <\/p>\n Techcrunch event<\/p>\n \n\t\t\t\t\t\t\t\t\tBerkeley, CA \t\t\t\t\t\t\t This model was pretrained on 4T tokens of high-quality data, following the same standard pretraining into high-quality annealing of our 7, 13, & 32B models. We upload intermediate checkpoints from every 1000 steps in training.<\/p>\n Access the base model: https:\/\/t.co\/xofyWJmo85<\/a> pic.twitter.com\/7uSJ6sYMdL<\/a><\/p>\n
\n\t\t\t\t\t\t\t\t\t\t\t\t\t|
\n\t\t\t\t\t\t\t\t\t\t\t\t\tJune 5\n\t\t\t\t\t\t\t<\/p>\n
\n\t\t\t\t\tBOOK NOW
\n\t\t\t\t<\/a><\/p>\n\n