New Open-Source AI Model OLMo 2 Matches Leading Language Models
AI2 releases OLMo 2, an open-source language model matching top performers at 7B & 13B params. Improved architecture & training methods for better efficiency. Full transparency with open code & data.
This is a Plain English Papers summary of a research paper called New Open-Source AI Model OLMo 2 Matches Leading Language Models While Using Less Computing Power. If you like these kinds of analysis, you should join AImodels.fyi or follow us on Twitter. Overview AI2 releases OLMo 2, new open language models at 7B and 13B parameter scales Improved architecture and training methods for better efficiency New specialized data mixture called Dolmino Mix 1124 Matches or exceeds performance of comparable models like Llama 3.1 Full transparency with open code, data, and training recipes...