1 article
Allen AI introduced OLMo Hybrid, a 7B open-weight language model that combines attention and recurrent layers. The hybrid architecture improves efficiency while maintaining strong benchmark performance, with long-context scores jumping from 70.9% to 85.0%.
We use cookies to improve your experience on our site and to show you relevant advertising. To find our more, read our privacy policy and cookie policy
Usman Salis
