TII Launches Falcon H1R 7B, Compact Reasoning Model Outperforming Much Larger Systems
Published 2026-01-07Foundation ModelsMedium
Summary
The Technology Innovation Institute (TII) in Abu Dhabi released Falcon H1R 7B in early January 2026, a compact AI reasoning model built on a hybrid Transformer-Mamba architecture that delivers performance comparable to models up to 7x its size. The model scored 88.1% on the AIME-24 math benchmark, surpassing larger models from Microsoft, Alibaba, and NVIDIA, and achieved 68.6% on coding tasks. It features a 256k context window. Falcon H1R 7B builds on the Falcon H1-7B foundation with a speciali
Alignment: Reinforces current position
tiifalconopen-sourcefoundation-modelsreasoningcompact-modelshybrid-architecturemamba