AI21s Jamba reasoning 3B redefines what 'small' means in LLMs 250K context on a laptop

AI21 Labs has introduced Jamba Reasoning 3B, a compact open-source AI model capable of extended reasoning, code generation, and ground-truth responses, designed to run efficiently on edge devices such as laptops and smartphones. Leveraging the Mamba architecture combined with Transformers, the model supports a 250,000-token window, enabling it to perform inference 2-4 times faster than previous models, with tested speeds of 35 tokens per second on a MacBook Pro, while significantly reducing memory and computational requirements. This development addresses a key industry challenge by shifting inference workloads from data centers to