New 'Markovian Thinking' technique unlocks a path to million-token AI reasoning

Researchers at Mila have developed a novel technique called Thinking, implemented through an environment named Delethink, which significantly enhances the efficiency of large language models (LLMs) in performing complex reasoning tasks. This approach addresses the longstanding quadratic scaling problem associated with chain-of-thought (CoT) reasoning, where the computational cost increases exponentially with the length of the reasoning chain, by structuring reasoning into fixed-size chunks rather than accumulating an ever-growing state. By breaking down the reasoning process into manageable segments, Delethink enables LLMs, such as a 1.5 billion parameter model, to perform