Coconut: A Framework for Latent Reasoning inLLMs

Coconut introduces a novel framework for training large language models (LLMs) to perform reasoning within a continuous latent space, enabling more efficient and flexible inference. By embedding reasoning processes into this latent space, Coconut enhances the models' ability to handle complex tasks, improve interpretability, and reduce computational costs compared to traditional approaches.