Zhipu AI Releases Glyph: An AI Framework for Scaling the Context Length through Visual-Text Compression

Zhipu AI's new framework, Glyph, introduces a novel approach to scaling context length in language models by converting long textual sequences into images for processing by visionlanguage models (VLMs). This method achieves 34 token compression without sacrificing accuracy, enabling models to handle contexts approaching one million tokenssignificantly beyond traditional limitsby rendering ultra-long texts into page images and leveraging the VLM's OCR, layout, and reasoning capabilities. This innovation addresses the limitations of conventional methods such as expanded positional encodings or attention modifications, which scale computationally with token count, and