Terminal-Bench 2.0 launches alongside Harbor, a new framework for testing agents in containers

The developers of Terminal-Bench have released version 2.0 alongside Harbor, a new framework designed to enhance the testing, optimization, and scalability of autonomous AI agents operating in containerized environments. Terminal-Bench 2.0 introduces a more challenging and rigorously validated set of 89 terminal-based tasks, replacing the previous version to set a higher standard for evaluating the capabilities of frontier models in realistic developer scenarios. Harbor complements this update by enabling large-scale evaluation across thousands of cloud containers and supporting integration with both open-source and proprietary AI agents and training pipelines. This dual release aims to address previous