Anthropics New AI Report Accidentally Reveals an Industry-Sized Weak Spot

Anthropic's recent report introduces a novel metric called "observed exposure," which combines theoretical large language model (LLM) capabilities with real-world usage data to assess the actual impact of AI on various jobs. The key technical innovation lies in this dual approach, contrasting the potential tasks AI could perform (represented by the blue area) with those it is actively performing in practice (the red area), based on empirical data from professional settings. This analysis reveals a significant gap between AI's theoretical abilities and its real-world application, highlighting that despite LLMs' broad potential, their current practical impact on employment