LLM Agents for Bargaining with Utility-based Feedback

Researchers have developed BargainArena, a new benchmark dataset with six complex bargaining scenarios, to better evaluate large language models' strategic and opponent-aware reasoning. They also introduce a utility-based feedback framework and evaluation metrics inspired by utility theory, which significantly improve LLMs' negotiation performance and alignment with human preferences.