Abstract: As LLM agents become increasingly capable of making consequential economic decisions, their safety under economic pressures remains poorly understood. We introduce EconSafeBench, the first benchmark for systematically evaluating the safety of LLM agents in executable economic environments. EconSafeBench contains 828 cases across five economic scenarios and four categories of safety violations. A key design is the matched evaluation of three sources of safety pressure, including explicit user requests, pressure from other actors, and pressure arising from the agent's own pursuit of a performance objective. We further evaluate safety at both static and dynamic scales through 30-period interactions with persistent memory and matched controls. Across eight LLMs, all evaluated models exhibit safety violations on the static benchmark, with overall violation rates ranging from 8.5% to 40.6%. We further find that violations can occur even without an explicit unsafe request, and that initially compliant agents may begin to violate as performance pressure increases over time. These findings highlight the need for stronger safety alignment and rigorous evaluation before LLM agents are deployed in high-stakes economic environments.
Read the original article:
When Helpful Agents Cause Financial Harm: Evaluating LLM Agent Safety in Executable Economic Worlds
