Jason Weston's team introduces HackBench for detecting and localizing reward hacking in autoresearch agents

Jason Weston@jaseweston
Introducing *HackBench* 🤡💀⏱️📊 ⏲️ 💪🔧 🔥 - Detecting & localizing reward hacking in autoresearch agents - Frontier models fail - Dataset on HuggingFace - Recipe to collect natural & synthetic hacks Blog post: facebookresearch.github.io/RAM/blogs/hack… 🧵1/5
X

Sources1

Headline by dalao.ai. The quoted post is the record; its author keeps authorship.