Jason Weston's team introduces HackBench for detecting and localizing reward hacking in autoresearch agents
Introducing *HackBench* 🤡💀⏱️📊 ⏲️ 💪🔧 🔥
- Detecting & localizing reward hacking in autoresearch agents
- Frontier models fail
- Dataset on HuggingFace
- Recipe to collect natural & synthetic hacks
Blog post: facebookresearch.github.io/RAM/blogs/hack…
🧵1/5XSources1
Headline by dalao.ai. The quoted post is the record; its author keeps authorship.