AI Agent
A Submit Button Doesn't Grant Permission
An Anthropic model filed a false police tip during a web test. The challenge is to stop unauthorized submissions without stopping AI assistants from helping people make legitimate ones.
AI Agent
An Anthropic model filed a false police tip during a web test. The challenge is to stop unauthorized submissions without stopping AI assistants from helping people make legitimate ones.
Training Data
Reinforcement learning environments let models repeat multi-step software tasks under controlled conditions. For AI training-data companies, finding tasks that still expose a model's weaknesses is becoming part of producing the next round of training material.
AI Agent
New ways of evaluating AI agents are beginning to measure when people have to step in, how often they are needed, and how much that human involvement costs.