Understand this story
Northwestern and Google published a paper proposing Harness2, which enables an agent harness to self-improve on new tasks without answer keys. Its process is to first run the agent, have an editor model propose harness modifications, then rerun the tasks to verify which modifications genuinely improve behavior, and store the experience from each task in a library to guide the next modification. The paper reports that a single improvement step raised GLM-5's WorkBuddy-Bench score by 11.5 points, surpassing Gemini 3.5 Flash using the original harness; whereas modifying the harness directly without test runs dropped the coding score from 73.4 to 63.2.
AI-generated from public reports
Developments
1 confirmed developments
Reports and discussion timeline
Browse reports and discussion by time. Their evidence levels remain distinct.
Nov 15
Rohan Paul
The Northwestern and Google paper proposes Harness2, enabling agent harnesses to self-improve without answer keys
A new paper from Northwestern and Google proposes Harness2, which enables agent harnesses to self-improve on new tasks without answer keys: first run the agent, have an editor model propose harness modifications, then rerun the tasks to see which modifications actually improved behavior, and store the experience from each task in a library to guide the next modification. One improvement step raised GLM-5's WorkBuddy-Bench score by 11.5 points, surpassing Gemini 3.5 Flash using the original harness; whereas modifying the harness directly without these test runs dropped the coding score from 73.4 to 63.2.
AI Trends