OpenAI releases the LifeVal benchmark to test models' ability to complete everyday tasks
OpenAI has released the LifeVal benchmark, designed to test whether AI models can complete everyday tasks on people's behalf, with tasks covering caregiving, health, education, finance, shopping, and household management—for example, scheduling a vehicle inspection or ordering halal food within a budget. The benchmark was shaped by feedback from thousands of ChatGPT users, and OpenAI says that over the past year it has used LifeVal to measure and improve how well its models handle such tasks. Rohan Paul relayed that GPT-6 Astra scored 80.6% on the benchmark, higher than GPT-5.2's 49.3% less than 9 months earlier.
Why read this
AI score 63
OpenAI built an everyday-tasks benchmark from feedback from thousands of ChatGPT users and provided cross-version score comparisons, making it possible to observe model progress on life-related tasks.
Topics
View original postFor AGI to benefit all of humanity, it should help people with the everyday tasks that matter most to them. So we built LifeVal, a new benchmark shaped by feedback from thousands of ChatGPT users on where they most want help from a personal assistant—from finding childcare to accessing government services to managing personal finances. Over the past year, we’ve used LifeVal to measure and improve how well our models handle these everyday tasks. https://t.co/GlUjixzEM0
View original
For AGI to benefit all of humanity, it should help people with the everyday tasks that matter most to them. So we built LifeVal, a new benchmark shaped by feedback from thousands of ChatGPT users on where they most want help from a personal assistant—from finding childcare to accessing government services to managing personal finances. Over the past year, we’ve used LifeVal to measure and improve how well our models handle these everyday tasks. https://t.co/GlUjixzEM0
Body
OpenAI has released LifeVal, a benchmark testing whether AI models can finish everyday errands for people.
GPT-6 Astra, scores 80.6% on everyday tasks, up from 49.3% for GPT-5.2 less than 9 months earlier.
LifeVal’s tasks span caregiving, health, education, finance, shopping and household admin, from booking a car inspection to ordering halal groceries within budget.