←Search results

By relevance · Total 425 results Clear search

Friday

  1. Arena

    Arena analyzes 26,225 Agent sessions: without caching, agent costs are 3.6 times higher

    Arena analyzed 26,225 Agent sessions, 30 agents, and 13 labs from September 12 to October 23, 2026, and found that if billed at the full input price, the typical task cost for the top ten agents would be 3.6 times higher, and 592% higher on MiMo V2.6 Pro. For agents, 86% to 96% of tokens are repeatedly read context, while their own output accounts for only 1% to 2%. Cache invalidation increases the typical task cost by about 5%, and on Claude Fable 5.1, 1 in every 10 sessions sees an increase of more than 18%.

    Arena analyzed 26,225 Agent sessions, 30 agents, and 13 labs from September 12 to October 23, 2026, and found that if billed at the full input price, the typical task cost for the top ten agents would be 3.6 times higher, and 592% higher on MiMo V2.6 Pro. For agents, 86% to 96% of tokens are repeatedly read context, while their own output accounts for only 1% to 2%. Cache invalidation increases the typical task cost by about 5%, and on Claude Fable 5.1, 1 in every 10 sessions sees an increase of

    Matched fieldsTitle、Summary、Body

Friday

  1. Shao Meng

    METR and Redwood each sent one person to OpenAI for three weeks to evaluate monitoring of internal Agent misalignment behavior

    METR and Redwood Research each sent one person to OpenAI from July 21 to August 11, 2026, to evaluate the misalignment behavior monitoring system for its internal agents (including Codex). The public draft states that about 75–94% of agent traffic in the internal Responses API at or above GPT-5.5 is eligible for monitoring, and the internal Codex agent subset is about 99.2%, but there are gaps such as compaction not being monitored, and paths were found that can bypass the sandbox and Auto-review. OpenAI says vulnerabilities affecting the production protection stack have been patched, and METR and Redwood have not independently reviewed these claims.

    METR and Redwood Research each sent one person to OpenAI from July 21 to August 11, 2026, to evaluate the misalignment behavior monitoring system for its internal agents (including Codex). The public draft states that about 75–94% of agent traffic in the internal Responses API at or above GPT-5.5 is eligible for monitoring, and the internal Codex agent subset is about 99.2%, but there are gaps such as compaction not being monitored, and paths were found that can bypass the sandbox and Auto-revie

    Matched fieldsTitle、Summary、Body

Thursday

  1. Chelsea Finn

    Librarian Agents paper: letting agents organize long contexts themselves to improve retrieval performance

    Chelsea Finn retweeted a new paper, Librarian Agents, by Anikait Singh and others, which studies whether agents can adapt to large amounts of unstructured context in specialized domains by organizing their own long-context workspaces and anticipating queries. She notes that agentic search can scale to information of any size but tends to miss relevant content, while optimizing information organization for downstream use can also bring 30+% improvements in OOD domains. The tweet includes links to the paper and code.

    Chelsea Finn retweeted a new paper, Librarian Agents, by Anikait Singh and others, which studies whether agents can adapt to large amounts of unstructured context in specialized domains by organizing their own long-context workspaces and anticipating queries. She notes that agentic search can scale to information of any size but tends to miss relevant content, while optimizing information organization for downstream use can also bring 30+% improvements in OOD domains. The tweet includes links to

    Matched fieldsTitle、Summary、Body

Thursday

Tuesday

Friday

Thursday

Monday

Wednesday

Tuesday

Tuesday

Friday

Monday

Wednesday

Wednesday

Tuesday

Tuesday

Thursday