←Search results

Search “arXiv”

By relevance · Total 78 results Clear search

Saturday

  1. Phoenix Technology

    Harvard study: AI review comments comprehensively outperform high-level human peer reviewers across seven dimensions

    Two researchers from Harvard University published a paper on October 22 comparing 134 pairs of AI and human review comments, with AI leading comprehensively across seven evaluation dimensions. The study used Claude Opus 4.8 to generate review comments and GPT-5.5 as the blind-review judge; in all 134 comparisons GPT-5.5 chose the AI. In 30 blind reviews by three former academic journal editors-in-chief, 26 considered the AI better. The factual error rate of AI review comments was 5.5%, versus 15.9% for humans, and all 651 references cited by the AI with DOI or arXiv numbers actually exist.

    I and human review comments, with AI leading comprehensively across seven evaluation dimensions. The study used Claude Opus 4.8 to generate review comments and GPT-5.5 as the blind-review judge; in all 134 comparisons GPT-5.5 chose the AI. In 30 blind reviews by three former academic journal editors-in-chief, 26 considered the AI better. The factual error rate of AI review comments was 5.5%, versus 15.9% for humans, and all 651 references cited by the AI with DOI or arXiv numbers actually exist.

    Matched fieldsSummary、Body

    #chinese#Papers/Research#Evaluations / benchmarks#Anthropic

Friday

  1. TechCrunch AI

    MIT study: 13 Claude Opus 4.7 agents perform better after playing autonomously on a virtual deserted island for 30 hours

    MIT researchers had 13 Eko agents based on Claude Opus 4.7 explore a simulated deserted island without any assigned tasks for 30 hours; afterward, in designated challenges, these agents generally outperformed comparable agents that had never been on the island. The paper has been published on arXiv and has not yet undergone peer review. The study also found that 6 agents figured out on their own that letting go mid-jump allows them to throw blocks farther, an ability the designers had not anticipated; UC Berkeley cognitive scientist Eunice Yiu considers the results impressive but hopes to see more evidence about the cognition behind the behavior.

    d tasks for 30 hours; afterward, in designated challenges, these agents generally outperformed comparable agents that had never been on the island. The paper has been published on arXiv and has not yet undergone peer review. The study also found that 6 agents figured out on their own that letting go mid-jump allows them to throw blocks farther, an ability the designers had not anticipated; UC Berkeley cognitive scientist Eunice Yiu considers the results impressive but hopes to see more evidence

    Matched fieldsSummary、Body

    #tech-media#Papers/Research#Agents#arXiv

Monday

  1. Rohan Paul

    Princeton and Google Paper: 4B Decision Model Shares Agent Tool Selection, Cutting Costs by 81.1% to 89.0%

    A new paper from Princeton University and Google finds that the most accurate decision model on isolated problems solved only 69.5% of agent tasks, while a 4B model trained on agent states solved 91.5%. Its harness delegates each step's tool selection to a fast decision model, adopting its answer only when confidence exceeds a threshold fitted on the agent's own runs, and it trained AgentDecision-4B on the states the agent actually reached (including states after mistakes). On tasks similar to the training data, such 4B models cut agent costs by 81.1% to 89.0% and boost speed by up to 2.5x, with a success-rate gap within 3 percentage points; without a threshold, delegating all tool selection drops the success rate by 19.0 percentage points. The paper is available at arxiv.org/abs/2610.21412.

    when confidence exceeds a threshold fitted on the agent's own runs, and it trained AgentDecision-4B on the states the agent actually reached (including states after mistakes). On tasks similar to the training data, such 4B models cut agent costs by 81.1% to 89.0% and boost speed by up to 2.5x, with a success-rate gap within 3 percentage points; without a threshold, delegating all tool selection drops the success rate by 19.0 percentage points. The paper is available at arxiv.org/abs/2610.21412.

    Matched fieldsSummary、Body

    #ai-news#Papers/Research#Agents#Reasoning

Tuesday

Saturday

Thursday

Tuesday

Sunday

Saturday

Monday

Wednesday

Monday

Thursday

  1. Story1 reports · 1 facts

    DeepMind paper discloses four Gemini agents autonomously completing Minecraft

    DeepMind research team disclosed in an arXiv paper that four autonomous agents running Gemini 4 Argon autonomously completed Minecraft in survival mode. According to a Pengpai News report on October 22, 2026, the four agents took 27 hours and 14 minutes to defeat the Ender Dragon, with no human intervention throughout and without receiving game-specific training; during the process they wrote and ran 2,783 programs, exchanged 229 chat messages, died 605 times, and processed about 1.35 billion input tokens, costing about $520 at discounted prices; the paper states this is the first end-to-end autonomous completion using only the standard Mineflayer library, without pre-exploring seeds or human-written game-specific tools. A Phoenix Technology report on October 23 added that the division of labor was not pre-written into the prompts, but was proposed by the agents themselves about ten minutes after the game started and gradually took shape, with role responsibilities adjusted as the process progressed; the team accumulated 605 deaths, and the causes of failure were analyzed and stored in shared memory for reuse by the whole team, with about 24,000 model calls throughout, of which 91% of input tokens came from context caching, and about 22% of game programs had errors, with the server restarting 6 times. Currently, this experiment remains at the latest status as disclosed in the paper.

    DeepMind research team disclosed in an arXiv paper that four autonomous agents running Gemini 4 Argon autonomously completed Minecraft in survival mode. According to a Pengpai News report on October 22, 2026, the four agents took 27 hours and 14 minutes to defeat the Ender Dragon, with no human intervention throughout and without receiving game-specific training; during the process they wrote and ran 2,783 programs, exchanged 229 chat messages, died 605 times, and processed about 1.35 billion in

    Matched fieldsSummary

Sunday

  1. Story1 reports · 1 facts

    Princeton and Google paper finds 4B model trained on agent states achieves higher task success rate

    Princeton University and Google published a paper studying the performance of a 4B model trained on agent states in agent tasks. The paper reports that the most accurate decision model on isolated problems solved only 69.5% of agent tasks, while the 4B model trained on agent states solved 91.5%. Its harness delegates tool selection at each step to a fast decision model, adopting its answer only when confidence exceeds a threshold fitted on the agent's own runs, and trained AgentDecision-4B on the states the agent actually reached, including states after mistakes. On tasks similar to the training data, this type of 4B model reduced agent costs by 81.1% to 89.0% and increased speed by up to 2.5 times, with a success rate gap of within 3 percentage points; delegating all tool selections without a threshold lowered the success rate by 19.0 percentage points. The paper is available at arxiv.org/abs/2610.21412.

    eds a threshold fitted on the agent's own runs, and trained AgentDecision-4B on the states the agent actually reached, including states after mistakes. On tasks similar to the training data, this type of 4B model reduced agent costs by 81.1% to 89.0% and increased speed by up to 2.5 times, with a success rate gap of within 3 percentage points; delegating all tool selections without a threshold lowered the success rate by 19.0 percentage points. The paper is available at arxiv.org/abs/2610.21412.

    Matched fieldsSummary