←新闻详情

TypeSafe AI更新于 10月14日 22:32

Jev 让研究智能体性能大幅提升

Jev is a huge power-up for research agents!

AI 导读

Jev 让研究智能体性能大幅提升! @edwardirby 构建了一个 @youdotcom 智能体来监控业务风险,并将 Jev 与普通 LLM 评审进行对比。 • 报告质量相同 • 但 LLM 反复无常:对同一威胁给出 0.35 -> 0.68 -> 0.50 • LLM 漏掉了 11 项调查中的 5 项。Jev 一项都没漏。• Jev 便宜 250 倍,快 3-6 倍 详细文章 👇

引用

Edward Irby

@edwardirby

How to build a reliable risk agent without a frontier model ($0.02/sweep): • @youdotcom search • @typesafeai Jev for typed judgments • @QwenDevs for proposals & synthesis • MCP for integration Full architecture & cost breakdown below 👇 https://t.co/9KbbPHRlEg

查看原帖

正文

当前显示原文,中文全文译文尚未就绪。

Jev is a huge power-up for research agents!

@edwardirby built a @youdotcom agent that monitors business risks, and compared Jev to an ordinary LLM judge.

• Same report quality • But the LLM flip-flopped: 0.35 -> 0.68 -> 0.50 on the same threat • the LLM missed 5 of 11 investigations. Jev missed none. • Jev was 250x cheaper, 3-6x faster

Write-up 👇

来源

TypeSafe AI