←搜索结果

按匹配度 · 共 3407 条结果 清除搜索

星期五

  1. LlamaIndex 产品、工程与评测

    LlamaIndex 发布 LlamaParse API v2 与 llama-cloud SDK

    LlamaIndex 为 LlamaParse v2 推出全新 API 及 llama-cloud Python、TypeScript SDK,取代原 llama-cloud-services,并实现 Python 与 TypeScript 功能对齐。新 API 将 v1 的数十个参数整理为 input_options、output_options、processing_options 等结构化配置对象,输出结构更一致。旧 SDK 约继续维护 3 个月,v1 仍受支持,v2 成为新项目推荐路径。

    parse, rather than getting lost in the details of how to parse. With cleaner configuration, structured outputs, and new llama-cloud SDKs for Python and TypeScript, you can now leverage LlamaParse v2's enhanced parsing quality with significantly less complexity. And if you're currently using v1, don't worry: we're maintaining full support via the old llama-cloud-services SDK for the time being, while making v2 the recommended path forward for all new projects. New LlamaParse SDKs Our SDKs are the

    匹配字段正文

  2. LlamaIndex 产品、工程与评测

    LlamaParse 推出 Granular Bounding Boxes:行、词、单元格级坐标追踪

    LlamaIndex 为 LlamaParse 推出 Granular Bounding Boxes,可在解析时按行、词、单元格三个粒度返回坐标,且只有页面上明确存在的文本才会获得坐标,推断值和 AI 摘要不生成边界框。该功能需在创建任务时传入单个参数开启,目前已在 LlamaParse 所有付费档位的 beta 中可用,Agentic Plus 会额外运行验证轮次以提升精度。

    Granular Bounding Boxes in LlamaParse

    value your pipeline extracts, proving exactly where on the page it came from. Most standard document parsers expose coarse, layout-level bounding boxes that can tell you where a paragraph sat or circle an entire table block. But if you were parsing a high-density financial report with 20 different payroll figures or inventory values tightly packed onto a single text line, hovering over an AI’s citation would awkwardly highlight half the page. That level of precision is "good enough" for basic LL

    匹配字段正文

  3. LlamaIndex 产品、工程与评测

    模板 OCR 的真正替代方案不是更好的模板

    LlamaIndex 指出,模板 OCR(区域 OCR)把提取绑定在数据所在的页面坐标上,供应商改版、扫描旋转或表格行数变化都会造成静默错误,且每种版式都需单独维护模板。其替代思路是 Agentic OCR:LlamaParse 先用布局感知的计算机视觉把页面切分为表头、表格、签名等真实组件,再按组件类型分派给快速 OCR、视觉语言模型或表格模型,无需定义区域,并输出置信度信号以支持人工复核。

    00 layouts you templated is worth very little when layout 201 walks in and the rate drops to zero. A template library doesn't degrade gracefully. It works perfectly inside its coverage and not at all outside it, and the edge of that coverage moves every time a vendor changes anything. Machine-learning document classification helps here, and it's the pitch you'll hear from most modern IDP vendors. A classifier can recognize a layout and pick the right template automatically instead of making you

    匹配字段正文

  4. LlamaIndex 产品、工程与评测

    LlamaIndex 与 GPT-3.5 打造无障碍 AI 语音助手 C3 指南

    C3 Voice Assistant 是基于 LlamaIndex 与 GPT-3.5 构建的语音助手,通过唤醒词“C3”或点击蓝色圆环激活,面向打字困难或有无障碍需求的用户,支持通用查询和文档级问答(如 Nvidia FY 2023 10K 报告)。前端采用 React.js 并托管于 Vercel,后端用 Python Flask 与 create-llama 搭建并部署在 Render,聊天记录以文本侧边栏展示。

    Follow us on The C3 Voice Assistant is my latest project aimed at making Large Language Model (LLM) and Retrieval-Augmented Generation (RAG) applications more accessible. This voice-activated assistant caters to a broad audience, including those facing typing challenges or accessibility issues. Explore our free and paid plans today. Learn more Voice Activation: Initiated by saying “C3.” Alternatively, users can click the blue ring to activate the listening mode of the app. The wake word “C3” is

    匹配字段正文

  5. LlamaIndex 产品、工程与评测

    AI 文档解析:LLM 如何重新定义机器阅读与理解文档

    LlamaIndex 发文梳理文档智能的演进路径:从 OCR、NLP、NER 到由 LLM 驱动的 AI 文档解析,LLM 凭借零样本语义理解直接推断结构、含义与关系,无需模板调优或领域训练,并能用多模态能力解读图表与表格。但文章也指出,仅依赖标准 LLM API 解析复杂文档仍有局限,例如密集排版、合并单元格表格易出错或产生幻觉,且缺少置信度、边界框、来源溯源与审计日志等企业级元数据。

    ExtractBench Pro: common patterns give way to exceptional cases in a dotted long-tail distribution.

    mounts. This allowed systems to populate fields in downstream workflows, but only for predefined entity types and predictable formats Together, these tools enabled functional but fragile automation. Each new document type required extensive rule writing, custom model training, and a steady stream of annotated examples. The resulting pipelines were brittle and hard to maintain. They struggled with small layout changes, required frequent retraining, and produced low pass through rates that eroded

    匹配字段正文

  6. LlamaIndex 产品、工程与评测

    LlamaParse 如何用智能体解析处理金融合规文档

    LlamaIndex 的 LlamaParse 面向金融合规文档,采用智能体解析而非模板匹配,可解析文本、表格、图像、图表和版面结构,输出下游 AI 系统可用的结构化数据。它针对 KYC、AML 调查、贷款审批、监管报告和 ISDA 协议分析等场景,解决传统 OCR 依赖模板、易丢失表格与脚注结构、准确率不足的问题。

    onal OCR? Legacy OCR tools are useful for extracting text from simple documents. But financial compliance workflows usually need much more than raw text. Traditional OCR is often fragile. It depends heavily on templates, rules, and predictable layouts. When a document changes format, even slightly, the extraction pipeline can break. It is also usually text-first, not structure-first. OCR may detect characters on a page, but it does not reliably understand that a table continues across multiple p

    匹配字段正文

  7. LlamaIndex 产品、工程与评测

    AI 文档抽取:为什么 Schema 才是准确率瓶颈

    LlamaIndex 指出,AI 文档抽取的读取环节已相当成熟,准确率损失主要出在开发者手写的 schema 上,而这一层几乎从不被审查。一份 180 页信贷协议中 interest_rate 同时存在 6.25%、SOFR 加 350 个基点、违约后 11% 三个合法数值,schema 未说明取哪个、何时、在什么条件下,三个抽取系统会给出三个不同答案。文章还列举了文档中不存在的字段被 required 逼出编造值、同一字段在不同发行方含义不同、一对多结构被压成单值等缺陷,并提到 LlamaExtract 的 extraction_target 可设为 per_table_row 来按表格行抽取。

    eract text dump and it has a flattened document to reason over, because no amount of reasoning rebuilds a table that stopped being a table two steps earlier. The same ceiling caps RAG pipelines, where retrieval can't exceed what extraction preserved. These three share a property that makes them useful test cases. The parse is easy, the typography is clean, and the schema will still be wrong. Credit Agreements and Lease Abstraction Defined-terms sections, amendments and riders that supersede the

    匹配字段正文

  8. LlamaIndex 产品、工程与评测

    AI 文档分类实用指南:从原理到落地

    LlamaIndex 发布《AI 文档分类实用指南》,梳理了 AI 文档分类的五阶段流程:摄取与预处理、特征提取、模型分类、打标与置信度评分、路由到下游工作流。文中以 LlamaParse 为例说明 agentic 文档解析如何用布局感知的计算机视觉重建文档结构,并对比了传统机器学习与大语言模型在文档分类上的适用场景。

    valuable if they connect to action. The final stage routes the classified, tagged document to the appropriate workflow: an approval queue, an ERP system, a legal review tool, a storage location, or a processing pipeline. This is where the integration layer matters. A classification system that produces accurate outputs but can't push them into your actual systems creates a manual handoff that negates much of the value. End-to-end agentic document processing, where classification feeds directly i

    匹配字段正文

  9. LlamaIndex 产品、工程与评测

    LlamaIndex 解析智能体文档处理:AI 智能体如何自动化工作流

    LlamaIndex 发文介绍智能体文档处理(ADP),即用 AI 智能体自主完成文档工作流,无需持续人工监督。其 LlamaParse 采用智能体文档解析,由多个专用文档理解智能体协同工作,在复杂文档上实现行业领先准确率,且布局变化时无需重新定制训练。文章还对比了智能体 AI 与传统 IDP,并给出落地路线图。

    Blog hero image with the text "Agentic document processing" on it.

    itional IDP: What's the Difference?; The Architecture of an Agentic Document Workflow; The Brain: Large Language Models for Reasoning and Planning; The Memory: Knowledge Bases and RAG; The Tools: APIs, ERPs, and External Systems; The Output: Structured Data Ready for Downstream Automation; High-Value Use Cases: From Legal to Finance; Legal Documents and Contract Review; Financial Statements and Investment Analysis; Complex Business Onboarding: The Multi-Document Problem; Overcoming the Challenge

    匹配字段正文

  10. LlamaIndex 产品、工程与评测

    LlamaIndex 文档上线原生 MCP 搜索

    LlamaIndex 文档现已提供原生 MCP 搜索,地址为 developers.llamaindex.ai/mcp,编码智能体或智能体工作流可直接调用全部文档。该服务暴露三个工具:基于 BM25 的 search_docs、基于正则的精确搜索 grep_docs,以及读取整页内容的 read_doc。文档站由 Astro 和 Starlight 生成并部署在 Vercel,BM25 索引在构建时静态生成。

    rameworks/etc. these days will have some kind of MCP support. Whether its some kind of JSON you configure locally, a special class you import in a framework, or elsewhere, we encourage users to use this docs MCP server anywhere they work. “How do the MCP tools actually work?” To start with, our documentation is a dynamically generated Astro and Starlight website, built from docs across many repositories. This is hosted and deployed onto Vercel. Conveniently, Vercel provides a nice createMCPHandl

    匹配字段正文

  11. LlamaIndex 产品、工程与评测

    为 Claude Code 添加文档理解能力的 3 种方式 | LlamaIndex

    LlamaIndex 提出为 Claude Code 等编码智能体补充文档理解能力的三种互补方案,以解决其默认无法原生读取 .pdf、.pptx、.docx、.xlsx 等企业文档的问题。Claude Code 的 Read 能力仅支持基础 PDF 理解,单次请求上限为 32 MB 和 100 页,而 Cursor 完全不支持 PDF 上传。第一种方案是通过 MCP 接入已解析、分块并嵌入索引的文档,但检索质量依赖索引实现,且缺乏 Sharepoint 等文件仓库的官方 MCP server。

    le set of financial docs (are they public filings, reports), along with previous due diligence reports, in order to understand the business requirements. It would also need to leverage these modules during the generated workflow. Over the past few months, we’ve been exploring ways to bridge this gap. Here are three complementary patterns for adding document intelligence to Claude Code. Each approach has their own tradeoffs, and we describe them in detail so you can pick and choose which one(s) t

    匹配字段正文

  12. LlamaIndex 产品、工程与评测

    LlamaIndex 收入验证 API:自动化基于文档的收入核查

    LlamaIndex 发布收入验证 API,用于自动化基于文档的收入核查,覆盖工资单、税表、银行流水等非传统就业收入类型。该 API 将验证后的收入数据结构化输出,包含核实后的总收入、净收入、收入类型、就业状态及验证置信度,供下游核保系统直接使用。文章同时梳理了 payroll API、开放银行数据和人工审单等现有方案在覆盖范围与可扩展性上的局限。

    verification API should deliver. The Income Verification API Landscape There are several categories of income verification solution, each with a different approach, different coverage, and different limitations. Understanding the landscape is important because no single approach covers every income type well. Payroll API Connections Payroll connectivity providers like Argyle and Pinwheel connect directly to payroll systems and HR platforms to retrieve income data programmatically. When a user g

    匹配字段正文

  13. TensorZero 工程博客

    TensorZero 提出把 LLM 应用看作 POMDP 而非 Agent

    TensorZero 在工程博客中提出,LLM 应用应被建模为部分可观测马尔可夫决策过程(POMDP),其中智能体只对应 LLM 函数,环境包含应用中的其余代码。文章据此建议应用与 LLM 的接口应是变量之间的函数 f:X→Y 而非提示词到生成,并主张按轨迹存储观测、动作与奖励,用离线策略评估做评测。TensorZero 表示已基于这些原则构建开源生产级系统,并计划未来自动生成、评估和呈现新的函数变体。

    the assumption that a function call corresponds to a single LLM call — so long as you respect the interface of f:X→Yf: \mathbb{X} \to \mathbb{Y}f:X→Y — enabling the ability to leverage complex inference-time optimizations (like the OpenAI o1 family of models). After you’ve used one or more of these techniques to generate a new policy, you’ll want to use historical data to backtest and find out if it’s good or not. These are evals, but have been studied for decades under the name offline policy e

    匹配字段正文

  14. TensorZero 工程博客

    OpenAI 的强化微调 RFT 值得用吗?TensorZero 在三个任务上做了基准测试

    TensorZero 在数据抽取、智能体编码和客服三个任务上对比了 OpenAI 的 RFT 与 SFT,RFT 成本是 SFT 的 100-700 倍。RFT 在智能体编码任务上明显优于 SFT,但数据抽取用 SFT 效果更好且成本低 159 倍,客服任务中 RFT 反而比基线更差。作者还指出 RFT 触发了比 SFT 更严格的内容审核,导致部分公开基准数据集无法通过验证。

    Fine-Tuning for o4-mini on terminal-benchThe script below demonstrates how to fine-tune o4-mini on terminal-bench using TensorZero’s programmatic API; Deploy with confidence: Leverage the experimentation features to gradually route traffic to your fine-tuned models, starting with a small allocation and scaling based on performance metrics So, is reinforcement fine-tuning worth it? For most use cases, not yet. At 100-700x the cost of supervised fine-tuning, we only observed RFT to deliver clear

    匹配字段正文

  15. TensorZero 工程博客

    从 NER 到智能体:自动化提示词工程 MIPRO 能否扩展到复杂任务?

    TensorZero 工程博客测试了自动化提示词工程方法 MIPRO 在从命名实体识别(CoNLL++)到多跳检索(HoVer)、文本游戏导航(BabyAI)和智能体工具调用(τ-bench)等任务上的表现。在 CoNLL++ 上,MIPRO 相比 Zero-shot 和 Random Demos 基线分别取得 140.1% 和 43.4% 的相对提升,但在 HoVer 上未观察到显著差异,说明任务越复杂收益越递减。大模型在复杂场景中从 MIPRO 优化中获益更多,且即使反馈带有噪声(包括 AI 生成的反馈)仍能带来有意义的改进。

    n for each environment at a given bin corresponds to the height of its colored segment. The increase in prompt length is primarily due to the demonstrations: either because the average number of turns in a successful episode increases (BabyAI PickUpSeqGoTo) or because environment observations and agent actions are more verbose (HoVer and τ-bench Retail). This observation motivates our experimentation with a larger model (GPT-4o instead of GPT-4o Mini) with larger context capacity for the τ-bench

    匹配字段正文

  16. TensorZero 工程博客

    TensorZero:即使噪声很大的 LLM 评估器也能用于改进 AI 智能体

    TensorZero 工程博客指出,LLM 评估器虽常与真实结果弱相关,但噪声会在大量样本上被平均掉,因此仍能可靠判断哪个智能体平均表现更好。评估器质量可分输出级相关性与智能体级相关性:前者决定护栏等单条输出场景是否可靠,后者随样本量增加而提升,可用于离线挑选最佳 prompt 或模型变体。

    ted value for production decisions that hinge on judging a single output (e.g. guardrails); However, even (very) noisy evaluators can reliably tell you which agent is better on average, meaning they can still help you pick the best variant to deploy and improve it over time It’s surprisingly hard to develop reliable LLM evaluators: they’re often noisy and poorly correlated with the metrics or outcomes practitioners actually care about. Sometimes the target is directly measurable but evaluators s

    匹配字段正文

  17. TensorZero 工程博客

    案例研究:欧洲大型银行用 TensorZero 与 LLM 自动生成 GitLab 代码变更日志

    一家欧洲大型银行用 TensorZero 构建了基于 LLM 的 GitLab merge request 变更日志生成器,并通过 Ollama 实现完全本地化部署,数据不出内网。团队借助 TensorZero 内置的动态上下文学习(DICL),把工程师对 AI 生成日志的修改和批准自动用于优化后续推理,无需微调或标注数据集,也无需 ML 工程师即可迭代。

    engineers edited and approved the AI-generated changelogs, those human revisions were automatically used by TensorZero to optimize future inference requests. Mark and his team leveraged TensorZero’s built-in dynamic in-context learning feature to make the system get smarter over time — without fine-tuning, labeling datasets, or writing complex pipelines. It was a human-in-the-loop learning flywheel, out of the box. Dynamic In-Context Learning (DICL) is an inference-time optimization strategy tha

    匹配字段正文

  18. TensorZero 工程博客

    TensorZero 在 LLM 网关中引入多臂老虎机自适应实验

    TensorZero 在其开源 LLM 网关中提供自适应实验(A/B 测试)功能,采用多臂老虎机算法解决传统实验固定停止规则和流量分配次优的问题,可在证据充分时自动停止并动态分配推理流量。官方称在多种真实环境中,自适应实验将正确识别最佳 LLM 变体(提示词、模型等)的平均时间比简单 A/B 测试缩短 37%。该功能基于固定置信度最佳臂识别(BAI)的 Track-and-Stop 策略,用 Rust 实现,通过概率采样、周期性更新采样概率和 GLRT 停止规则适配生产环境的异步反馈与并发请求。

    while dynamically allocating LLM inference traffic for maximum efficiency; Across a diverse set of realistic and challenging environments, adaptive experimentation reduced the average time to correctly identify the best LLM variants (prompts, models, etc.) by 37% compared to simple A/B testing Developing LLM applications involves numerous design decisions: which model to use, how to structure prompts, what temperature and sampling parameters to set, etc. While offline evaluations and synthetic

    匹配字段正文

  19. TensorZero 工程博客

    TensorZero:用每次 Git 提交自动评估 AI 编程助手

    TensorZero 提出一种基于 Git 提交自动评估 AI 编程助手的方法:用 tree-sitter 将代码解析为语法树,再用树编辑距离(TED)衡量 LLM 生成代码与提交代码的差异,从而为 Cursor 等编码智能体的推理结果生成反馈。该方案开源,可在已部署 Cursor 集成的机器上运行。

    m exhaustively evaluates every candidate subtree to guarantee the closest match. Each distance is normalized by the size of the LLM snippet, yielding a ratio in [0, 1]. We then average these ratios across all snippets in the inference, and compute the reward is then computed as 1 - average ratio. A perfect match receives a score of 1, while lower scores indicate poorer performance. Formally, say that an LLM inference outputs nnn code snippets with corresponding concrete syntax trees I={t1,…,tn}I

    匹配字段正文

  20. Chroma Research

    Chroma 技术报告:嵌入向量适配器可将检索准确率提升最高 70%

    Chroma 发布技术报告,提出在嵌入模型输出后加一个线性变换“适配器”,仅用少至 1,500 条标注查询-文档对训练、且只作用于查询嵌入,即可让检索准确率较原始预训练嵌入模型提升最高 70%。负样本可直接从非相关文档中随机采样,大幅降低标注成本;该方法对约 10,000 条嵌入规模的小型集合尤为适用,代码已在 GitHub 开源。

    Embedding Adapters

    arning processes more computationally tractable, but also enable the discovery of hidden connections and similarities that might be obscured in the original representation. By leveraging pre-trained embeddings and fine-tuning them with task-specific data, we can create models that are more accurate and require less training time compared to learning from scratch. This approach has been particularly successful in natural language processing tasks, such as sentiment analysis, named entity recognit

    匹配字段正文