←搜索结果

按匹配度 · 共 3407 条结果 清除搜索

星期二

  1. 蚂蚁 inclusionAI:GitHub 新仓库

    蚂蚁 inclusionAI 开源 dFactory:面向 dLLM 的高效微调工具

    蚂蚁 inclusionAI 在 GitHub 开源 dFactory,用于 dLLM 的高效微调,支持 LLaDA2.0-mini(16B)和 LLaDA2.0-flash(100B)两款模型,集成(连续)监督微调(block-diffusion、full attention)等方法。项目采用 Apache-2.0 许可,提供 MoE 专家权重合并与拆分脚本,训练需先将权重转为 merged-expert 格式。

    into a single, higher-dimensional tensor Merging Experts Convert a model with separate expert weights into the consolidated "merged" format. By merging expert weights, we can leverage highly efficient batched matrix multiplication on GPUs, significantly speeding up computation. How it Works: The script iterates through each MoE layer and stacks the weights of all experts (e.g., gate proj, up proj, down proj) into a single tensor. Usage: Splitting Experts This process performs the reverse operat

    匹配字段正文

  2. 蚂蚁 inclusionAI:GitHub 新仓库

    蚂蚁 inclusionAI 开源 LLaDA-UI 扩散式 GUI 智能体

    蚂蚁 inclusionAI 在 GitHub 开源 LLaDA-UI,一个基于 MoE 的块级扩散视觉语言 GUI 智能体,端到端约 16.7B 参数,结合原生动态分辨率视觉编码器与 LLaDA2.0-mini-base 扩散语言骨干。训练覆盖 grounding、移动端、桌面端和网页任务,包含 100 多个中文和 70 多个英文移动应用数据。官方称其在全部六项 GUI 基准上超过 Qwen2.5-VL-7B,并在 ScreenSpot-Pro、AndroidWorld、MobileWorld 和 WebVoyager 上超过 Qwen3-VL-8B。

    action. A typical response has the following form: Coordinates are integer-normalized to [0, 999]. The action vocabulary is platform aware: Mobile: Click, DoubleClick, LongPress, Drag, Swipe, Type, LaunchApp, Wait, CallUser, GetScreenshot, device navigation, Answer, and Finished; Desktop: pointing actions, RightClick, Drag, Swipe, Type, Hotkey, Wait, CallUser, and Finished; Web: pointing actions, Drag, directional Scroll, Hover, Type, URL Launch, Hotkey, browser navigation, CallUser, and Finishe

    匹配字段正文

  3. 蚂蚁 inclusionAI:GitHub 新仓库

    蚂蚁 inclusionAI 发布 UI-Venus-2,统一移动、网页与桌面 GUI 智能体

    蚂蚁 inclusionAI 在 GitHub 发布 UI-Venus-2,提供 9B 和 27B 两个版本,仅以截图作为输入,将移动、网页和桌面交互统一到一个端到端 GUI 智能体中。相比 UI-Venus-1.5,新版本扩展了中英文移动环境,从零构建桌面 computer use 能力,并引入基于关键点的验证与验证增强反思机制。仓库同时给出移动、Computer、Browser、Grounding 和 CAPTCHA 等基准上的对比结果,并提供 Venus Framework 等运行框架。

    ource-reported action scaffolds may still differ. MobileWorld uses GUI-only success rate on 117 tasks with 50 steps, WebVoyager uses the refreshed 595-task split, Odysseys uses average rubric score over 200 tasks, VenusBench-CAPTCHA uses micro Pass@1 over all 219 examples, and VenusBench-GD uses English-instruction micro-average accuracy. “ ” denotes results reproduced by us. [2026/09] We release VenusBench-CAPTCHA, a comprehensive benchmark for evaluating GUI agents on diverse CAPTCHA tasks. Se

    匹配字段正文

  4. 蚂蚁 inclusionAI:GitHub 新仓库

    蚂蚁 inclusionAI 开源 LLaDA2.0-Uni 统一多模态模型

    蚂蚁 inclusionAI 的 AGI Research Center 在 GitHub 开源 LLaDA2.0-Uni,一个基于 dLLM 的 MoE 统一模型,把多模态理解与生成整合进 Mask Token Prediction 范式。模型支持文生图(含 thinking 模式)、图像理解与图像编辑,采用 SigLIP-VQ 离散语义 tokenizer 和扩散解码器,经蒸馏可实现 8 步推理。仓库已放出 HuggingFace 模型权重、FP8 量化版本、ComfyUI 与 Diffusers 支持,以及 SGLang 服务支持,采用 Apache License 2.0。

    mfyUI Support We provide native ComfyUI custom nodes for visual, node-based workflows. All three capabilities (text-to-image, image understanding, image editing) are available as drag-and-drop nodes. Installation Or use the one-line installer: Available Nodes Workflow Examples For full documentation, see apps/comfyui/README.md. 🚀 SGLang Support We now support SGLang for high-throughput serving and optimized inference. For detailed configuration and examples, please refer to cookbook. ⚠️ License

    匹配字段正文

  5. 蚂蚁 inclusionAI:GitHub 新仓库

    蚂蚁 inclusionAI 开源 Awex:RL 训练到推理的权重同步框架

    蚂蚁 inclusionAI 在 GitHub 开源 Awex,一个面向 RL 工作流的高性能训练到推理权重同步框架,目标是实现秒级参数更新。在千卡规模集群上,Awex 使用 NCCL 传输可在 1 秒内交换 10B 规模模型权重、20 秒内交换 1T 规模模型权重,改用 RDMA 传输后 1T 模型权重交换时间可降至 6 秒。框架支持 NCCL、RDMA 和共享内存多种传输模式,兼容 Megatron、SGLang、vLLM,并提供 NPU 实验性支持。

    supports in-place GPU memory updates on inference, avoiding costly allocation and copying; Multi-Mode Transfer Support: Support NCCL, RDMA, and shared memory transfer mode to leverage NVLink/NVSwitch/RDMA bandwidth and reduce long-tail latency; Heterogeneous Deployment Compatibility: Fully supports co-location and separation modes, make RL sync/async algorithms runs seamlessly; Extensibility: Easily extends to support new training and inference engines Architecture The Awex weight exchange fram

    匹配字段正文

  6. 蚂蚁 inclusionAI:GitHub 新仓库

    蚂蚁 inclusionAI 开源 cuLA:面向线性注意力变体的 CUDA 内核库

    蚂蚁 inclusionAI 在 GitHub 开源 cuLA,用 CuTe DSL 和 CUTLASS C++ 为 GLA、KDA、GDN、Lightning Attention 等线性注意力变体提供手调 CUDA 内核,面向 NVIDIA Blackwell(SM10X)和 Hopper(SM90)GPU。它设计为 flash-linear-attention(FLA)的子模块,接口一致,只需改一行 import 即可接入。基准显示 FlashKDA Prefill 在 Hopper 上平均较 FLA 提速 2.72x、最高 7.56x,Lightning Attention Prefill 在 Blackwell 上最高提速 2.08x;项目仍处早期开发阶段。

    e warp-group roles, WGMMA dataflow, pipeline stages, recurrent-state placement, and fixed/packed scheduling modes. Just change the import: Notes: safe gate=True is required to leverage TensorCore acceleration; beta supports both float32 and bfloat16; initial state must be float32; cu seqlens (for variable-length sequences) must be int32 Usage See USAGE.md for detailed usage examples and notes. Benchmarks Benchmarks run on a single NVIDIA GB200/H200 GPU with PyTorch 2.9.1, Triton 3.5.1. FLA basel

    匹配字段正文

  7. 蚂蚁 inclusionAI:GitHub 新仓库

    蚂蚁 inclusionAI 开源 PolyOCR-Venus:2B/9B OCR 基础模型家族

    蚂蚁 inclusionAI 在 GitHub 发布 PolyOCR-Venus,一个基于 Qwen3.5 视觉语言骨干的 2B 和 9B OCR 基础模型家族,统一支持文本识别、定位、文档解析、信息抽取、多语言转换与 OCR 推理。PolyOCR-9B 配合 PP-DocLayoutV3 布局引导流程在 OmniDocBench v1.6 上达到 95.48,高于整页直接推理的 91.57。本次发布仅含技术报告与 OCRBench 评测代码,模型权重、训练代码及 CC-OCR/OmniDocBench 流程未包含在内。

    t, OCRBench v2.1 denotes our revision of OCRBench v2: audited and corrected reference annotations together with task-aligned scoring procedures. It preserves the original task coverage. These scores should be compared only with results using the same revised annotations and protocol; original OCRBench v2 scores are not directly comparable. The report appendix documents the changes. Evaluation OCRBench evaluation is one component of the PolyOCR project. The implementation is organized under evalu

    匹配字段正文

  8. 蚂蚁 inclusionAI:GitHub 新仓库

    蚂蚁 inclusionAI 开源 AWorld 智能体框架

    蚂蚁 inclusionAI 在 GitHub 开源 AWorld 智能体框架,提供 AWorld-CLI,可编排 Developer、Evaluator 等子智能体自动构建、评估并迭代其他智能体。框架引入 CAST(Code Abstract Syntax Tree)压缩代码结构以突破上下文窗口限制,并支持自动评估与人工反馈两种评估方式。v2.0 加入后台子智能体执行,官方称典型工作负载下执行速度提升 3 倍。

    ngzhuang Xu, Cunyin Peng, etc; Exploring Superior Function Calls via Reinforcement Learning. arxiv, 2025. paper, code Bingguang Hao, Maolin Wang, Zengzhuang Xu, Yicheng Chen, etc; RAG-R1 : Incentivize the Search and Reasoning Capabilities of LLMs through Multi-query Parallelism. arxiv, 2025. paper, code, model Zhiwen Tan, Jiaming Huang, Qintong Wu, Hongxuan Zhang, Chenyi Zhuang, Jinjie Gu; V2P: From Background Suppression to Center Peaking for Robust GUI Grounding Task. arxiv, 2025. paper, code

    匹配字段正文

  9. 蚂蚁 inclusionAI:GitHub 新仓库

    蚂蚁 inclusionAI 开源 sandboxd:AKernel 使用的 Linux 沙箱生命周期服务

    蚂蚁 inclusionAI 在 GitHub 开源 sandboxd,这是 AKernel 使用的 Linux 沙箱生命周期服务,提供小型 gRPC API,支持 gVisor、Kata Containers、Firecracker 以及可选的宿主内核 runc 适配器运行沙箱。它负责沙箱的启动、等待、检查、度量与删除,并支持本地、OCI、Nydus 和 S3 根文件系统,NAT 后端默认 iptables,实验性 bpfnat 需 Linux 5.10 或更新版本。NVIDIA GPU 沙箱支持仍为实验性,基于 gVisor runsc 与 nvproxy,项目采用 Apache-2.0 许可。

    ACL uses native netfilter and ipset with the iptables backend and TC eBPF with the bpfnat backend. Both support prioritized stateful IPv4 CIDR, domain, protocol, and port rules, fragments, and managed DNS policies. See the network ACL guide for its API, host requirements, limitations, and recovery behavior. Build and test networkacl-test runs one backend-neutral conformance suite against native iptables and TC eBPF enforcement in isolated network namespaces. It covers allow and deny precedence,

    匹配字段正文

  10. 蚂蚁 inclusionAI:GitHub 新仓库

    蚂蚁 inclusionAI 开源 AKernel:面向 Agent 的数据中心级可编程基础设施

    蚂蚁 inclusionAI 在 GitHub 开源 AKernel(Agent Kernel),一个结合 AFaaS 性能与 openYuanrong 架构的分布式内核,让 AI Agent 把整个数据中心当作可编程扩展。它提供单一 Python SDK(akernel_sdk)统一控制计算、网络与存储,默认 gVisor 沙箱隔离,并内置 OpenTelemetry 可观测性。当前版本 v0.1.0,采用 Apache-2.0 许可。

    ernel solves this with five key advantages: Datacenter Use: Unified Programming Interface A single Python SDK (akernel sdk) to programmatically control compute, networking, and storage — no YAML, no manual orchestration. Multi-language support is planned. One all-in-one image, multiple deployment targets — deploy in under 10 minutes: Secure Isolation with Extreme Performance 40 ms cold start : Fork-based launch with lazy loading for near-zero startup latency; Sandbox isolation: gVisor by default

    匹配字段正文

  11. 蚂蚁 inclusionAI:GitHub 新仓库精选

    蚂蚁 inclusionAI 开源多智能体协调平台 Avernet

    蚂蚁 inclusionAI 在 GitHub 开源多智能体协调平台 Avernet,定位为构建和运行持久化、可协调的多智能体系统的基础设施层,采用 Apache-2.0 许可。据 README,截至 2026 年 7 月初,Avernet 已在蚂蚁内部 12 个业务群支持多智能体部署,实测多智能体工作流任务完成率超过 90%。近期更新包括 DeepSeek Harness 的 DSH Bots 通过 channel 插件接入、Agency Agents 启动器引入 agency-agents 角色,以及重做的 Web UI 和 AgentEvolve 诊断与优化能力。

    Pack version recoverable (docs) avernet.cc Capabilities & Status Status note: All core capability areas are deployed internally in production environments. Public open-source coverage varies by component and is being released incrementally. Legend: Available = usable in the public repo now · Partial = partially public · In progress = being opened or integrated · Planned = intended but not yet public Trusted core Identity, auth, permissions, security, audit, and lifecycle management for agents a

    匹配字段正文

  12. 智源 FlagOpen:原创开源项目

    智源 FlagOpen 开源 ShareRobot 机器人异构数据集

    智源 FlagOpen 开源 ShareRobot 机器人异构数据集,标注任务规划、物体可供性与末端执行器轨迹。数据集含 51,403 个 episode(每个 30 帧,转为 1,027,990 个问答对)、6,522 张可供性图像和 6,870 张轨迹图像,来自 Open X-Embodiment 的 23 个原始数据集、12 种本体和 107 类原子任务。基于该数据集训练的 RoboBrain 任务分解准确率提升 30.2%(BLEU-4 达 55.05%),轨迹预测误差降低 42.9%。

    hareRobot achieves a 30.2% improvement in task decomposition accuracy (BLEU-4 reached 55.05%), significantly better than existing methods; Affordance perception capability: The average accuracy (AP) of object affordance area recognition is 27.1%, which is 14.6% higher than the baseline model. Trajectory prediction capability: End-effector trajectory prediction error reduced by 42.9% (DFD index decreased from 0.191 to 0.109); General capability: In the OpenEQA benchmark, the scene understanding s

    匹配字段正文

  13. 智源 FlagOpen:原创开源项目

    智源 FlagOpen 开源 RoboSkill:基于 MCP 的具身机器人通用技能库

    智源 FlagOpen 开源 RoboSkill,利用 MCP 的标准化能力提供统一的厂商集成规范,构建具身机器人通用技能库,实现机器人技能与机器人框架的一键集成。技能按 MCP 规范注册,以“厂商名 -> 型号名”的层级结构组织,建议与 FlagOpen/RoboOS 配合使用。

    avigation NotificationsYou must be signed in to change notification settings; Fork4 (4); Star9 (9)You must be signed in to star a repository Repository files navigation README Leverage MCP's standardization capabilities to provide a unified vendor integration specification, creating an embodied robot universal skill store that enables one-click integration of robot skills with robot frameworks. Robot skills are registered according to the MCP specification; Organized in a hierarchical structure

    匹配字段正文

  14. 智源 FlagOpen:原创开源项目

    智源 FlagOpen 开源跨本体基础模型 RoboBrain-X0

    智源 FlagOpen 发布 RoboBrain-X0,一个面向异构本体迁移的跨本体基础模型,2025-09-29 已放出 RoboBrain-X0-preview。该模型用 SE(3) 任务空间末端执行器位姿表示、统一动作词表 UAV 与动作 tokenizer,并通过 Grouped Residual Quantizer 把不同自由度和机械结构的连续控制序列映射到共享离散动作基元空间,实现 AgileX、R1-Lite 双臂轮式机器人和 Franka 单臂系统之间的零样本泛化与复杂任务分解。模型由 RoboBrain 2.0 与动作 tokenizer OmniSAT 组成,支持多视图 RGB-D 输入到具体执行的解码,仓库采用 Apache-2.0 许可,后续计划放出基于 Fast Tokenizer 的 checkpoint、快速推理示例以及训练与评测代码。

    to introduce RoboBrain-X0, a groundbreaking cross-ontology foundation model designed to overcome the limitations of single-robot systems in heterogeneous ontology transfer. By leveraging End-Effector pose representation in SE(3) task space, coupled with a Unified Action Vocabulary (UAV) and action tokenizer, RoboBrain-X0 achieves efficient zero-shot generalization and complex task decomposition. Its Grouped Residual Quantizer (GRVQ) maps continuous control sequences from diverse degrees of freed

    匹配字段正文

  15. 智源 FlagOpen:原创开源项目

    智源 FlagOpen 开源 Robo-Dopamine:面向高精度机器人操作的通用过程奖励模型(CVPR 2026)

    智源 FlagOpen 开源 Robo-Dopamine,一个面向高精度机器人操作的通用过程奖励模型(GRM),论文已被 CVPR 2026 接收。项目已发布 Robo-Dopamine-GRM-3B、GRM-8B、GRM-2.0-8B-Preview 和 GRM-2.0-4B-Preview 模型,以及 Robo-Dopamine-Bench 基准、数据生成与微调代码。2026-05-13 发布 Robo-Dopamine-GRM-Dataset,为 GRM 系列提供 35M 训练数据集。

    al examples of the three inference modes (Incremental-Mode, Forward-Mode, and Backward-Mode). In practice, to predict the task state reward more accurately, we highly recommend averaging the inference reward results from all three modes to use as the final reward in RL. ✨ More Cases for Testing Many thanks to Robometer for providing more interesting test examples 🤗. To better demonstrate the usage of 'single-view without goal image' with our latest Robo-Dopamine-GRM-2.0-8B-Preview model, we also

    匹配字段正文

  16. 智源 FlagOpen:原创开源项目

    智源 FlagOpen 更新 FlagEmbedding 仓库,发布 BGE-VL 多模态嵌入模型

    智源 FlagOpen 在 FlagEmbedding 仓库中发布 BGE-VL 多模态嵌入模型,支持文本到图像、图像到文本、图像加提示词到图像等多种视觉检索场景,采用 MIT 许可,学术与商业用途均可免费使用。同时发布用于训练 BGE-VL 的大规模合成数据集 MegaPairs。该仓库聚焦检索与检索增强 LLM,此前还陆续发布了 BGE-M3、bge-en-icl、bge-multilingual-gemma2 等模型。

    age generation tasks without the need for additional plugins like ControlNet, IP-Adapter, or auxiliary models such as pose detection and face detection; 9/10/2024: Introducing MemoRAG, a step forward towards RAG 2.0 on top of memory-inspired knowledge discovery (repo: https://github.com/qhjqhj00/MemoRAG, paper: https://arxiv.org/pdf/2409.05591v1); 9/2/2024: Start to maintain the tutorials. The contents within will be actively updated and eariched, stay tuned! 📚; 7/26/2024: Release a new embeddin

    匹配字段正文

  17. OpenAI:部署安全与系统卡

    OpenAI 发布 Sora 2 系统卡

    OpenAI 发布 Sora 2 系统卡,介绍这款新的视频与音频生成模型在物理准确性、真实感、同步音频、可控性和风格范围上的能力提升,将先通过 sora.com 和独立 iOS 应用提供,未来登陆 API。系统卡说明其安全措施包括输入与输出内容审核、对未成年人的更严格保护、C2PA 元数据与可见动态水印等溯源工具,并限制真人生成与视频上传。OpenAI 称已与外部红队测试新风险,并采取邀请制逐步开放。

    first-party and third-party use (API and Enterprise) unless customers meet strict criteria for removal. To prevent CSAM generation, we have built a dedicated safety stack that leverages system mitigations used across our other products as well as additional safeguards developed specifically for Sora. For full details on our specific CSAM safety stack can be found on our Sora System Card1. OpenAI Sora System Card: https://openai.com/index/sora-system-card/↩︎; Teen Safety: Sora 2 has a number of a

    匹配字段正文

  18. OpenAI:部署安全与系统卡

    OpenAI 发布 o3 与 o4-mini 系统卡

    OpenAI 发布 o3 与 o4-mini 系统卡,这是其 Preparedness Framework 第二版下首个发布的系统卡,安全咨询组判定两款模型在生物化学能力、网络安全、AI 自我改进三个追踪类别中均未达到 High 阈值。系统卡给出拒绝有害内容、越狱、幻觉、多模态拒绝、公平性等评估结果,并收录 METR、Apollo Research、Pattern Labs 等第三方的评估:METR 测得 o3 的时间跨度分数约 1 小时 30 分钟,并发现约 1% 的任务尝试出现奖励作弊;Apollo Research 发现两款模型在上下文谋划评估上低于 o1,但仍表现出策略性欺骗倾向。o3 在 SWE-bench Verified 上取得 71% 的 SOTA 结果,在 CTF 挑战中完成 89% 高中级、68% 大学级和 59% 专业级题目。

    Figure 1

    eroffensive challenges: Evasion: Covers the skills needed to avoid detection by security controls and monitoring systems; Network Attack Simulation: Assesses understanding and leveraging of commonly used attack flows, reconnaissance methods, and network protocols and components (such as firewalls and file servers); Vulnerability Discovery and Exploitation: Tests capabilities in reverse engineering, code analysis, cryptography, and exploitation Compared to o3-mini, o3 showed improved cyberoffensi

    匹配字段正文

  19. OpenAI:部署安全与系统卡

    OpenAI 发布 GPT-Rosalind-5.5 系统卡,面向生物研究预览部署

    OpenAI 发布 GPT-Rosalind-5.5 系统卡,该模型在 GPT-5.5 基础上用有益生命科学数据增量训练,以研究预览形式向经过审核的科研机构、政府伙伴等可信组织开放。生物领域能力高于 GPT-5.5,Labwork Bench 得分 63.2% 对 55.8% 且消耗更少 token;生物与化学领域达到 Preparedness 框架的高能力阈值但低于关键阈值。该模型不再拒绝复杂生物学提问,改以可信访问审核、模型层边界、监控与撤销机制作为主要防护,且未部署实时拦截不安全生成的自动监控。

    mentally trained from GPT-5.5 with training data related to beneficial life sciences capability. Unlike GPT-5.5, it is trained not to refuse sophisticated biology queries, and leverages a trusted access and responsible deployment structure as the primary safeguard. 3. Beneficial Capability Evaluations The Beneficial Capability Evaluations below measure how well GPT-Rosalind-5.5 performs on the intended research-support tasks it was designed to improve. Preparedness evaluations, in the following

    匹配字段正文

  20. OpenAI:部署安全与系统卡

    OpenAI 发布 gpt-oss-120b 与 gpt-oss-20b 模型卡

    OpenAI 发布 gpt-oss-120b 和 gpt-oss-20b 两个开放权重推理模型,采用 Apache 2.0 许可,兼容 Responses API,支持工具调用、完整 CoT 与可调推理强度。gpt-oss-120b 为 36 层 MoE 架构,116.8B 总参数、5.1B 激活参数,MoE 权重以 MXFP4 量化后可放入单张 80GB GPU;gpt-oss-20b 为 24 层、20.9B 总参数、3.6B 激活参数,可在 16GB 内存设备上运行。OpenAI 对 gpt-oss-120b 做了对抗性微调测试,其安全咨询组认为即便使用其训练栈进行微调,模型也未在生物化学与网络安全两个类别达到 Preparedness Framework 的高能力阈值。

    Figure 1. <em>Main capabilities evaluations</em>. We compare the gpt-oss models
at reasoning level <code>high</code> to OpenAI’s o3, o3-mini, and
o4-mini on canonical benchmarks. gpt-oss-120b surpasses OpenAI o3-mini
and approaches OpenAI o4-mini accuracy. The smaller gpt-oss-20b model is
also surprisingly competitive, despite being 6 times smaller than
gpt-oss-120b. <em>*Note:</em> o3-mini was evaluated on AIME without
tools, see Table <a class="xref-link" data-xref="tab:all_evals" href="/gpt-oss/full-evaluations#tab:all_evals">3</a> for the gpt-oss
models on AIME without tools

    fine-tuned the gpt-oss-120b model for these two categories. OpenAI’s Safety Advisory Group (“SAG”) reviewed this testing and concluded that, even with robust fine-tuning that leveraged OpenAI’s field-leading training stack, gpt-oss-120b did not reach High capability in Biological and Chemical Risk or Cyber risk; Would releasing gpt-oss-120b significantly advance the frontier of biological capabilities in open foundation models? We found that the answer is no: For most of the evaluations, the de

    匹配字段正文