←Multimodal
← All topics

Multimodal

Understanding and generation across text, images, audio and video.

Public reading groups
195
Last 30 days
74
Directory status
Curated topic

LatestGoogle Releases Gemini 4 Carbon Model, Focused on Long-Horizon Agentic Workflows

Latest reading groups

Duplicate reports of the same fact are grouped

  1. ZhidongxiModel releases
    AI score91

    Google Releases Gemini 4 Carbon Model, Focused on Long-Horizon Agentic Workflows

    Google has released its flagship model Gemini 4 Carbon, built specifically for continuously running agentic workflows, with a focus on improving coding, agentic, scientific task, and full-stack web development capabilities. The model ranks first on the Artificial Analysis Intelligence Index v5.0 with a score of 59, surpassing Claude Opus 5.5, GPT-6 Astra, and GPT-6.1 Sol; the launch promotional price is $2 per million input tokens and $10 per million output tokens, with a 95% discount available for cached input tokens. Carbon adopts a phased rollout strategy, first opening to select cybersecurity defenders, then expanding the range of trusted partners through the Fairwind program, and afterward opening to developers, enterprises, and consumers.

    Why read thisThe original article lists Carbon's rankings on multiple benchmarks and its phased rollout strategy, allowing comparison of its capability differences with GPT-6 and the Claude series.

  2. Kimi.aiFirst-partyProduct release
    AI score64

    Kimi Launches 3D Make, Enabling Modeling and Game Development via Blender and CAD Tools

    Kimi has launched 3D Make, which can connect to tools such as Blender and CAD to create models, assemble scenes, and develop games. The feature is now available on the Kimi official website and Kimi Work, and the official team has also released 5 usage tips and step-by-step instructions.

    Why read thisThe official announcement explains Kimi's modeling, scene-building, and game development capabilities after integrating with Blender and CAD tools, and provides access points.

  3. Mistral AIFirst-partyModel releases
    AI score87

    Mistral Releases Open Weights for Mistral Large 4 (Le Chonk)

    Mistral has released the open weights for Mistral Large 4 (Le Chonk), a 1-trillion-parameter natively multimodal model that continues reinforcement learning on top of the preview version, with improved coding and defensive cybersecurity capabilities. It scores 19.7% on FrontierCode 2.0 and 48% on the Artificial Analysis Coding Agent Index, roughly on par with GLM-5.3, but uses an average of 47% fewer tokens per task; on Terminal-Bench 4.0 it improves by 13 percentage points to 41%. The model supports three reasoning modes, uses a modified MIT-based Mistral Ecosystem Open-Weight license, and is priced via API at $0.70 per million input tokens, $0.07 for cached input, and $2.10 for output.

    Le Chonk signal

    Why read thisThe original text provides open weights, three reasoning modes, and comparisons across multiple benchmarks, allowing readers to judge the trade-offs for self-hosted coding and security scenarios.

  1. Hugging FaceFirst-partyModel releases
    AI score83

    Liquid AI Releases the LFM3 Series of Models, Including 1.7B Text, Vision, Audio, and Omni Versions

    Liquid AI has released the LFM3 series of open-weight models, all branched from LFM3-1.7B-Base, covering text, vision, audio, Omni, and the d1 decision model. LFM3-1.7B-Base adopts a three-hybrid-layer architecture, is pretrained on 22T tokens, and in the mid-training stage over the final 3.5T tokens incorporates more agent trajectories and tool-calling data, with the context window extended to 256K tokens. The company says LFM3-1.7B is about 25% faster than LFM2-1.2B at an 8K context, and scores 38.42 versus 3.02 on WebArena-Verified; LFM3-VL-2B's average score across 62 vision benchmarks rises from 57.6 to 71.4. All models are available for download on Hugging Face, along with a single-GPU fine-tuning notebook.

    Why read thisThe original article presents the architectural changes shared by the six models on a common backbone and on-device benchmark data, which can be used to assess the trade-offs of the small-model specialization approach on long-context and agentic tasks.

  2. Google BlogFirst-partyModel releases
    AI score78

    Google DeepMind releases world model Genie 4, supporting real-time interactive simulation and native audio

    Google DeepMind releases the world model Genie 4, focused on real-time interactive simulation and introducing native audio for the first time in the series. The model is built on capabilities from the Gemini family: Gemini Omni is responsible for making simulations match the appearance and behavior of the real world, while other Gemini models provide the complex reasoning needed to maintain simulation coherence. Users can control scenes in real time using natural language, such as moving the camera, changing the weather, or introducing new characters, and each world also generates ambient sound, music, and interactive dialogue on the fly.

    Why read thisThe original text explains that Genie 4 adds native audio and natural language control to real-time interactive simulation, allowing readers to understand the new capability boundaries of world models.

  3. Google BlogFirst-partyProduct release
    AI score60

    Gemini app launches immersive explorations library, supports layered browsing of topics

    The Gemini app has added an immersive explorations library. Users can enter by clicking "Try immersive explorations" in the student hub and explore topics ranging from microscopic systems to deep space layer by layer in an interactive, visual way. Each scene has clickable labels for deeper viewing, and audio narration is coming soon; the feature will later also be integrated directly into conversations with Gemini. The feature supports English, Indonesian, Hindi, Brazilian Portuguese, French, and Simplified Chinese; users of other languages can currently only use the English version.

    Why read thisThe original text explains the entry point, interaction method, and language coverage of immersive explorations, so readers can judge which learning scenarios it suits.

  4. Google BlogFirst-partyProduct release
    AI score68

    Google and XREAL Launch the First Android XR Wired Glasses, XREAL AURA

    Google and XREAL have launched the XREAL AURA, the first wired XR glasses powered by Android XR. Orders open today in the United States, Canada, and South Korea, with sales in Japan starting November 2, at a starting price of $1,099. The glasses weigh less than 95 grams, use transparent lenses and a 70-degree field of view to project apps into the user's field of view, and offload heavy computing to a portable computing puck connected by cable; the puck is powered by the debut Qualcomm Snapdragon Reality Elite platform. Users can open multiple apps at once and pair them with a Bluetooth keyboard and mouse, or connect a laptop screen as a window via USB-C wired mirroring, and Gemini can provide assistance based on the content in the field of view and on the screen.

    XREAL AURA

    Why read thisThe original text explains the combination of transparent lenses, a 70-degree field of view, and a split-computing puck, allowing readers to judge the boundaries of everyday use for wired XR glasses.

  1. BaiduFirst-partyModel releases
    AI score62

    Baidu Open-Sources Unlimited OCR 2 Document Parsing Model

    Baidu has open-sourced Unlimited OCR 2, which uses a new SR-SWA mechanism to compress the attention interaction between text and vision into a fixed-size working reference, thereby parsing documents of almost any length within a limited context window. Baidu says that as documents grow longer, per-step decoding latency and memory usage remain nearly constant, and that the model achieves SOTA performance on MPDocBench and MarathonDocBench, which cover documents ranging from dozens to hundreds of pages.

    Why read thisThe official release presents the SR-SWA mechanism and results on two long-document benchmarks, offering insight into the context and latency trade-offs of long-document OCR.

  2. ChatGPTFirst-partyModel releases
    AI score84

    OpenAI Releases GPT-6.1 Terra Model

    OpenAI has released a new model, GPT-6.1 Terra, which focuses on speed and efficiency, strengthens visual reasoning and precise computer operation, and writes more clearly and naturally. Starting today, the model is being rolled out to Plus, Pro, Enterprise and Edu users in ChatGPT Work and Codex; the company says it can cover work scenarios ranging from interpreting technical drawings and drafting proposals to filling out forms and editing videos.

    Why read thisThe official announcement sets out the new model's positioning in visual reasoning and computer operation, and explains the scope of access for paid users.

  3. heise onlineModel releases
    AI score80

    Moonshot AI releases Kimi K3.1 Pro, AA Intelligence Index rises to 55 points, ranking fourth

    Moonshot AI has released Kimi K3.1 Pro, which rose from 44 points for Kimi K3 to 55 points on the Artificial Analysis Intelligence Index, ranking fourth and trailing Claude Opus 5.5's 58 points. The model retains the MoE architecture with 2.8 trillion parameters and 104 billion activated parameters, has a context window of 1 million tokens, and supports text, image, and video input. The success rate on Terminal-Bench 4.0 rose from 13% to 67%, API input and output prices are $2 and $10 per million tokens respectively, and the weights are scheduled for release on November 4.

    Why read thisThe article gives K3.1 Pro's scores on independent leaderboards, benchmark improvements, and API pricing, which can be used to assess the gap between open-weight models and closed-source leaders.

  1. Kimi.aiFirst-partyModel releases
    AI score87

    Kimi releases K3.1 Pro open-weight model, 2.8T total parameters, 1M token context

    Kimi releases K3.1 Pro, its strongest 3T-class open-weight model, using a MoE architecture with 2.8T total parameters and 104B activated parameters, supporting a 1M token context and multimodality. Officially it is claimed to match the strongest closed-source models on coding, agent, and knowledge benchmarks, and to support full-project game development in Unreal, Unity, and Godot as well as parametric 3D modeling in Blender and CAD, with hallucinations in financial scenarios reduced by 65%. K3.1 Pro and K3.1 Pro Highspeed, which is 2–3 times faster, are already live on the Kimi official website, Kimi Work, Kimi Code, and the Kimi API, with open weights planned for release on November 4, 2026.

    Why read thisThe official MoE specs of 2.8T total parameters and 104B activated, along with multimodal capabilities, allow judging the scale position of this open-weight model.

  2. UnslothFirst-partyModel releases
    AI score72

    NVIDIA releases Nemotron-3.5-Bolt-E4B, which can run locally on 6GB of memory

    NVIDIA releases Nemotron-3.5-Bolt-E4B, which can run locally on devices with 6GB of memory, targeting on-device devices such as phones. The model is trained based on Gemma 4, supports vision, and Unsloth also provides GGUF files and a guide link. NVIDIA says it targets scenarios such as local assistants, interactive characters, and robots that can converse and call tools.

    Why read thisThe original text gives the model's positioning of running locally on 6GB of memory and its visual capabilities, so readers can judge the usable boundaries of small models in on-device assistant scenarios.

  1. falModel releases
    AI score70

    Kling 4.0 launches on fal and opens its API

    Kling 4.0 has publicly launched on the fal platform, with its API open to all customers. The model supports native video generation with audio up to 30 seconds, up to 15 image/video/element references, and precise control of up to 10 keyframes, and improves motion, character consistency, and cinematic storytelling.

    Why read thisKling 4.0 launches on fal and opens its API; the original text lists specific capability changes such as duration, reference materials, and keyframe control.

  2. Google BlogFirst-partyModel releases
    AI score80

    Google releases Gemini 4 Argon, showcasing 5 community creative projects

    Google releases new frontier model Gemini 4 Argon, stating it performs outstandingly on complex tasks such as coding, mathematics, and 3D world building, and surpasses other frontier models on benchmarks across multiple domains. The official showcase features 5 community projects, including a 3D Earth that maps wildfires and seismic activity in real time, a turbofan engine simulation with real-time data, a 3D carriage generated from a single image, and a multiplayer capture-the-flag browser game. The model has been widely available since last week.

    Collage showing five builds with Gemini 4 Argon

    Why read thisOfficial lists five community cases, demonstrating the new model's concrete outputs on 3D scenes and multi-step tasks.

  1. Google ResearchFirst-partyResearch
    AI score64

    Google Research uses AI to assist blind-sweep ultrasound assessment of gestational age, with error comparable to experts

    Google Research published a study in JAMA Network Open; its AI gestational age assessment model based on blind-sweep ultrasound achieved a mean absolute error of 4.18 days in prospective testing in Chicago (n=192) and Nairobi (n=193), reaching non-inferiority compared with expert sonographers' 4.48 days. The model was fine-tuned only on data from 120 participants in Chicago and did not use Nairobi data; the errors in the two locations were 4.10 days and 4.27 days, respectively. The study used a Clarius C3 handheld probe, with standardized blind sweeps performed by operators without professional ultrasound training.

    Bar chart comparing the mean absolute error between the AI model and expert clinical standards across multiple cohorts.

    Why read thisThe study prospectively validated the same model in Chicago and Nairobi, maintaining the error level without local fine-tuning, showing how cross-scenario generalization can be implemented.

  1. Higgsfield AIProduct release
    AI score65

    Kling 4.0 launches on Higgsfield

    Kling 4.0 is now available on Higgsfield, supporting Omni Reference to handle characters, objects, and audio simultaneously in a single generation, generating 30-second scenes per run, and allowing control of each beat using start, middle, and end frames. Native 4K is coming soon and is currently available for use on Higgsfield.

    Why read thisThe original article lists several specific capability changes following Kling 4.0's launch on Higgsfield, which readers can use to assess how video generation workflows will be affected.

  2. ElevenLabs BlogFirst-partyProduct release
    AI score60

    ElevenLabs launches Eleven Realtime Translation real-time speech translation model

    ElevenLabs releases the real-time speech translation model Eleven Realtime Translation, currently available in alpha form to ElevenAPI enterprise customers. The model uses the low-latency speech model Eleven v4 Turbo by default, supports more than 90 languages and automatic language detection, keeps the same voice consistent across languages, and can be selected from a library of more than 17,500 voices or custom voice clones. Teams can adjust the translation startup speed, trading off between high-quality translation and low latency on complex calls; Deutsche Telekom has already built new call features based on ElevenLabs in its Magenta AI Call Assistant.

    Smiling person with tousled hair against a neutral background.

    Why read thisThe original text explains the adjustable-latency design and multilingual consistency of the real-time translation model, allowing readers to judge how it would be implemented in customer service and telecom scenarios.