English translation is being prepared.
Matched fieldsSummary
←Search results
English text is being prepared.
English translation is being prepared.
Matched fieldsSummary
English translation is being prepared.
Matched fieldsSummary
Databricks uses Lakebase branching to create an independent database per PR: a CI/CD practice
Databricks describes Snorkel AI's CI/CD solution that uses Lakebase branching to create an independent read-write database for each open PR, reducing branch readiness time from over 30 minutes to under 60 seconds. Branches use copy-on-write; on a production dataset of about 2.5 TB, 100 concurrent PR branches store only 5 to 10 GB of data each for their own changes, and TTL automatically cleans them up after the PR ends. Production data is continuously synchronized to the main branch via AWS DMS; developers log in with Okta SSO, and the CI pipeline authenticates with a service principal and short-lived OAuth tokens.
Databricks describes Snorkel AI's CI/CD solution that uses Lakebase branching to create an independent read-write database for each open PR, reducing branch readiness time from over 30 minutes to under 60 seconds. Branches use copy-on-write; on a production dataset of about 2.5 TB, 100 concurrent PR branches store only 5 to 10 GB of data each for their own changes, and TTL automatically cleans them up after the PR ends. Production data is continuously synchronized to the main branch via AWS DMS;
Matched fieldsBody
Reinforcement Learning Terminology for LLM Readers: How a Single Score Is Distributed to Each Token
The article uses DeepSeek-R1-Zero's pass@1 on AIME 2024 rising from 15.6% to 71.0% as an example to show that a rule-based judge gives only a single score for the entire response, whereas training needs to adjust the probability of each token. The author uses the sampling example "Is OpenAI open?" to explain in turn policy, state, action, reward, return, value, Q, advantage, baseline, TD error, GAE, clipping, and KL, and points out that PPO uses a critic to learn V, while GRPO uses the average score within a group to replace V.
The article uses DeepSeek-R1-Zero's pass@1 on AIME 2024 rising from 15.6% to 71.0% as an example to show that a rule-based judge gives only a single score for the entire response, whereas training needs to adjust the probability of each token. The author uses the sampling example "Is OpenAI open?" to explain in turn policy, state, action, reward, return, value, Q, advantage, baseline, TD error, GAE, clipping, and KL, and points out that PPO uses a critic to learn V, while GRPO uses the average s
Matched fieldsBody
Artificial Analysis Intelligence Index v5 is live, Claude…
Artificial Analysis Intelligence Index v5 is live, featuring 2 new benchmarks and 3 upgrades, of which 60% are based on private test sets or held-out answers. Claude Opus 5.5 (max) leads with 58 points, followed closely by GPT-6 Astra (max) at 57 points and GPT-6.1 Sol (max) at 55 points, with Gemini 4 Argon (high) further back at 50 points. The gap between open-weight models and the leader has widened from 3 points to 12 points; among released weights, DeepSeek V4.1 Flash 1017 (max) and GLM-5.3 (max) lead with 32 points.
Artificial Analysis Intelligence Index v5 is live, featuring 2 new benchmarks and 3 upgrades, of which 60% are based on private test sets or held-out answers. Claude Opus 5.5 (max) leads with 58 points, followed closely by GPT-6 Astra (max) at 57 points and GPT-6.1 Sol (max) at 55 points, with Gemini 4 Argon (high) further back at 50 points. The gap between open-weight models and the leader has widened from 3 points to 12 points; among released weights, DeepSeek V4.1 Flash 1017 (max) and GLM-5.3
Matched fieldsBody
Pydantic compares code mode and tool calling across 5,276 runs
Michael Pfaffenberger of Pydantic used 5 small Pydantic AI applications and 8 models to conduct 5,276 scored runs, comparing code mode with direct tool calling. On long tasks, code mode reduced average cost by 58%, latency by 51%, and increased success rate by 16 percentage points; however, for short tasks with 5 items, 3 out of 5 tasks were instead 21% to 38% more expensive. The author argues that models are better at writing loops than at acting as the loop, and the gap widens as tasks get longer.
Michael Pfaffenberger of Pydantic used 5 small Pydantic AI applications and 8 models to conduct 5,276 scored runs, comparing code mode with direct tool calling. On long tasks, code mode reduced average cost by 58%, latency by 51%, and increased success rate by 16 percentage points; however, for short tasks with 5 items, 3 out of 5 tasks were instead 21% to 38% more expensive. The author argues that models are better at writing loops than at acting as the loop, and the gap widens as tasks get lon
Matched fieldsBody
SlopCodeBench Retest: GPT-6 Astra Leads with 16.3% Strict Pass Rate, Ahead of Opus 5.5
The author retested frontier models using the full version of SlopCodeBench (36 questions, 196 checkpoints per setting). The highest was GPT-6 Astra with a strict pass rate of 16.3%, above GPT-5.5's 14.8% in May, with the tested models overall ranging from 12.2% to 16.3%. In the three full comparisons, the XHigh tier cost 2.11-4.22 times that of Medium, but Opus 5.5 actually had more strict passes at the Medium tier (28 vs. 25), while Astra and SOL performed better at the XHigh tier. Regarding code quality, Opus 5.5 XHigh had a slop line proportion of 77.75%, lower than Medium's 94.25%; the author cautions that this may be because the new models produce new anti-patterns not yet covered by the 200-plus linters.
The author retested frontier models using the full version of SlopCodeBench (36 questions, 196 checkpoints per setting). The highest was GPT-6 Astra with a strict pass rate of 16.3%, above GPT-5.5's 14.8% in May, with the tested models overall ranging from 12.2% to 16.3%. In the three full comparisons, the XHigh tier cost 2.11-4.22 times that of Medium, but Opus 5.5 actually had more strict passes at the Medium tier (28 vs. 25), while Astra and SOL performed better at the XHigh tier. Regarding c
Matched fieldsBody
GPT-6.1 Terra ranks 14th on Code Arena WebDev with 1,671 points and a 28% lower cost per task
Arena.ai announced that OpenAI's GPT-6.1 Terra (Max) ranks 14th on Code Arena: WebDev with 1,671 points, 151 points higher than GPT-5.6 Terra, which now ranks 56th. Its median cost per task is $0.40, 28% lower than GPT-5.6 Terra's $0.56. Within the same family, it is 81 points below the 4th-ranked GPT-6.1 Sol (1,752 points), but its median cost per task is 75% lower; it is 6 points below the 11th-ranked GPT-6 Sol (1,677 points), with a 76% lower cost.
Matched fieldsBody
Perplexity Publishes LLM Gateway Best Practices Guide, Outlining Request Flow and Production Risks
On October 27, 2026, Perplexity published an LLM gateway best practices guide explaining how this middleware layer routes, authenticates, caches, and logs model calls, and distinguishing four categories: API gateways, LLM gateways, MCP gateways, and AI gateways. The guide breaks down the mechanism through a six-step request lifecycle, while warning that the gateway centralizes credentials from various providers, and cites the LiteLLM gateway breach disclosed by Microsoft and two high-severity vulnerabilities, CVE-2026-35029 and CVE-2026-59823, reported by Check Point (already fixed in LiteLLM 1.83.9). The article also lists postmortems of Cloudflare AI Gateway and OpenRouter outages, four deployment paths, and paid plans starting at about $50 per month.
On October 27, 2026, Perplexity published an LLM gateway best practices guide explaining how this middleware layer routes, authenticates, caches, and logs model calls, and distinguishing four categories: API gateways, LLM gateways, MCP gateways, and AI gateways. The guide breaks down the mechanism through a six-step request lifecycle, while warning that the gateway centralizes credentials from various providers, and cites the LiteLLM gateway breach disclosed by Microsoft and two high-severity vu
Matched fieldsBody
NVIDIA Explains How to Fine-Tune Nemotron 3.5 Lightning with the Nemotron-Personas Dataset
NVIDIA has released the Nemotron-Personas France and Belgium datasets and provided a complete post-training workflow for fine-tuning Nemotron 3.5 Lightning with them. The workflow includes defining behavior contracts, generating synthetic conversations with personas, fine-tuning with LoRA on NVIDIA NeMo, merging adapters, and then comparing and evaluating item by item against the base model on a frozen test set. The France dataset was built in collaboration with Pleias, and the Belgium dataset involved Pleias and KU Leuven; the Nemotron repository provides reusable steps and agent skills for data generation, training, and evaluation.
NVIDIA has released the Nemotron-Personas France and Belgium datasets and provided a complete post-training workflow for fine-tuning Nemotron 3.5 Lightning with them. The workflow includes defining behavior contracts, generating synthetic conversations with personas, fine-tuning with LoRA on NVIDIA NeMo, merging adapters, and then comparing and evaluating item by item against the base model on a frozen test set. The France dataset was built in collaboration with Pleias, and the Belgium dataset i
Matched fieldsBody
How LangChain Built the Design Agent Content Studio
LangChain's GTM engineering team, working with the design team, built Content Studio, a design agent inside Slack, on Managed Deep Agents. It can generate videos, social graphics, UI mockups, and slide decks, and has already produced more than 3,000 assets and over 80 slide decks. The article breaks down its four-layer knowledge structure (skills, wiki, code validation, memory), the dedicated LangSmith Sandbox for each Slack thread, the two rendering engines HyperFrames and the in-house motion-studio, and how the main agent orchestrates asynchronous sub-agents. The team says that after migrating to Managed Deep Agents, its own code shrank by about 80%, the median model cost per request fell from about $8 in mid-September to about 50 cents, and the entire harness has been open-sourced.
LangChain's GTM engineering team, working with the design team, built Content Studio, a design agent inside Slack, on Managed Deep Agents. It can generate videos, social graphics, UI mockups, and slide decks, and has already produced more than 3,000 assets and over 80 slide decks. The article breaks down its four-layer knowledge structure (skills, wiki, code validation, memory), the dedicated LangSmith Sandbox for each Slack thread, the two rendering engines HyperFrames and the in-house motion-s
Matched fieldsBody
Gemini 4 Carbon Tops the Artificial Analysis Intelligence Index v5
Google's Gemini 4 Carbon ranks first on the Artificial Analysis Intelligence Index v5 with a score of 59, leading in four of the 9 evaluations: HLE-Diamond, Terminal-Bench-Science, AA-Omniscience, and AutomationBench-AA. On the Coding Agent Index, Gemini 4 Carbon (high) paired with the Antigravity CLI scores 59, trailing Claude Code paired with Claude Opus 5.5 (max, 62 points) by 3 points. The model has a 1M-token context window, supports text, image, video, and speech input, and is priced at a standard rate of $4/$20 per million input/output tokens; it is currently available to select users with a 50% discount.
Google's Gemini 4 Carbon ranks first on the Artificial Analysis Intelligence Index v5 with a score of 59, leading in four of the 9 evaluations: HLE-Diamond, Terminal-Bench-Science, AA-Omniscience, and AutomationBench-AA. On the Coding Agent Index, Gemini 4 Carbon (high) paired with the Antigravity CLI scores 59, trailing Claude Code paired with Claude Opus 5.5 (max, 62 points) by 3 points. The model has a 1M-token context window, supports text, image, video, and speech input, and is priced at a
Matched fieldsBody
Artificial Analysis releases the image-to-video benchmark AA-Video-I2V v2.1
Artificial Analysis launches the image-to-video evaluation benchmarks AA-Video-I2V v2.1 and AA-Video-I2V-Silent v2.1, ranking models at up to 1080p resolution across 10 use-case categories, 10 capabilities, and multiple visual styles. The two versions are based on more than 58,000 human preference votes across over 1,000 prompts and more than 44,000 votes across 500 prompts, respectively, with only 5% of prompts made public in the public arena and rotated monthly. In the first version of the leaderboard, Dreamina Seedance 2.5 ranks first overall, statistically tied with the Seedance 2.0 and MiniMax H3 series, at a price of $34.12/min; the open-weight MiniMax H3 (768p) ranks third, at a price of $4.80/min.
Artificial Analysis launches the image-to-video evaluation benchmarks AA-Video-I2V v2.1 and AA-Video-I2V-Silent v2.1, ranking models at up to 1080p resolution across 10 use-case categories, 10 capabilities, and multiple visual styles. The two versions are based on more than 58,000 human preference votes across over 1,000 prompts and more than 44,000 votes across 500 prompts, respectively, with only 5% of prompts made public in the public arena and rotated monthly. In the first version of the lea
Matched fieldsBody
Gemini 4 Carbon Tops the Artificial Analysis Intelligence Index…
Artificial Analysis evaluations show that Google's Gemini 4 Carbon tops Intelligence Index v5 with 59 points, ranking first in four of the 9 evaluations: HLE-Diamond, Terminal-Bench-Science, AA-Omniscience, and AutomationBench-AA. On the Coding Agent Index, Gemini 4 Carbon (high) paired with Antigravity CLI scores 59 points, 3 points behind Claude Code paired with Claude Opus 5.5 (max, 62 points). The model is currently available only to some users and has not yet been publicly released; it is priced at $4/$20 per 1M input/output tokens with a 50% discount, has a 1M-token context window, and supports text, image, video, and voice input.
Artificial Analysis evaluations show that Google's Gemini 4 Carbon tops Intelligence Index v5 with 59 points, ranking first in four of the 9 evaluations: HLE-Diamond, Terminal-Bench-Science, AA-Omniscience, and AutomationBench-AA. On the Coding Agent Index, Gemini 4 Carbon (high) paired with Antigravity CLI scores 59 points, 3 points behind Claude Code paired with Claude Opus 5.5 (max, 62 points). The model is currently available only to some users and has not yet been publicly released; it is p
Matched fieldsBody
Elorian Releases DecoyCount Benchmark: Frontier Models All Score Below 50% on Visual Counting Accuracy
Elorian and Mercor jointly released the DecoyCount benchmark, which tests whether models truly count objects or rely on visual shortcuts. Frontier models all scored below 50% accuracy, with the highest being GPT-6 Astra at 43.17%. Elorian says its visual reasoning model Glimpse scored 50.48% in a single run on 1,660 questions, making it the only model to exceed 50%, but this result comes from internal testing and did not use an agent or tool framework, whereas the six models in the paper each took the average of three runs. Elorian CEO Andrew Dai said the benchmark examines both vision and reasoning, and can distinguish whether a model failed to see the objects or miscounted them.
Elorian and Mercor jointly released the DecoyCount benchmark, which tests whether models truly count objects or rely on visual shortcuts. Frontier models all scored below 50% accuracy, with the highest being GPT-6 Astra at 43.17%. Elorian says its visual reasoning model Glimpse scored 50.48% in a single run on 1,660 questions, making it the only model to exceed 50%, but this result comes from internal testing and did not use an agent or tool framework, whereas the six models in the paper each to
Matched fieldsBody
How to Extract Structured Data from Websites with LLMs (2026)
Browser Use published a tutorial introducing a workflow for extracting structured data across multiple websites using a single JSON Schema: static pages are scraped to Markdown and then filled in by an LLM, while pages requiring login or clicks are handed off to a browser agent. The article provides a reliability checklist, including enabling structured output, validating with Pydantic or Zod, returning null for missing fields, preserving source_url and original-text citations, deduplicating by stable keys, respecting robots.txt, and spot-checking samples. It also compares Firecrawl, Crawl4AI, Browser Use, Stagehand, and a self-built Fetch+Markdown+LLM setup in terms of login and JS workflows, Schema support, open-source status, and billing.
Browser Use published a tutorial introducing a workflow for extracting structured data across multiple websites using a single JSON Schema: static pages are scraped to Markdown and then filled in by an LLM, while pages requiring login or clicks are handed off to a browser agent. The article provides a reliability checklist, including enabling structured output, validating with Pydantic or Zod, returning null for missing fields, preserving source url and original-text citations, deduplicating by
Matched fieldsBody
AWS explains prompt caching patterns for using OpenAI models on Amazon Bedrock
AWS has published a tutorial explaining how to use prompt caching to reduce the cost of agents repeatedly reading context when calling OpenAI models on Amazon Bedrock, distinguishing between two approaches—implicit caching and explicit prompt_cache_breakpoint—and recommending their combined use. The article provides code examples for tool and instruction caching, rolling breakpoints across multi-turn history, adding tools mid-session, and shared prefixes across sub-agents, and states that in a six-turn workload on GPT-6 Astra, implicit caching reduces input costs by about 62%, while explicit rolling breakpoints reduce them by about 61%. Cacheable prefixes must be at least 1024 tokens, and cache writes are billed at 1.25 times the normal input price.
AWS has published a tutorial explaining how to use prompt caching to reduce the cost of agents repeatedly reading context when calling OpenAI models on Amazon Bedrock, distinguishing between two approaches—implicit caching and explicit prompt cache breakpoint—and recommending their combined use. The article provides code examples for tool and instruction caching, rolling breakpoints across multi-turn history, adding tools mid-session, and shared prefixes across sub-agents, and states that in a s
Matched fieldsBody
How to get coding agents to use your already-logged-in Chrome
Browser Use published a guide introducing several ways to let coding agents work in a real, already-logged-in Chrome, including Claude in Chrome, Playwright MCP extension mode, Chrome DevTools MCP auto-connect mode, the Gemini CLI built-in browser agent, the ChatGPT desktop browser extension, and Browser Harness. The article gives configuration commands and limitations separately for agents such as Claude Code, Codex, Gemini CLI, and Cursor, and explains that starting with Chrome 136, --remote-debugging-port and --remote-debugging-pipe on the default data directory will be ignored, so the old practice of copying cookies to a new browser will fail in scenarios such as device-bound sessions.
Browser Use published a guide introducing several ways to let coding agents work in a real, already-logged-in Chrome, including Claude in Chrome, Playwright MCP extension mode, Chrome DevTools MCP auto-connect mode, the Gemini CLI built-in browser agent, the ChatGPT desktop browser extension, and Browser Harness. The article gives configuration commands and limitations separately for agents such as Claude Code, Codex, Gemini CLI, and Cursor, and explains that starting with Chrome 136, --remote-d
Matched fieldsBody
LangChain summarizes the five components for building company-level agents
Harrison Chase and Caspar Broekhuizen of LangChain published an article summarizing the five core components shared by its three internal agents for marketing, sales, and engineering: agents live in existing workplaces such as Slack, a distinction between acting on behalf of users and a fixed identity, global and user-level memory, code execution within a sandbox, and a large number of runs triggered by schedules or events. The article uses GTM Agent, OpenSWE, and Content Studio as examples to explain their specific approaches to identity, memory, and code execution, all three of which are built on Managed Deep Agents.
Harrison Chase and Caspar Broekhuizen of LangChain published an article summarizing the five core components shared by its three internal agents for marketing, sales, and engineering: agents live in existing workplaces such as Slack, a distinction between acting on behalf of users and a fixed identity, global and user-level memory, code execution within a sandbox, and a large number of runs triggered by schedules or events. The article uses GTM Agent, OpenSWE, and Content Studio as examples to e
Matched fieldsBody