←Search results

By relevance · Total 1528 results Clear search

Friday

  1. PyTorch Blog

    PyTorch Conference 2026 held in San Jose, announces progress on TorchTPU and TorchNeuron

    PyTorch Conference North America 2026 was held on October 20–21 in San Jose, attracting more than 3,500 attendees and focusing on accelerating open intelligence and projects including PyTorch, vLLM, DeepSpeed, Ray, Helion, and Safetensors. The event announced TorchTPU, a native PyTorch TPU backend developed in collaboration between Google and Meta, as well as TorchNeuron, a native backend for AWS Trainium, which entered public testing under Apache 2.0 on October 20. Shopify shared a case study of building a continuous learning loop with PyTorch and vLLM, saying it compresses production failures into model weights every day and has reduced serving costs by 96%.

    PyTorchCon community expo

    jects including PyTorch, vLLM, DeepSpeed, Ray, Helion, and Safetensors. The event announced TorchTPU, a native PyTorch TPU backend developed in collaboration between Google and Meta, as well as TorchNeuron, a native backend for AWS Trainium, which entered public testing under Apache 2.0 on October 20. Shopify shared a case study of building a continuous learning loop with PyTorch and vLLM, saying it compresses production failures into model weights every day and has reduced serving costs by 96%.

    Matched fieldsSummary、Body

  2. AWS Machine Learning

    Streaming low-latency speech for AI agents with Kokoro TTS on Amazon SageMaker AI

    AWS demonstrated a solution for hosting the Kokoro-82M text-to-speech model on Amazon SageMaker AI that lets AI agents stream-synthesize speech immediately as each sentence is generated, so playback does not have to wait for the full response to finish generating. Kokoro-82M has only 82 million parameters and can run on a single ml.g5.xlarge GPU instance; the container provides two routes, POST /invocations and WS /invocations-bidirectional-stream. The article also explains how binary WebSocket frames are handled in bidirectional streaming, and precautions for keeping the session from closing.

    Client connects to an Amazon SageMaker AI real-time endpoint on ml.g5.xlarge over InvokeEndpointWithBidirectionalStream. A Starlette ASGI app exposing GET /ping, POST /invocations, and WS /invocations-bidirectional-stream routes the WebSocket to a KPipeline running Kokoro-82M, which returns audio and control frames on the same connection.

    AWS demonstrated a solution for hosting the Kokoro-82M text-to-speech model on Amazon SageMaker AI that lets AI agents stream-synthesize speech immediately as each sentence is generated, so playback does not have to wait for the full response to finish generating. Kokoro-82M has only 82 million parameters and can run on a single ml.g5.xlarge GPU instance; the container provides two routes, POST /invocations and WS /invocations-bidirectional-stream. The article also explains how binary WebSocket

    Matched fieldsSummary、Body

  3. AWS Machine Learning

    How Amazon Quick Deploys AI in HIPAA-Compliant Environments

    Amazon Quick is a HIPAA-eligible service covering web, desktop, and mobile clients, and can be used to process PHI after signing an AWS BAA. Its chat agent can retrieve across unstructured data such as clinical notes and structured data such as claims and member records, and execute multi-step tasks through connectors including Slack, Microsoft Outlook, Salesforce, Jira, and SharePoint; it also supports connecting custom tools via MCP. HIPAA-eligible does not equal HIPAA compliant—users still need to complete data classification, configuration, governance, and administrative safeguards themselves.

    Amazon Quick is a HIPAA-eligible service covering web, desktop, and mobile clients, and can be used to process PHI after signing an AWS BAA. Its chat agent can retrieve across unstructured data such as clinical notes and structured data such as claims and member records, and execute multi-step tasks through connectors including Slack, Microsoft Outlook, Salesforce, Jira, and SharePoint; it also supports connecting custom tools via MCP. HIPAA-eligible does not equal HIPAA compliant—users still ne

    Matched fieldsSummary、Body

  4. AWS Machine Learning

    How IskayPet unified enterprise knowledge with Amazon Bedrock Managed Knowledge Bases

    IskayPet built an enterprise knowledge assistant on Amazon Bedrock Managed Knowledge Bases, covering retail operations, veterinary care, HR onboarding, and procurement, supporting four languages across three countries without self-managing RAG infrastructure. The assistant ingests existing documents directly through the native SharePoint connector, combines hybrid search of semantic and BM25 keyword search, managed reranking, and document-level permission controls, and returns answers with source citations. The entire solution, from the store frontend to the AWS architecture deployment, was completed by Kiro with Claude Haiku 4.5.

    Solution architecture

    R onboarding, and procurement, supporting four languages across three countries without self-managing RAG infrastructure. The assistant ingests existing documents directly through the native SharePoint connector, combines hybrid search of semantic and BM25 keyword search, managed reranking, and document-level permission controls, and returns answers with source citations. The entire solution, from the store frontend to the AWS architecture deployment, was completed by Kiro with Claude Haiku 4.5.

    Matched fieldsSummary、Body

  5. AWS Machine Learning

    Amazon Polly generative engine major upgrade: adds 14 new voices and supports Hindi and Finnish for the first time

    The Amazon Polly generative engine has completed an upgrade, adding 14 new voices across 9 locales and, for the first time, officially offering Hindi and Finnish in the generative engine. After the upgrade, it offers a total of 57 generative voices, covering 11 languages and 25 locales, and has expanded to AWS GovCloud (US-West), for a total of 11 AWS Regions. Existing voice names and API calls remain unchanged; this is an in-place upgrade with no price change and no code changes required.

    Matched fieldsSummary、Body

  6. AWS Machine Learning

    How Rescale Built an AI Triage Agent with Strands Agents and AI-DLC

    Rescale built an AI triage agent based on the AWS AI-DLC framework and Strands Agents, going from problem definition to pre-release deployment in just five days and reaching production within weeks. The agent runs in an Argo Workflows CI/CD pipeline on Amazon EKS, calls Claude Opus 4.8 on Amazon Bedrock to classify nightly Playwright test failures as infrastructure issues, code defects, flaky tests, or environment problems, and queries pod logs via MCP, combining them with a historical failure knowledge base to generate structured remediation reports.

    Architecture of Rescale’s triage agent on Amazon EKS using Amazon Bedrock, a knowledge base, and MCP log retrieval through Amazon CloudWatch

    Rescale built an AI triage agent based on the AWS AI-DLC framework and Strands Agents, going from problem definition to pre-release deployment in just five days and reaching production within weeks. The agent runs in an Argo Workflows CI/CD pipeline on Amazon EKS, calls Claude Opus 4.8 on Amazon Bedrock to classify nightly Playwright test failures as infrastructure issues, code defects, flaky tests, or environment problems, and queries pod logs via MCP, combining them with a historical failure k

    Matched fieldsSummary

  7. AWS Machine Learning

    No More Guesswork: A Measured Approach to TTS Autoscaling Targets on Amazon SageMaker AI

    AWS deploys the 82M-parameter TTS model Kokoro-82M in a custom container on an Amazon SageMaker AI real-time endpoint, using measured Q_max (the highest concurrency a single instance can sustain within the SLO) and T_total (the end-to-end time of one scale-out) to derive the scale-out threshold, scale-in threshold, and cooldown period, replacing target values set by guesswork. The approach scales on the natively published SageMaker AI ConcurrentRequestsPerModel metric, avoiding the hidden failure of a custom metric that no one reports.

    Diagram showing a client connecting to an Amazon SageMaker AI real-time endpoint, which contains a custom GPU container exposing two routes, POST /invocations for response streaming and WS /invocations-bidirectional-stream for bidirectional streaming, both feeding into a KPipeline running Kokoro-82M with lang_code=“a”

    AWS deploys the 82M-parameter TTS model Kokoro-82M in a custom container on an Amazon SageMaker AI real-time endpoint, using measured Q max (the highest concurrency a single instance can sustain within the SLO) and T total (the end-to-end time of one scale-out) to derive the scale-out threshold, scale-in threshold, and cooldown period, replacing target values set by guesswork. The approach scales on the natively published SageMaker AI ConcurrentRequestsPerModel metric, avoiding the hidden failur

    Matched fieldsSummary、Body

Thursday

  1. AWS Machine Learning

    AAIF: An Adaptive Agent Framework Based on Strands Agents

    AWS built the Adaptive Agent Intelligence Framework (AAIF) with Strands Agents, using llama3.2:1b as the orchestration layer to classify requests: routine tasks are handled by a local SLM via Ollama, while complex analysis is routed through boto3 to frontier models on Amazon Bedrock. This architecture can run on edge devices such as a Raspberry Pi with 8 GB of memory, or be deployed fully in the cloud or in a hybrid setup, thereby reducing API costs while maintaining low local latency.

    AAIF three-layer architecture with an SLM orchestrator routing requests to local processing tools or to Amazon Bedrock cloud processing

    Matched fieldsSummary、Body

Tuesday

  1. Tessl: Product and Engineering Blog

    From personal coding tools to development platforms: trust and cost in AI programming

    Massimo Re Ferre, Senior Principal PM at AWS, believes that the key for teams moving from personal coding assistants to agent development platforms is not model capability, but whether agent output can be verified at low cost—trust rises with inspection capability, not with benchmarks. Agent costs are billed by task activity; about 80% of developers use only 20% of the budget, while 20% of heavy users consume the rest, so the focus should be on the cost per unit of effective work rather than seat price.

    Massimo Re Ferre'

    Massimo Re Ferre, Senior Principal PM at AWS, believes that the key for teams moving from personal coding assistants to agent development platforms is not model capability, but whether agent output can be verified at low cost—trust rises with inspection capability, not with benchmarks. Agent costs are billed by task activity; about 80% of developers use only 20% of the budget, while 20% of heavy users consume the rest, so the focus should be on the cost per unit of effective work rather than sea

    Matched fieldsSummary、Body

  2. heise online

    Amazon to invest 16 billion euros in Germany next year for cloud and AI

    Amazon plans to invest more than 16 billion euros in Germany next year, of which about 4.8 billion euros will go toward expanding AWS cloud and AI infrastructure around Frankfurt, with the remainder directed to logistics modernization and Prime Video original content. In logistics, more than 3,000 new jobs have currently been added; upgrades in Bad Hersfeld, Dortmund and Werne will be completed next year, and a new center in Könnern is under construction; the investment also involves the satellite internet project Amazon Leo.

    Amazon plans to invest more than 16 billion euros in Germany next year, of which about 4.8 billion euros will go toward expanding AWS cloud and AI infrastructure around Frankfurt, with the remainder directed to logistics modernization and Prime Video original content. In logistics, more than 3,000 new jobs have currently been added; upgrades in Bad Hersfeld, Dortmund and Werne will be completed next year, and a new center in Könnern is under construction; the investment also involves the satelli

    Matched fieldsSummary、Body

  3. SiliconANGLE

    AuxoAI Raises Over $20 Million Series A to Bring AI Expertise to Enterprises

    Enterprise engineering and consulting firm AuxoAI announced it has closed a $20.7 million Series A funding round led by NTT Venture Capital to accelerate growth and expand its enterprise AI consulting model. Its core platform, Damia, is a toolkit for "forward-deployed engineers" that turns enterprise data into applications and encodes business process knowledge into AI agents capable of long-term collaboration. The company has worked with Global 2000 enterprises for more than three years and has partnerships with platforms including Google, AWS, Snowflake, Databricks and Microsoft.

    n Series A funding round led by NTT Venture Capital to accelerate growth and expand its enterprise AI consulting model. Its core platform, Damia, is a toolkit for "forward-deployed engineers" that turns enterprise data into applications and encodes business process knowledge into AI agents capable of long-term collaboration. The company has worked with Global 2000 enterprises for more than three years and has partnerships with platforms including Google, AWS, Snowflake, Databricks and Microsoft.

    Matched fieldsSummary、Body

Wednesday

  1. Rohan PaulSelected

    OpenAI and Google Reach AI Distribution Agreement; GPT-6 Astra and Codex to Launch on Google…

    OpenAI and Google have reached an AI distribution agreement. Within weeks, OpenAI will list GPT-6 Astra and Codex on Google Cloud's Model Garden, extending its model coverage to all three major U.S. clouds. Customers can purchase these models through Google Cloud Marketplace and count the spending toward their committed cloud consumption quotas, eliminating a separate procurement process; regulated customers can also run agent workflows built with OpenAI models within Google Cloud's access control and data governance tools. The agreement only became possible after April 27, 2026, when Microsoft's license to OpenAI technology became non-exclusive and Microsoft stopped paying OpenAI a revenue share on Azure resales; AWS had previously been first to launch Codex on Bedrock.

    ount the spending toward their committed cloud consumption quotas, eliminating a separate procurement process; regulated customers can also run agent workflows built with OpenAI models within Google Cloud's access control and data governance tools. The agreement only became possible after April 27, 2026, when Microsoft's license to OpenAI technology became non-exclusive and Microsoft stopped paying OpenAI a revenue share on Azure resales; AWS had previously been first to launch Codex on Bedrock.

    Matched fieldsSummary

  2. Rohan PaulSelected

    WSJ sees Anthropic IPO draft: half-year revenue $16.3 billion, compute commitments about $450 billion

    The Anthropic IPO draft seen by WSJ shows half-year revenue of $16.3 billion, a book loss of $80.7 billion, and compute commitments of about $450 billion. The draft discloses fixed payments of $252 billion to three major cloud providers over the next 7 to 10 years, including $111 billion to Google, $110 billion to AWS, and $31 billion to Microsoft, payable whether or not used. There is also over $160 billion in Google chip leasing (via Broadcom) and up to $86 billion in Nvidia GPU rental, plus $150 billion in deals under negotiation.

    ws half-year revenue of $16.3 billion, a book loss of $80.7 billion, and compute commitments of about $450 billion. The draft discloses fixed payments of $252 billion to three major cloud providers over the next 7 to 10 years, including $111 billion to Google, $110 billion to AWS, and $31 billion to Microsoft, payable whether or not used. There is also over $160 billion in Google chip leasing (via Broadcom) and up to $86 billion in Nvidia GPU rental, plus $150 billion in deals under negotiation.

    Matched fieldsSummary