AI Trends

Trending story

Together AI Launches Together Storage Accelerator

1 reports1 story updatesUpdated Nov 19 08:00

Understand this story

AI overview

On November 19, Together AI launched Together Storage Accelerator (TSA), a distributed caching layer for Together GPU Clusters that connects to object storage and the Hugging Face Hub without requiring changes to existing applications and is provided free of charge with every cluster. Tests on H100 nodes published by Together AI showed warm-cache read speeds of 3.0–3.4 GB/s for 2 GiB objects, approximately 20 times faster than cross-cloud sources; when 200 nodes retrieved the same checkpoint, the number of source requests could be reduced from 200 to one. The service can now be enabled on the cluster settings page, though actual results may vary depending on the data source, object size, and network path.

AI-generated from public reports

Latest development · Report

Together AI Launches Together Storage Accelerator, Bringing…

Developments

1 confirmed developments

  1. Together AI Launches Together Storage Accelerator

    Source:Together AI Blog

Reports and discussion timeline

Browse reports and discussion by time. Their evidence levels remain distinct.

Nov 19

  1. Together AI BlogFirst-party

    Together AI Launches Together Storage Accelerator, Bringing…

    Together AI has launched Together Storage Accelerator, providing free distributed caching for every Together GPU Cluster and enabling access to object storage and the Hugging Face Hub without requiring changes to existing applications. Tests on H100 nodes showed warm-cache read speeds of 3.0–3.4 GB/s for 2 GiB objects, approximately 20× faster than cross-cloud sources. When 200 nodes retrieve the same checkpoint, the number of origin requests can drop from 200 to one. The service can now be enabled on the cluster settings page. Actual results may vary depending on the data source, object size, and network path.

Related stories

  1. Related storiesNVIDIA and Databricks contribute Zerobus Ingest sink to Debezium
  2. Related storiesRecursive releases open-weight local coding model Flint
  3. Related storiesLMSYS releases SGLang AWS Trainium plugin Beta
  4. Related storiesModal launches LLM training library Modal Dojo