Fireworks AI launches the Specialized Intelligence Index

On September 22, 2026, Fireworks AI released the Specialized Intelligence Index (SII), which brings together the performance of open, closed-source, and specialized models on domain-specific benchmarks, initially covering seven domains: healthcare, legal, cybersecurity, finance, customer service, productivity, and software. According to the official description, each benchmark was designed by practitioners in the field, such as Harvey's Legal Agent Benchmark, Sierra's τ-Banking and τ-Voice, and Datacurve's DeepSWE v1.1. SII does not weight or average results across domains; it retains only benchmark- and domain-level scores and provides comparison views of score versus cost and score versus duration. Each benchmark is annotated with its reproducible scope, and new frontier models must pass a production deployability screening before being included. Fireworks also accepts partner submissions, with partners providing tasks and data in a Harbor-compatible format; Fireworks runs the evaluations free of charge and publishes scores with the partner's consent. There have been no further developments so far.

AI-generated from public reports

1. Sep 22· 3 reports

   Fireworks AI launches Specialized Intelligence Index

   Source:Fireworks AI