FireRedVAD：支持 100+ 语言的工业级语音活动检测与音频事件检测

FireRedTeam; FireRedVAD

Repository navigation

NotificationsYou must be signed in to change notification settings; Fork38 (38); Star547 (547)You must be signed in to star a repository

Repository files navigation

README; Apache-2.0 license

[Paper] [Model🤗] [Model🤖] [Demo]

FireRedVAD is a state-of-the-art (SOTA) industrial-grade Voice Activity Detection (VAD) and Audio Event Detection (AED) solution. FireRedVAD supports non-streaming/streaming VAD and non-streaming AED. It supports speech/singing/music detection in 100+ languages. Non-streaming VAD achieves 97.57% F1 on FLEURS-VAD-102, outperforming Silero-VAD, TEN-VAD, FunASR-VAD and WebRTC-VAD.

[2026.03.12] We release FireRedASR2S (including FireRedVAD) technical report. See arXiv; [2026.03.03] We release FireRedVAD as a standalone repository, along with model weights and inference code; [2026.02.12] We release FireRedASR2S (FireRedASR2-AED, FireRedVAD, FireRedLID, and FireRedPunc) with model weights and inference code

Evaluation

FireRedVAD

We evaluate FireRedVAD on FLEURS-VAD-102, a multilingual VAD benchmark covering 102 languages.

FireRedVAD achieves SOTA performance, outperforming Silero-VAD, TEN-VAD, FunASR-VAD, and WebRTC-VAD.

*FLEURS-VAD-102: We randomly selected ~100 audio files per language from FLEURS test set, resulting in 9,443 audio files with manually annotated binary VAD labels (speech=1, silence=0). This VAD testset will be open sourced (coming soon).

Note: FunASR-VAD achieves low Miss Rate but at the cost of high False Alarm Rate (44.03%), indicating over-prediction of speech segments.

Quick Start

Setup

Create a clean Python environment:

Run Step 2 or Step 3 (choose one); (via pypi) Install dependencies and set up the environment; (from source) Install dependencies and set up PATH and PYTHONPATH:; Download models:; Convert your audio to 16kHz 16-bit mono PCM format if needed:

Script Usage

Command-line Usage

If installed via pip install fireredvad, use the fireredvad CLI directly:

For source installation, set up PATH and PYTHONPATH first: export PATH=$PWD/fireredvad/bin/:$PATH; export PYTHONPATH=$PWD/:$PYTHONPATH

Python API Usage

If installed via pip install fireredvad, no PYTHONPATH setup is needed. For source installation, set up PYTHONPATH first: export PYTHONPATH=$PWD/:$PYTHONPATH

DFSMN-based non-streaming/streaming Voice Activity Detection and Audio Event Detection.

Runtime

Now support NCNN for multiplatform, see runtime

FAQ

Q: What audio format is supported?

16kHz 16-bit mono PCM wav. Use ffmpeg to convert other formats: ffmpeg -i -ar 16000 -ac 1 -acodec pcm_s16le -f wav

Citation