64 of 64
| Full-duplex | Tier | Setting | Focus | |||
|---|---|---|---|---|---|---|
DuplexActDong et al. | Full-duplex | Speech-native | Lab | — | 8 | 2026-10 |
VoiceBenchNUS | — | Speech-native | Lab | Speech-LM Instruction following | 7 | 2025-06 |
 Big Bench AudioArtificial Analysis | — | Speech-native | Lab | Speech-LM Instruction following | 7 | 2026-05 |
Full-Duplex-Bench v1NTU / UC Berkeley / UW / MIT | Full-duplex | Speech-native | Lab | — | 5 | 2025-03 |
 VideoFDBNVIDIA / David AI | Full-duplex | Speech-native | Live | — | 4 | 2026-10 |
 TurnBenchSesame AI Labs / Mundo AI / CMU / oto | Full-duplex | Speech-native | Lab | — | 3 | 2026-11 |
Full-Duplex-Bench v1.5NTU / UC Berkeley / UW / MIT | Full-duplex | Speech-native | Lab | — | 3 | 2025-08 |
 Talking TurnsApple / CMU | Full-duplex | Speech-native | Lab | Speech-LM | 3 | 2025-04 |
 AIR-BenchAlibaba DAMO (OFA-Sys) | — | Speech-native | Lab | Audio understanding Instruction following | 3 | 2024-12 |
 τ-bench 2.0 (τ-Voice)Sierra Research | Full-duplex | Speech-native | Vertical | Vertical agent Speech-LM | 3 | 2026-10 |
Full-Duplex-Bench v3NTU (NVIDIA advisory) | Full-duplex | Speech-native | Live | Vertical agent | 2 | 2026-05 |
MultiPartyTurnBenchMathur and Manocha | Full-duplex | Speech-native | Lab | — | 2 | 2026-10 |
URO-BenchRuiqi Yan et al. | — | Speech-native | Lab | Speech-LM Instruction following +1 | 2 | 2025-08 |
MMARSJTU / MBZUAI · NeurIPS 2025 | — | Component | Lab | Audio understanding Speech-LM | 2 | 2026-02 |
 Audio MultiChallengeScale AI (Scale Labs) | Full-duplex | Speech-native | Lab | Speech-LM | 2 | 2026-10 |
| Scale Voice ShowdownScale AI | — | Speech-native | Arena | Speech-LM TTS | 1 | 2026-03 |
EVA-BenchServiceNow | — | Speech-native | Vertical | Vertical agent Speech-LM | 1 | 2026-10 |
Full-Duplex-Bench v2NTU / UC Berkeley / UW / MIT | Full-duplex | Speech-native | Live | Speech-LM | 0 | 2026-02 |
MultiTalkBenchWang et al. (MultiTalk) | Full-duplex | Speech-native | Lab | — | 0 | 2026-09 |
M3-DuplexBenchNTT (Fukuda et al.) | Full-duplex | Speech-native | Lab | Speech-LM | 0 | 2026-10 |
Duplex-MPEMa et al. | Full-duplex | Speech-native | Lab | — | 0 | 2026-11 |
DuplexLedgerLi et al. | Full-duplex | Speech-native | Lab | Speech-LM | 0 | 2026-10 |
InteractionBenchAvera Labs (He et al.) | Full-duplex | Speech-native | Live | Speech-LM | 0 | 2026-11 |
ECHOZhao et al. | Full-duplex | Speech-native | Lab | — | 0 | 2026-09 |
MP-BenchShih et al. | Full-duplex | Speech-native | Lab | Speech-LM | 0 | 2026-10 |
DuplexSpeechBench-IFEvalMathur and Manocha | Full-duplex | Speech-native | Lab | Instruction following | 0 | 2026-09 |
VocalBenchSJTU (OmniAgent) | — | Speech-native | Lab | Speech-LM Audio understanding | 0 | 2026-01 |
| Artificial Analysis Speech to Speech IndexArtificial Analysis | — | Speech-native | Lab | Speech-LM Vertical agent | 0 | 2026-08 |
IFEval-AudioAudioLLMs (I2R Singapore) | — | Speech-native | Lab | Instruction following Speech-LM | 0 | 2025-05 |
| Artificial Analysis Speech ArenaArtificial Analysis | — | Adjacent | Arena | TTS | 0 | 2026-10 |
| Artificial Analysis Speech Agent ArenaArtificial Analysis | — | Speech-native | Arena | Speech-LM Vertical agent | 0 | 2026-10 |
 Real World Voice EQ BenchHume AI | — | Component | Arena | TTS Speech-LM +2 | 0 | 2026-07 |
MTalk-BenchFreedomIntelligence / CUHK-SZ | — | Speech-native | Arena | Speech-LM Instruction following +1 | 0 | 2025-09 |
 TTS ArenaHugging Face | — | Adjacent | Arena | TTS | 0 | 2026-03 |
VAmoS BenchVeris AI | — | Speech-native | Vertical | Vertical agent | 0 | 2026-10 |
APEX-VoiceMathur and Manocha | Full-duplex | Speech-native | Vertical | Vertical agent | 0 | 2026-09 |
VoiceAgentEvalMeituan / Xbench / Agora | — | Speech-native | Vertical | Vertical agent Speech-LM | 0 | 2025-10 |
 HealthBenchOpenAI | — | Adjacent | Vertical | Vertical agent Instruction following | 0 | 2025-05 |
| — | Component | Lab | Speech translation | 0 | 2023-12 | |
 CoVoST-2 BLEUMeta AI | — | Component | Lab | Speech translation ASR | 0 | 2020-07 |
 Seed-TTS EvalByteDance | — | Component | Lab | TTS | 0 | 2024-11 |
NV-BenchNi et al. | — | Component | Lab | TTS Emotion | 0 | 2026-03 |
SUPERBNTU et al. (s3prl) | — | Legacy | Lab | Speech-LM ASR +1 | 0 | 2024-06 |
LibriSpeech WEROpenSLR | — | Legacy | Lab | ASR | 0 | 2024-01 |
MELD / IEMOCAPAcademic | — | Legacy | Lab | Emotion Audio understanding | 0 | 2023-06 |
SID-BenchXia et al. | Full-duplex | Speech-native | Lab | — | 0 | 2026-03 |
FD-BenchPeng et al. | Full-duplex | Speech-native | Lab | — | 0 | 2025-07 |
MTR-DuplexBenchZhang et al. | Full-duplex | Speech-native | Lab | Speech-LM | 0 | 2026-04 |
HumDial (ICASSP '26)ICASSP 2026 Spoken Dialogue Challenge | Full-duplex | Speech-native | Lab | Speech-LM Emotion | 0 | 2026-01 |
FLEXIGe et al. | Full-duplex | Speech-native | Lab | — | 0 | 2025-09 |
AudioBenchAudioLLMs (I2R Singapore) | — | Component | Lab | Audio understanding | 0 | 2024-07 |
Dynamic-SUPERBNTU et al. | — | Component | Lab | Speech-LM Instruction following | 0 | 2024-11 |
VoiceAssistant-EvalWang et al. | — | Component | Lab | Speech-LM Instruction following | 0 | 2025-09 |
SD-EvalAcademic (SD-Eval authors) | — | Component | Lab | Speech-LM Emotion | 0 | 2024-06 |
ProsAuditAcademic (ProsAudit authors) | — | Component | Lab | Emotion Audio understanding | 0 | 2023-02 |
VocalBench-zhSJTU (OmniAgent) | — | Speech-native | Lab | Speech-LM Audio understanding | 0 | 2025-11 |
CS3-BenchAcademic (CS3-Bench authors) | — | Speech-native | Lab | Speech-LM | 0 | 2025-10 |
J-Moshi (subjective)Ohashi et al. | Full-duplex | Speech-native | Lab | Speech-LM | 0 | 2025-06 |
VoiceAgentBenchAcademic (VoiceAgentBench authors) | — | Speech-native | Vertical | Vertical agent Speech-LM +1 | 0 | 2026-02 |
 MSI-BenchBoson AI | — | Speech-native | Lab | Speech-LM Vertical agent | 0 | 2026-09 |
MMedFDAcademic (MMedFD authors) | Full-duplex | Adjacent | Vertical | ASR Vertical agent | 0 | 2025-09 |
LALM Jailbreak Taxonomy & EvalFeng et al. | — | Speech-native | Lab | Audio safety Speech-LM | 0 | 2026-05 |
SpeechJBBCeccatelli, Jeon, Adelani et al. | — | Speech-native | Lab | Audio safety Speech-LM | 0 | 2026-08 |
AIA — Acoustic Interference AttackWang, Huang, Liang, Wu (CUHK · HKUST) | — | Speech-native | Lab | Audio safety Speech-LM | 0 | 2026-05 |