
Artificial Analysis
Announcing the Artificial Analysis Diarization Index, our new benchmark for who said what in speech to text The Diarization Index scores APIs on Word Diarization Error Rate (WDER): the share of words given to the wrong speaker or to no speaker, across 97 conversations of two to eight people, with equal weight on each group size. Nemotron 3.5 Transcribe from @NVIDIAAI leads at 3.3%, ahead of Voxtral Small Transcribe 3 at 7.5%. Thread below




