GPT-4o Mini TranscribevsSoniox STT-RT v5

Compare

Accuracy and speed

Left gets fewer words wrong. Lower has the final text ready sooner.

Accurate and fast0ms200ms400ms600ms800ms0%2%4%6%8%Words wrong on clean audio (Pipecat WER)
  • 4o Mini Transcribe3.35% · 630ms
  • STT-RT v52.54% · 38ms

Soniox STT-RT v5 is ahead of GPT-4o Mini Transcribe on the Pipecat Dataset and final-text delay. The Ocular Dataset is too close to call.

Last updated Methodology by Dileep Chagam

Who is better at what

4o Mini TranscribeSTT-RT v5
  • Pipecat Dataset WER3.35%2.54%
  • Ocular Dataset WER4.45%3.92%
  • Time to first textn/a1.20s
  • Final-text delay630ms38ms

Lower is better on every measure. Too close to call means the likely ranges overlap.

4o Mini Transcribe vs STT-RT v5 FAQ

  • Soniox STT-RT v5 is more accurate on the public clips. On the 1,000 public Pipecat clips, GPT-4o Mini Transcribe scores 3.35% and Soniox STT-RT v5 2.54%, so Soniox STT-RT v5 makes fewer errors by 0.81 points. On the eight licensed Ocular recordings, GPT-4o Mini Transcribe scores 4.45% and Soniox STT-RT v5 3.92%, with likely ranges of 3.22 to 5.55% and 2.60 to 4.86%. The ranges overlap, so the difference is too close to call. Word error rate counts incorrect, missing, and extra words, so lower is better.

  • No. Soniox STT-RT v5 finishes the transcript 592ms sooner. GPT-4o Mini Transcribe has the final transcript 630ms after the speaker stops and Soniox STT-RT v5 38ms, at the median. Both are measured on the same 206 streamed turns.

  • Soniox STT-RT v5 finishes the transcript 592ms sooner, and the two are too close to call on real conversations. A voice agent cannot reply until the final transcript arrives, and the Ocular recordings are real conversations.

  • Only Soniox STT-RT v5. GPT-4o Mini Transcribe returns no text until the speaker stops, which matters if your agent reacts to partial transcripts.