Gradium vs GPT-4o Mini Transcribe
Gradium is ahead on final-text delay, and GPT-4o Mini Transcribe on the Pipecat Dataset. The two tie on the Ocular Dataset.
Last updated Methodology by Dileep Chagam
Accuracy vs speed
Each dot is one model. Bottom-left is best: fewer errors and a faster final transcript.
Which to pick
Pick Gradium for quick turn-taking once the caller stops (418ms sooner). Pick GPT-4o Mini Transcribe for accuracy on clean, scripted audio (3.12 points lower). They are level on accuracy on real phone conversations.
The four metrics, side by side
- Gradium
- 6.48%17th
- GPT-4o Mini Transcribe
- 3.35%11th
GPT-4o Mini Transcribe, 3.12 points lower
- Gradium
- 4.45%12th
- GPT-4o Mini Transcribe
- 4.45%12th
Level
- Gradium
- 1.71s12th
- GPT-4o Mini Transcribe
- No text until the speaker stops
Not comparable
- Gradium
- 212ms11th
- GPT-4o Mini Transcribe
- 630ms16th
Gradium, 418ms sooner
Lower is better on every metric. The small figure is each model's place in the whole field. What each metric measures.
- WER · Word error rate
- Share of words the model got wrong: replaced, missing or added. Lower is better.
- Pipecat Dataset
- 1,000 short public clips from Pipecat's STT benchmark dataset.
- Ocular Dataset
- 8 recordings from 4 real phone conversations, licensed from Ocular.
- TTFT · Time to first text
- How long after the audio starts streaming until the first words appear.
- TTFS · Final-text delay
- How long after the caller stops until the full transcript arrives. A voice agent waits for this before it replies.
First text and final text, at three percentiles
Gradium shows first text after 7.32s and final text after 280ms, and GPT-4o Mini Transcribe shows first text after 40.84s and final text after 1.53s, on a bad turn (P95) across the same streamed turns.
| Measure | Model | P50 | P90 | P95 |
|---|---|---|---|---|
| Time to first text | Gradium | 1.71s | 4.05s | 7.32s |
| GPT-4o Mini Transcribe | No text until the speaker stops | |||
| Final-text delay | Gradium | 212ms | 266ms | 280ms |
| GPT-4o Mini Transcribe | 630ms | 1.34s | 1.53s | |
- P50 / P90 / P95 · Typical, slow and slowest turns
- Half of turns are faster than P50. Only 1 in 10 is slower than P90, and 1 in 20 slower than P95.
How each ranks among all 17 models
Place among the 17 models on each metric. Lower is better on all four.
| Metric | Gradium | 4o Mini Transcribe |
|---|---|---|
| Pipecat Dataset WER | 6.48%17th of 17 | 3.35%11th of 17 |
| Ocular Dataset WER | 4.45%12th of 17 | 4.45%12th of 17 |
| Time to first text | 1.71s12th of 15 | Not comparable |
| Final-text delay | 212ms11th of 17 | 630ms16th of 17 |
How much audio each model was tested on
| Model | Pipecat clips | Ocular recordings | Turns timed | Failed |
|---|---|---|---|---|
| Gradium | 1,000 | 8 | 198 | 0 |
| GPT-4o Mini Transcribe | 1,000 | 8 | 206 | 0 |
Only clips with usable text count, so the two totals can differ. How WER is scored.
Related comparisons
- Gradium vs Deepgram Flux Multilingual
- Gradium vs Deepgram Flux English
- Gradium vs GPT-4o Transcribe
- Gradium vs Smallest Pulse
- Gradium vs Deepgram Nova-3
- Gradium vs Inworld STT-1
- Gradium vs Soniox STT-RT v5
- Gradium vs Speechmatics Linden
- Gradium vs Cartesia Ink 2
- Gradium vs GPT Realtime Whisper
- Gradium vs Reson8
- Gradium vs Google Chirp 3
- Gradium vs AssemblyAI Universal 3.6 Pro
- GPT-4o Mini Transcribe vs Deepgram Nova-3
- GPT-4o Mini Transcribe vs Smallest Pulse
- GPT-4o Mini Transcribe vs GPT-4o Transcribe
- GPT-4o Mini Transcribe vs Deepgram Flux English
- GPT-4o Mini Transcribe vs Inworld STT-1
- GPT-4o Mini Transcribe vs Soniox STT-RT v5
- GPT-4o Mini Transcribe vs Speechmatics Linden
- GPT-4o Mini Transcribe vs Cartesia Ink 2
- GPT-4o Mini Transcribe vs GPT Realtime Whisper
- GPT-4o Mini Transcribe vs Reson8
- GPT-4o Mini Transcribe vs Google Chirp 3
- GPT-4o Mini Transcribe vs AssemblyAI Universal 3.6 Pro
- GPT-4o Mini Transcribe vs Deepgram Flux Multilingual
Frequently asked questions
Which is more accurate, Gradium or GPT-4o Mini Transcribe?
GPT-4o Mini Transcribe is more accurate on the public clips. On the 1,000 public Pipecat clips, Gradium scores 6.48% and GPT-4o Mini Transcribe 3.35%, so GPT-4o Mini Transcribe makes fewer errors by 3.12 points. On the eight licensed Ocular recordings, Gradium scores 4.45% and GPT-4o Mini Transcribe 4.45%, which is a tie. Word error rate counts incorrect, missing, and extra words, so lower is better.
Is Gradium faster than GPT-4o Mini Transcribe?
Yes. Gradium finishes the transcript 418ms sooner. Gradium has the final transcript 212ms after the speaker stops and GPT-4o Mini Transcribe 630ms, at the median. Both are measured on the same 206 streamed turns.
Is Gradium or GPT-4o Mini Transcribe better for voice agents?
Gradium finishes the transcript 418ms sooner, and the two are level on real conversations. A voice agent cannot reply until the final transcript arrives, and the Ocular recordings are real conversations.
Do Gradium and GPT-4o Mini Transcribe stream text while the speaker is talking?
Only Gradium. GPT-4o Mini Transcribe returns no text until the speaker stops, which matters if your agent reacts to partial transcripts.