Speechmatics Linden is ahead of GPT-4o Transcribe on the Pipecat Dataset, the Ocular Dataset and final-text delay.
Last updated Methodology by Dileep Chagam
Each dot is one model. Bottom-left is best: fewer errors and a faster final transcript.
Speechmatics Linden is the better pick over GPT-4o Transcribe on every measure that separates them: accuracy on clean, scripted audio (1.45 points lower), accuracy on real phone conversations (8.52 points lower) and quick turn-taking once the caller stops (505ms sooner).
Speechmatics Linden, 1.45 points lower
Speechmatics Linden, 8.52 points lower
Not comparable
Speechmatics Linden, 505ms sooner
Lower is better on every metric. The small figure is each model's place in the whole field. What each metric measures.
GPT-4o Transcribe shows first text after 40.63s and final text after 1.97s, and Speechmatics Linden shows first text after 2.52s and final text after 213ms, on a bad turn (P95) across the same streamed turns.
| Measure | Model | P50 | P90 | P95 |
|---|---|---|---|---|
| Time to first text | GPT-4o Transcribe | No text until the speaker stops | ||
| Speechmatics Linden | 1.19s | 1.56s | 2.52s | |
| Final-text delay | GPT-4o Transcribe | 652ms | 1.73s | 1.97s |
| Speechmatics Linden | 147ms | 192ms | 213ms | |
Place among the 17 models on each metric. Lower is better on all four.
| Metric | 4o Transcribe | Linden |
|---|---|---|
| Pipecat Dataset WER | 3.90%14th of 17 | 2.46%7th of 17 |
| Ocular Dataset WER | 12.45%17th of 17 | 3.93%7th of 17 |
| Time to first text | Not comparable | 1.19s8th of 15 |
| Final-text delay | 652ms17th of 17 | 147ms8th of 17 |
| Model | Pipecat clips | Ocular recordings | Turns timed | Failed |
|---|---|---|---|---|
| GPT-4o Transcribe | 1,000 | 8 | 206 | 0 |
| Speechmatics Linden | 998 | 8 | 194 | 12 |
Only clips with usable text count, so the two totals can differ. How WER is scored.
Speechmatics Linden is more accurate on both datasets. On the 1,000 public Pipecat clips, GPT-4o Transcribe scores 3.90% and Speechmatics Linden 2.46%, so Speechmatics Linden makes fewer errors by 1.45 points. On the eight licensed Ocular recordings, GPT-4o Transcribe scores 12.45% and Speechmatics Linden 3.93%, so Speechmatics Linden makes fewer errors by 8.52 points. Word error rate counts incorrect, missing, and extra words, so lower is better.
No. Speechmatics Linden finishes the transcript 505ms sooner. GPT-4o Transcribe has the final transcript 652ms after the speaker stops and Speechmatics Linden 147ms, at the median. Both are measured on the same 206 streamed turns.
Speechmatics Linden is the stronger pick for voice agents: it makes fewer errors on real conversations and finishes the transcript 505ms sooner. A voice agent cannot reply until the final transcript arrives, and the Ocular recordings are real conversations.
Only Speechmatics Linden. GPT-4o Transcribe returns no text until the speaker stops, which matters if your agent reacts to partial transcripts.