Lower and further left is better
Speechmatics Linden is 7th of 19 on the Ocular Dataset and 9th of 19 on final-text delay.
Last updated Methodology by Dileep Chagam
Lower is better on every measure. Hover a column for that model's full numbers.
On real calls, dropped words are its biggest source of error. On clean clips, wrong words lead.
55%
of its errors on the Ocular calls are words it left out.
Median across all 19 models: 53%
Mix of errors
Real calls (Ocular Dataset)
Clean clips (Pipecat Dataset)
Timed on the same 206 streamed Ocular turns as every other model. P90 and P95 show what a caller meets on a slow turn.
How long after the caller stops until the full transcript arrives. A voice agent waits for this before it replies.
How long after the audio starts streaming until the first words appear.
Every other model's typical turn, on the same axis.
998 Pipecat clips · 8 Ocular recordings · 194 turns timed · 12 failed requests
Speechmatics Linden places highest on the Ocular Dataset, 7th of 19 at 3.93%. Its weakest placing is final-text delay, 9th of 19 at 147ms.
Speechmatics Linden places highest on the Ocular Dataset, 7th of 19 at 3.93%. Its weakest placing is final-text delay, 9th of 19 at 147ms.
Speechmatics Linden transcribes the 1,000 public Pipecat clips at 2.46% word error rate and the eight licensed Ocular recordings at 3.93%. Word error rate counts incorrect, missing, and extra words against the reference transcript, so lower is better.
First text arrives after 1.19s at the median, and the transcript is final 147ms after the speaker stops. Both are measured on the same 206 streamed turns as every other model, and the page shows P90 and P95 as well, which is what a caller meets on a bad turn.
Every model runs the same two datasets under the same conditions: 1,000 public clips from Pipecat's STT benchmark dataset for accuracy at scale, and eight licensed conversation recordings from Ocular for real speech. Latency comes from 206 streamed turns, using each provider's own supported finalization contract. Speechmatics Linden returned usable text for 998 of the public clips.