Lower and further left is better · Nemotron 3.5 Transcribe doesn't support streaming, so it is not shown
Murf Finch-Global is 5th of 23 on final-text delay and 18th of 21 on time to first text.
Last updated Methodology by Dileep Chagam
Lower is better on every measure. Hover a column for that model's full numbers.
NVIDIA Nemotron 3.5 Transcribe send no text until the speaker stops, so TTFT is not comparable.
Wrong words are its biggest source of error on both real calls and clean clips.
42%
of its errors on the Ocular calls are wrong words.
Median across all 24 models: 34%
Mix of errors
Real calls (Ocular Dataset)
Clean clips (Pipecat Dataset)
Timed on the same 206 streamed Ocular turns as every other model. P90 and P95 show what a caller meets on a slow turn.
How long after the caller stops until the full transcript arrives. A voice agent waits for this before it replies.
How long after the audio starts streaming until the first words appear.
Every other model's typical turn, on the same axis.
1,000 Pipecat turns · 300 Ocular turns · 205 turns timed · 0 failed requests
Murf Finch-Global places highest on final-text delay, 5th of 23 at 51ms. Its weakest placing is time to first text, 18th of 21 at 1.83s.
Murf Finch-Global places highest on final-text delay, 5th of 23 at 51ms. Its weakest placing is time to first text, 18th of 21 at 1.83s.
Murf Finch-Global transcribes the 1,000 public Pipecat clips at 3.17% word error rate and the 300 licensed Ocular turns at 3.62%. Word error rate counts incorrect, missing, and extra words against the reference transcript, so lower is better.
First text arrives after 1.83s at the median, and the transcript is final 51ms after the speaker stops. Both are measured on the same 206 streamed turns as every other model, and the page shows P90 and P95 as well, which is what a caller meets on a bad turn.
Every model runs the same two datasets under the same conditions: 1,000 public clips from Pipecat's STT benchmark dataset for accuracy at scale, and 300 turns of licensed Ocular conversations for real speech. Latency comes from 206 streamed turns, using each provider's own supported finalization contract. Murf Finch-Global returned usable text for 1,000 of the public clips.
Cekura runs these simulated calls on your agent and scores every one.