ElevenLabs Scribe v3 Live vs Google Chirp 3
Accuracy and speed
Left gets fewer words wrong. Lower has the final text ready sooner.
- Scribe v3 Live1.81% · 57ms
- Chirp 32.00% · 475ms
ElevenLabs Scribe v3 Live is ahead of Google Chirp 3 on both datasets together, the Ocular Dataset, time to first text and final-text delay. The Pipecat Dataset is too close to call.
Last updated Methodology by Dileep Chagam
Who is better at what
- Overall WER1.89%2.76%
- Pipecat Dataset WER1.81%2.00%
- Ocular Dataset WER2.05%4.19%
- Time to first text685ms4.48s
- Final-text delay57ms475ms
Lower is better on every measure. Too close to call means the likely ranges overlap. For more on the platform, read our ElevenLabs review.
Scribe v3 Live vs Chirp 3 FAQ
Which is more accurate, ElevenLabs Scribe v3 Live or Google Chirp 3?
ElevenLabs Scribe v3 Live is more accurate on the public clips. On the 1,000 public Pipecat clips, ElevenLabs Scribe v3 Live scores 1.89% and Google Chirp 3 2.76%, so ElevenLabs Scribe v3 Live makes fewer errors by 0.86 points. On the 300 licensed Ocular turns, ElevenLabs Scribe v3 Live scores 1.81% and Google Chirp 3 2.00%, with likely ranges of 1.59 to 2.04% and 1.77 to 2.25%. The ranges overlap, so the difference is too close to call. Word error rate counts incorrect, missing, and extra words, so lower is better.
ElevenLabs Scribe v3 Live is more accurate on the public clips. On the 1,000 public Pipecat clips, ElevenLabs Scribe v3 Live scores 1.89% and Google Chirp 3 2.76%, so ElevenLabs Scribe v3 Live makes fewer errors by 0.86 points. On the 300 licensed Ocular turns, ElevenLabs Scribe v3 Live scores 1.81% and Google Chirp 3 2.00%, with likely ranges of 1.59 to 2.04% and 1.77 to 2.25%. The ranges overlap, so the difference is too close to call. Word error rate counts incorrect, missing, and extra words, so lower is better.
Yes. ElevenLabs Scribe v3 Live finishes the transcript 3.79s sooner. ElevenLabs Scribe v3 Live has the final transcript 685ms after the speaker stops and Google Chirp 3 4.48s, at the median. Both are measured on the same 206 streamed turns.
ElevenLabs Scribe v3 Live finishes the transcript 3.79s sooner, and the two are too close to call on real conversations. A voice agent cannot reply until the final transcript arrives, and the Ocular recordings are real conversations.
Yes, both return partial text before the speaker stops. ElevenLabs Scribe v3 Live shows first text after 2.05% and Google Chirp 3 after 4.19%, at the median, so ElevenLabs Scribe v3 Live is 2.14 points lower.
Test your voice agent the same way.
Cekura runs these simulated calls on your agent and scores every one.