AssemblyAI Universal 3.6 Pro is ahead of Deepgram Flux English on the Pipecat Dataset, time to first text and final-text delay. The Ocular Dataset is too close to call.
Last updated Methodology by Dileep Chagam
Each dot is one model. Bottom-left is best: fewer errors and a faster final transcript.
AssemblyAI Universal 3.6 Pro is the better pick over Deepgram Flux English on every measure that separates them: accuracy on clean, scripted audio (2.13 points lower), showing words while the caller is still talking (306ms sooner) and quick turn-taking once the caller stops (17ms sooner). For accuracy on real phone conversations, the gap is inside the margin of error, so neither is ahead.
AssemblyAI Universal 3.6 Pro, 2.13 points lower
Too close to call: inside the margin of error
AssemblyAI Universal 3.6 Pro, 306ms sooner
AssemblyAI Universal 3.6 Pro, 17ms sooner
Lower is better on every metric. The small figure is each model's place in the whole field. What each metric measures.
AssemblyAI Universal 3.6 Pro shows first text after 967ms and final text after 232ms, and Deepgram Flux English shows first text after 1.51s and final text after 141ms, on a bad turn (P95) across the same streamed turns.
| Measure | Model | P50 | P90 | P95 |
|---|---|---|---|---|
| Time to first text | AssemblyAI Universal 3.6 Pro | 485ms | 966ms | 967ms |
| Deepgram Flux English | 791ms | 1.23s | 1.51s | |
| Final-text delay | AssemblyAI Universal 3.6 Pro | 91ms | 210ms | 232ms |
| Deepgram Flux English | 108ms | 132ms | 141ms |
Place among the 17 models on each metric. Lower is better on all four.
| Metric | Universal 3.6 Pro | Flux English |
|---|---|---|
| Pipecat Dataset WER | 1.77%1st of 17 | 3.90%15th of 17 |
| Ocular Dataset WER | 4.50%14th of 17 | 4.18%8th of 17 |
| Time to first text | 485ms1st of 15 | 791ms3rd of 15 |
| Final-text delay | 91ms3rd of 17 | 108ms5th of 17 |
| Model | Pipecat clips | Ocular recordings | Turns timed | Failed |
|---|---|---|---|---|
| AssemblyAI Universal 3.6 Pro | 1,000 | 8 | 206 | 0 |
| Deepgram Flux English | 999 | 8 | 199 | 7 |
Only clips with usable text count, so the two totals can differ. How WER is scored.
Both providers, every model: AssemblyAI vs Deepgram
AssemblyAI Universal 3.6 Pro is more accurate on the public clips. On the 1,000 public Pipecat clips, AssemblyAI Universal 3.6 Pro scores 1.77% and Deepgram Flux English 3.90%, so AssemblyAI Universal 3.6 Pro makes fewer errors by 2.13 points. On the eight licensed Ocular recordings, AssemblyAI Universal 3.6 Pro scores 4.50% and Deepgram Flux English 4.18%, with likely ranges of 3.66 to 5.34% and 3.08 to 5.23%. The ranges overlap, so the difference is too close to call. Word error rate counts incorrect, missing, and extra words, so lower is better.
Yes. AssemblyAI Universal 3.6 Pro finishes the transcript 17ms sooner. AssemblyAI Universal 3.6 Pro has the final transcript 91ms after the speaker stops and Deepgram Flux English 108ms, at the median. Both are measured on the same 206 streamed turns.
AssemblyAI Universal 3.6 Pro finishes the transcript 17ms sooner, and the two are too close to call on real conversations. A voice agent cannot reply until the final transcript arrives, and the Ocular recordings are real conversations.
Yes, both return partial text before the speaker stops. AssemblyAI Universal 3.6 Pro shows first text after 485ms and Deepgram Flux English after 791ms, at the median, so AssemblyAI Universal 3.6 Pro is 306ms sooner.