All comparisons
GradiumReson8

Gradium vs Reson8

Gradium is ahead on time to first text and final-text delay, and Reson8 on the Pipecat Dataset. The Ocular Dataset is too close to call.

Last updated Methodology by Dileep Chagam

Compare

Accuracy vs speed

Each dot is one model. Bottom-left is best: fewer errors and a faster final transcript.

Top half on bothBest picks
Final-text delay P50 (ms)
Pipecat Dataset WER (%)
Shaded box: top half on both measures. Dotted line: no other model is both more accurate and faster.
Verdict

Which to pick

Pick Gradium for showing words while the caller is still talking (695ms sooner) and quick turn-taking once the caller stops (23ms sooner). Pick Reson8 for accuracy on clean, scripted audio (4.38 points lower). For accuracy on real phone conversations, the gap is inside the margin of error, so neither is ahead.

Head to head

The four metrics, side by side

Pipecat Dataset WER
Gradium
6.48%17th
Reson8
2.10%4th

Reson8, 4.38 points lower

Ocular Dataset WER
Gradium
4.45%12th
Reson8
2.93%1st

Too close to call: inside the margin of error

Time to first text
Gradium
1.71s12th
Reson8
2.40s13th

Gradium, 695ms sooner

Final-text delay
Gradium
212ms11th
Reson8
235ms12th

Gradium, 23ms sooner

Lower is better on every metric. The small figure is each model's place in the whole field. What each metric measures.

WER · Word error rate
Share of words the model got wrong: replaced, missing or added. Lower is better.
Pipecat Dataset
1,000 short public clips from Pipecat's STT benchmark dataset.
Ocular Dataset
8 recordings from 4 real phone conversations, licensed from Ocular.
TTFT · Time to first text
How long after the audio starts streaming until the first words appear.
TTFS · Final-text delay
How long after the caller stops until the full transcript arrives. A voice agent waits for this before it replies.
Latency

First text and final text, at three percentiles

Gradium shows first text after 7.32s and final text after 280ms, and Reson8 shows first text after 10.20s and final text after 398ms, on a bad turn (P95) across the same streamed turns.

MeasureModelP50P90P95
Time to first textGradium1.71s4.05s7.32s
Reson82.40s7.97s10.20s
Final-text delayGradium212ms266ms280ms
Reson8235ms357ms398ms
P50 / P90 / P95 · Typical, slow and slowest turns
Half of turns are faster than P50. Only 1 in 10 is slower than P90, and 1 in 20 slower than P95.
Ranking

How each ranks among all 17 models

Place among the 17 models on each metric. Lower is better on all four.

MetricGradiumReson8
Pipecat Dataset WER6.48%17th of 172.10%4th of 17
Ocular Dataset WER4.45%12th of 172.93%1st of 17
Time to first text1.71s12th of 152.40s13th of 15
Final-text delay212ms11th of 17235ms12th of 17
Coverage

How much audio each model was tested on

ModelPipecat clipsOcular recordingsTurns timedFailed
Gradium1,00081980
Reson81,00082010

Only clips with usable text count, so the two totals can differ. How WER is scored.

Questions

Frequently asked questions

Which is more accurate, Gradium or Reson8?

Reson8 is more accurate on the public clips. On the 1,000 public Pipecat clips, Gradium scores 6.48% and Reson8 2.10%, so Reson8 makes fewer errors by 4.38 points. On the eight licensed Ocular recordings, Gradium scores 4.45% and Reson8 2.93%, with likely ranges of 3.17 to 5.90% and 2.29 to 3.68%. The ranges overlap, so the difference is too close to call. Word error rate counts incorrect, missing, and extra words, so lower is better.

Is Gradium faster than Reson8?

Yes. Gradium finishes the transcript 23ms sooner. Gradium has the final transcript 212ms after the speaker stops and Reson8 235ms, at the median. Both are measured on the same 206 streamed turns.

Is Gradium or Reson8 better for voice agents?

Gradium finishes the transcript 23ms sooner, and the two are too close to call on real conversations. A voice agent cannot reply until the final transcript arrives, and the Ocular recordings are real conversations.

Do Gradium and Reson8 stream text while the speaker is talking?

Yes, both return partial text before the speaker stops. Gradium shows first text after 1.71s and Reson8 after 2.40s, at the median, so Gradium is 695ms sooner.