Inworld STT-1 vs Reson8 Rumble-2
Accuracy and speed
Left gets fewer words wrong. Lower has the final text ready sooner.
- STT-12.72% · 41ms
- Rumble-21.69% · 18ms
Reson8 Rumble-2 is ahead of Inworld STT-1 on both datasets together, the Ocular Dataset, time to first text and final-text delay. The Pipecat Dataset is too close to call.
Last updated Methodology by Dileep Chagam
Who is better at what
- Overall WER5.44%2.05%
- Pipecat Dataset WER2.72%1.69%
- Ocular Dataset WER10.60%2.75%
- Time to first text1.06s486ms
- Final-text delay41ms18ms
Lower is better on every measure. Too close to call means the likely ranges overlap.
STT-1 vs Rumble-2 FAQ
Which is more accurate, Inworld STT-1 or Reson8 Rumble-2?
Reson8 Rumble-2 is more accurate on the public clips. On the 1,000 public Pipecat clips, Inworld STT-1 scores 5.44% and Reson8 Rumble-2 2.05%, so Reson8 Rumble-2 makes fewer errors by 3.38 points. On the 300 licensed Ocular turns, Inworld STT-1 scores 2.72% and Reson8 Rumble-2 1.69%, with likely ranges of 1.67 to 4.68% and 1.48 to 1.92%. The ranges overlap, so the difference is too close to call. Word error rate counts incorrect, missing, and extra words, so lower is better.
Reson8 Rumble-2 is more accurate on the public clips. On the 1,000 public Pipecat clips, Inworld STT-1 scores 5.44% and Reson8 Rumble-2 2.05%, so Reson8 Rumble-2 makes fewer errors by 3.38 points. On the 300 licensed Ocular turns, Inworld STT-1 scores 2.72% and Reson8 Rumble-2 1.69%, with likely ranges of 1.67 to 4.68% and 1.48 to 1.92%. The ranges overlap, so the difference is too close to call. Word error rate counts incorrect, missing, and extra words, so lower is better.
No. Reson8 Rumble-2 finishes the transcript 577ms sooner. Inworld STT-1 has the final transcript 1.06s after the speaker stops and Reson8 Rumble-2 486ms, at the median. Both are measured on the same 206 streamed turns.
Reson8 Rumble-2 finishes the transcript 577ms sooner, and the two are too close to call on real conversations. A voice agent cannot reply until the final transcript arrives, and the Ocular recordings are real conversations.
Yes, both return partial text before the speaker stops. Inworld STT-1 shows first text after 10.60% and Reson8 Rumble-2 after 2.75%, at the median, so Reson8 Rumble-2 is 7.86 points lower.
Test your voice agent the same way.
Cekura runs these simulated calls on your agent and scores every one.