Reson8 is ahead of Google on both datasets together, time to first text and final-text delay. The Pipecat Dataset and The Ocular Dataset are too close to call.
Last updated Methodology by Dileep Chagam
Each row sets Google's best model against Reson8's best on that measure.
It is too close to call: the gap is inside the margin of error. The best Google result is Google Chirp 3 at 2.00%, and the best Reson8 result is Reson8 Rumble-2 at 1.69%, on the Pipecat Dataset.
It is too close to call: the gap is inside the margin of error. The best Google result is Google Chirp 3 at 2.00%, and the best Reson8 result is Reson8 Rumble-2 at 1.69%, on the Pipecat Dataset.
Reson8 is faster, 457ms sooner. The best Google result is Google Chirp 3 at 475ms, and the best Reson8 result is Reson8 Rumble-2 at 18ms, on final-text delay.
Google: Google Chirp 2, Google Chirp 3. Reson8: Reson8 Resonant-1, Reson8 Rumble-2. Every model ran the same tests on Converse-STT.
Cekura runs these simulated calls on your agent and scores every one.