Reson8 is ahead on both datasets together and final-text delay, and AssemblyAI on time to first text. The Pipecat Dataset and The Ocular Dataset are too close to call.
Last updated Methodology by Dileep Chagam
Each row sets AssemblyAI's best model against Reson8's best on that measure.
It is too close to call: the gap is inside the margin of error. The best AssemblyAI result is AssemblyAI Universal 3.6 Pro at 1.77%, and the best Reson8 result is Reson8 Rumble-2 at 1.69%, on the Pipecat Dataset.
It is too close to call: the gap is inside the margin of error. The best AssemblyAI result is AssemblyAI Universal 3.6 Pro at 1.77%, and the best Reson8 result is Reson8 Rumble-2 at 1.69%, on the Pipecat Dataset.
Reson8 is faster, 73ms sooner. The best AssemblyAI result is AssemblyAI Universal 3.6 Pro at 91ms, and the best Reson8 result is Reson8 Rumble-2 at 18ms, on final-text delay.
AssemblyAI: AssemblyAI Universal 3.5 Pro, AssemblyAI Universal 3.6 Pro. Reson8: Reson8 Resonant-1, Reson8 Rumble-2. Every model ran the same tests on Converse-STT.
Cekura runs these simulated calls on your agent and scores every one.