OpenAI vs Reson8
Reson8 is ahead of OpenAI on both datasets together, the Pipecat Dataset, time to first text and final-text delay. The Ocular Dataset is too close to call.
Last updated Methodology by Dileep Chagam
Who is better at what
Each row sets OpenAI's best model against Reson8's best on that measure.
- Overall WER2.63%GPT Realtime Whisper2.05%Reson8 Rumble-2
- Pipecat Dataset WER2.16%GPT Realtime Whisper1.69%Reson8 Rumble-2
- Ocular Dataset WER3.53%GPT Realtime Whisper2.75%Reson8 Rumble-2
- Time to first text1.38sGPT Realtime Whisper486msReson8 Rumble-2
- Final-text delay543msGPT Realtime Whisper18msReson8 Rumble-2
OpenAI vs Reson8 FAQ
Is OpenAI or Reson8 better for speech-to-text?
Reson8 is ahead, 0.47 points lower. The best OpenAI result is GPT Realtime Whisper at 2.16%, and the best Reson8 result is Reson8 Rumble-2 at 1.69%, on the Pipecat Dataset.
Reson8 is ahead, 0.47 points lower. The best OpenAI result is GPT Realtime Whisper at 2.16%, and the best Reson8 result is Reson8 Rumble-2 at 1.69%, on the Pipecat Dataset.
Reson8 is faster, 525ms sooner. The best OpenAI result is GPT Realtime Whisper at 543ms, and the best Reson8 result is Reson8 Rumble-2 at 18ms, on final-text delay.
OpenAI: GPT-4o Mini Transcribe, GPT-4o Transcribe, GPT Realtime Whisper. Reson8: Reson8 Resonant-1, Reson8 Rumble-2. Every model ran the same tests on Converse-STT.
Test your voice agent the same way.
Cekura runs these simulated calls on your agent and scores every one.