CekuraBench

Grok Voice 3.0

Every modelCompare

81.7%

Reliability

1st of 12

1.34s

Median reply

1st of 12

$0.080

Cost / min

5th of 9

Reliability vs. response time

Higher and further left is better

Best quadrant
Reliability, pass³ (%)
Median response time (s)

For the wider field, see our pick of the best voice AI APIs for real-time audio.

Grok Voice 3.0 against every other model

Scenarios that passed on all 3 runs, pass³. Higher is better.

#ModelReliability
  1. 01Grok Voice 3.081.7%
  2. 02GPT Realtime 2.179.3%
  3. 03GPT-Live 1 + GPT-6 Sol75.6%
  4. 04Azure Realtime70.7%
  5. 05Phonic v168.3%
  6. 06Grok Voice Think Fast 2.067.1%
  7. 07Gemini 3.1 Flash Live Preview62.2%
  8. 08Deepslate Opal57.3%
  9. 09Gemini 3.8 Live Extended Thinking52.4%
  10. 10Amazon Nova 2 Sonic50.0%
  11. 11GPT Realtime 2.1 Mini50.0%
  12. 12Gemini 3.8 Live41.5%
  • refCascade82.9%

Where Grok Voice 3.0 struggled

Grok Voice 3.0 falls furthest behind on interruptions and barge-in: 87% passed, against a median of 90%.

Below the medianPassedMedian
  • Interruptions & barge-in
    87%median 90%
  • Plain booking & lookup
    93%median 94%
Mistakes in saved data
  • Field left out45 · 64%
  • Extra call11 · 16%
  • Step skipped10 · 14%

Fields it got wrong most: zip_code, route_id, lead_id

Response time at P50, P90 and P95

Grok Voice 3.0 starts replying in 1.34s on a typical turn and 1.74s on the slowest turn in twenty, 1st fastest of 12 at the median.

ModelP50P90P95
  • Cascade
    2.17s2.51s2.62s
Seconds from the caller finishing to the agent replying. The bar is the typical turn, P50.

Grok Voice 3.0 head to head

Every comparisonAll 12 models

How much audio Grok Voice 3.0 was tested on

246 live calls: 82 scenarios, each run three times. The median call ran 1:31.

Live calls
246
Scenarios
82
Booking calls
177
Medicare calls
69
Replies per call
6.8
Median call
1:31

82 scenarios, the same for every model. See every test case

Grok Voice 3.0 FAQ

  • Grok Voice 3.0 passed 67 of 82 scenarios on all three runs, 81.7%, 1st of 12 realtime models. Across all 246 calls, 86.6% passed every check.

  • Grok Voice 3.0 starts replying 1.34s after the caller finishes at the median, 1.62s at P90 and 1.74s at P95. That is 1st fastest of 12 at the median, measured on the call audio.

  • Grok Voice 3.0 falls furthest behind the field on interruptions and barge-in: 87% of calls passed, against a median of 90%. When it saved data wrong, the most common mistake was field left out, 64% of them.

  • Grok Voice 3.0 saved everything exactly right on 87.3% of the calls that save data, 3rd of 12. On Booking calls, 98.2%. On Medicare calls, 59.1%.

  • $0.080 a minute of call at xAI's published rates, 5th cheapest of 9 priced models. Excludes a text-input charge the vendor lists without a unit.

  • Cekura ran Grok Voice 3.0 as the whole agent in the same open-source Pipecat pipeline as every other model, with the same prompt, tools and connection. A simulated caller worked through 82 scenarios on live calls, three times each: 246 calls for Grok Voice 3.0. A call passes only when the agent said the right things and saved the right data.