First prenatal visit
HealthcareFinished the task
Handled well: Emotion Recognition, Overlapping-Speech Recovery, Tool-Latency Handling
Listen to the call1154
ELOELO Rating
1st of 12
42.9%
Pass³Reliability (Pass³)
1st of 12
1.60s
LatencyLatency P50
2nd of 12
$0.080
Cost/MinCost per Minute (USD)
5th of 8
Higher wins more head-to-head calls (1000 = average); further left replies faster
Each model took the same recorded human callers on live calls. Pick a measure to see where Grok Voice 3.0 ranks.
Rating from head-to-head calls: on every call each pair of models is compared, the better call wins. 1000 is the average model. Higher is better.
Pick a skill family. The shape is this model on every skill in it; the dashed line is the median of the other models.
Share of calls where the skill was needed and handled, strongest first. Hover a point on the chart for both values.
Banking and healthcare callers. Each shows what the caller needed, what made the call hard, and how the model handled it.
Finished the task
Handled well: Emotion Recognition, Overlapping-Speech Recovery, Tool-Latency Handling
Listen to the callFinished the task
Handled well: Side-Speech Rejection, Tool-Latency Handling, Mid-Utterance Pause Tolerance
Listen to the callFinished the task
Handled well: Degraded-Channel Robustness, Multi-Speaker Handling, Overlapping-Speech Recovery
Listen to the callFinished the task
Handled well: Entity Extraction Accuracy, Degraded-Channel Robustness, Backchannel vs Barge-in Detection
Listen to the callFinished 6 of 7 steps
Handled well: Prosodic Cue Understanding, Mid-Utterance Pause Tolerance, Consent Verification
Struggled with: Low-Confidence Confirmation
Listen to the callFinished 4 of 6 steps
Handled well: Waiting Through Hold, Multi-Speaker Handling, Backchannel vs Barge-in Detection
Listen to the callFinished 2 of 3 steps
Handled well: Tool-Latency Handling, Mid-Utterance Pause Tolerance, Consent Verification
Struggled with: Premature-Response Avoidance
Listen to the callFinished 3 of 5 steps
Handled well: Tool-Latency Handling, Consent Verification, Redundant Re-prompt Avoidance
Struggled with: Cancellation Handling
Listen to the callFinished 4 of 6 steps
Handled well: Prosodic Cue Understanding, Endpointing, Premature-Response Avoidance
Struggled with: Multi-Speaker Handling
Listen to the callFinished 5 of 8 steps
Handled well: Correction Handling, Tool Error Handling, Redundant Re-prompt Avoidance
Struggled with: Low-Confidence Confirmation
Listen to the callGrok Voice 3.0 starts replying in 1.60s on a typical turn and 2.20s on the slowest turn in twenty, 2nd fastest of 12 at the median.
210 live calls: 70 scenarios, each run three times. The median call ran 3:38.
70 scenarios, the same for every model.
Grok Voice 3.0 has an ELO rating of 1154, 1st of 12 ranked models. It passed 30 of 70 callers on all three runs, a Pass³ of 42.9%.
Grok Voice 3.0 has an ELO rating of 1154, 1st of 12 ranked models. It passed 30 of 70 callers on all three runs, a Pass³ of 42.9%.
Grok Voice 3.0 starts replying 1.60s after the caller finishes at P50, 1.94s at P90 and 2.20s at P95: 2nd fastest of 12 at P50, measured on the call audio.
Grok Voice 3.0 is at or above the median score on every call type.
Grok Voice 3.0 has a task completion rate of 34.8%, 2nd of 12. A call counts only when every step the caller needed was done.
$0.080 per minute of call at xAI's published rates, 5th cheapest of 8 priced models. Excludes a text-input charge the vendor lists without a unit.
Cekura ran Grok Voice 3.0 as the whole agent with the same prompt, tools and phone connection as every other model. It took the same 70 recorded real human callers on live calls, three times each (210 calls), and each call was graded on 25 skills across Hearing, Turn Taking, Task Handling and Speaking.
Cekura runs these simulated calls on your agent and scores every one.