1030
ELOELO Rating
5th of 12
28.6%
Pass³Reliability (Pass³)
7th of 12
1.44s
LatencyLatency P50
1st of 12
$0.080
Cost/MinCost per Minute (USD)
5th of 8
Higher wins more head-to-head calls (1000 = average); further left replies faster
Each model took the same recorded human callers on live calls. Pick a measure to see where Grok Voice Think Fast 2.0 ranks.
Rating from head-to-head calls: on every call each pair of models is compared, the better call wins. 1000 is the average model. Higher is better.
Pick a skill family. The shape is this model on every skill in it; the dashed line is the median of the other models.
Share of calls where the skill was needed and handled, strongest first. Hover a point on the chart for both values.
Banking and healthcare callers. Each shows what the caller needed, what made the call hard, and how the model handled it.
Finished 3 of 6 steps
Handled well: Emotion Recognition, Overlapping-Speech Recovery, Tool-Latency Handling
Struggled with: Multi-Speaker Handling, Human Handoff, Cancellation Handling
Listen to the callFinished 6 of 7 steps
Handled well: Side-Speech Rejection, Tool-Latency Handling, Mid-Utterance Pause Tolerance
Listen to the callFinished the task
Handled well: Degraded-Channel Robustness, Multi-Speaker Handling, Overlapping-Speech Recovery
Listen to the callFinished 2 of 3 steps
Handled well: Degraded-Channel Robustness, Consent Verification, Redundant Re-prompt Avoidance
Struggled with: Entity Extraction Accuracy
Listen to the callFinished 4 of 6 steps
Handled well: Prosodic Cue Understanding, Mid-Utterance Pause Tolerance, Redundant Re-prompt Avoidance
Struggled with: Low-Confidence Confirmation, Consent Verification
Listen to the callFinished the task
Handled well: Waiting Through Hold, Multi-Speaker Handling, Consent Verification
Listen to the callFinished 2 of 3 steps
Handled well: Tool-Latency Handling, Consent Verification, Redundant Re-prompt Avoidance
Struggled with: Mid-Utterance Pause Tolerance, Premature-Response Avoidance, Numeric Read-back
Listen to the callFinished 1 of 4 steps
Handled well: Tool-Latency Handling, Redundant Re-prompt Avoidance, Hallucinated-Success Avoidance
Struggled with: Consent Verification
Listen to the callFinished 3 of 6 steps
Handled well: Prosodic Cue Understanding, Endpointing, Premature-Response Avoidance
Struggled with: Multi-Speaker Handling
Listen to the callFinished 6 of 7 steps
Handled well: Backchannel vs Barge-in Detection, Tool Error Handling, Redundant Re-prompt Avoidance
Struggled with: Low-Confidence Confirmation
Listen to the callGrok Voice Think Fast 2.0 starts replying in 1.44s on a typical turn and 2.04s on the slowest turn in twenty, 1st fastest of 12 at the median.
210 live calls: 70 scenarios, each run three times. The median call ran 3:18.
70 scenarios, the same for every model.
Grok Voice Think Fast 2.0 has an ELO rating of 1030, 5th of 12 ranked models. It passed 20 of 70 callers on all three runs, a Pass³ of 28.6%.
Grok Voice Think Fast 2.0 has an ELO rating of 1030, 5th of 12 ranked models. It passed 20 of 70 callers on all three runs, a Pass³ of 28.6%.
Grok Voice Think Fast 2.0 starts replying 1.44s after the caller finishes at P50, 1.83s at P90 and 2.04s at P95: 1st fastest of 12 at P50, measured on the call audio.
Grok Voice Think Fast 2.0 falls furthest behind on Corrections and Changes: 48%, against a median of 61%.
Grok Voice Think Fast 2.0 has a task completion rate of 22.9%, 7th of 12. A call counts only when every step the caller needed was done.
$0.080 per minute of call at xAI's published rates, 5th cheapest of 8 priced models. Excludes a text-input charge the vendor lists without a unit.
Cekura ran Grok Voice Think Fast 2.0 as the whole agent with the same prompt, tools and phone connection as every other model. It took the same 70 recorded real human callers on live calls, three times each (210 calls), and each call was graded on 25 skills across Hearing, Turn Taking, Task Handling and Speaking.
Cekura runs these simulated calls on your agent and scores every one.
