CekuraBench
Book a demo

GPT-Live 1 + GPT-6 Sol

Every modelCompare

1069

ELO

2nd of 12

32.9%

Pass³

4th of 12

2.27s

Latency

8th of 12

$0.055

Cost/Min

2nd of 8

ELO Rating vs. Latency P50

Higher wins more head-to-head calls (1000 = average); further left replies faster

Best quadrant
ELO Rating
Median latency (s)

GPT-Live 1 + GPT-6 Sol Against Every Other Model

Each model took the same recorded human callers on live calls. Pick a measure to see where GPT-Live 1 + GPT-6 Sol ranks.

Rating from head-to-head calls: on every call each pair of models is compared, the better call wins. 1000 is the average model. Higher is better.

#ModelELO Rating
  1. 01Grok Voice 3.01154
  2. 02GPT-Live 1 + GPT-6 Sol1069
  3. 03Gemini 3.1 Flash Live Preview1062
  4. 04GPT Realtime 2.11054
  5. 05Grok Voice Think Fast 2.01030
  6. 06Phonic-11030
  7. 07Azure Realtime1017
  8. 08Gemini 3.8 Live Extended Thinking1016
  9. 09Gemini 3.8 Live968
  10. 10GPT Realtime 2.1 Mini921
  11. 11Deepslate Opal847
  12. 12Amazon Nova 2 Sonic832
  • refCascade955

Where GPT-Live 1 + GPT-6 Sol Is Strong and Weak

Pick a skill family. The shape is this model on every skill in it; the dashed line is the median of the other models.

GPT-Live 1 + GPT-6 SolMedian of the other models
71Hearing Score3rd of 12+5 vs median
SkillScore · vs median
  • Entity Extraction Accuracy76%+44
  • Multi-Speaker Handling62%+19
  • Emotion Recognition100%+16
  • Low-Confidence Confirmation31%+12
  • Side-Speech Rejection100%+5
  • Waiting Through Hold88%+4
  • Degraded-Channel Robustness75%0
  • Prosodic Cue Understanding38%−40

Share of calls where the skill was needed and handled, strongest first. Hover a point on the chart for both values.

Example Calls from GPT-Live 1 + GPT-6 Sol

Banking and healthcare callers. Each shows what the caller needed, what made the call hard, and how the model handled it.

First prenatal visit

Healthcare
Upset callerSeveral peopleTalks over the agentNeeds a person

Finished the task

Handled well: Emotion Recognition, Multi-Speaker Handling, Overlapping-Speech Recovery

Listen to the call

Urgent visit for a feverish child

Healthcare
Background voicesSlow systemAsks to holdAsks for a number

Finished 6 of 7 steps

Handled well: Side-Speech Rejection, Tool-Latency Handling, Mid-Utterance Pause Tolerance

Listen to the call

Reschedule a specialist visit

Healthcare
Bad connectionSeveral peopleTalks over the agentChanges their mind

Finished the task

Handled well: Degraded-Channel Robustness, Multi-Speaker Handling, Overlapping-Speech Recovery

Listen to the call

Update insurance details

Healthcare
Spells names and numbersBad connectionNeeds consentCancels

Finished the task

Handled well: Degraded-Channel Robustness, Consent Verification, Cancellation Handling

Struggled with: Entity Extraction Accuracy, Numeric Read-back

Listen to the call

Loan payoff quote

Banking
Noisy lineAsks to holdNeeds consentCancels

Finished 6 of 7 steps

Handled well: Mid-Utterance Pause Tolerance, Consent Verification, Cancellation Handling

Struggled with: Low-Confidence Confirmation

Listen to the call

Change a mortgage payment date

Banking
Hold musicSeveral peopleInterruptsNeeds a person

Finished 6 of 7 steps

Handled well: Waiting Through Hold, Multi-Speaker Handling, Backchannel vs Barge-in Detection

Struggled with: Human Handoff

Listen to the call

Business loan documents

Banking
Slow systemAsks to holdNeeds consent

Finished 2 of 3 steps

Handled well: Mid-Utterance Pause Tolerance, Consent Verification, Redundant Re-prompt Avoidance

Struggled with: Tool-Latency Handling, Premature-Response Avoidance

Listen to the call

Request a medical records transfer

Healthcare
Slow systemNeeds consentCancelsAsks for a number

Finished 3 of 5 steps

Handled well: Redundant Re-prompt Avoidance, Hallucinated-Success Avoidance, Numeric Read-back

Struggled with: Tool-Latency Handling, Consent Verification, Cancellation Handling

Listen to the call

Payment plan for missed loan payments

Banking
Several peoplePauses mid-sentenceNeeds consent

Finished the task

Handled well: Multi-Speaker Handling, Endpointing, Premature-Response Avoidance

Listen to the call

Remove a sold car from a policy

Banking
Noisy lineBackground voicesInterruptsChanges their mind

Finished the task

Handled well: Low-Confidence Confirmation, Side-Speech Rejection, Correction Handling

Struggled with: Backchannel vs Barge-in Detection

Listen to the call

Latency at P50, P90 and P95

GPT-Live 1 + GPT-6 Sol starts replying in 2.27s on a typical turn and 2.83s on the slowest turn in twenty, 8th fastest of 12 at the median.

ModelP50P90P95
  • Cascade
    2.06s2.49s2.60s
Seconds from the caller finishing to the agent replying. The bar is the typical turn, P50.

GPT-Live 1 + GPT-6 Sol Head to Head

Every comparisonAll 12 models

How Much Audio GPT-Live 1 + GPT-6 Sol Was Tested On

210 live calls: 70 scenarios, each run three times. The median call ran 4:46.

Live calls
210
Scenarios
70
Banking calls
105
Healthcare calls
105
Replies per call
21.2
Median call
4:46

70 scenarios, the same for every model.

GPT-Live 1 + GPT-6 Sol FAQ

  • GPT-Live 1 + GPT-6 Sol has an ELO rating of 1069, 2nd of 12 ranked models. It passed 23 of 70 callers on all three runs, a Pass³ of 32.9%.

  • GPT-Live 1 + GPT-6 Sol starts replying 2.27s after the caller finishes at P50, 2.72s at P90 and 2.83s at P95: 8th fastest of 12 at P50, measured on the call audio.

  • GPT-Live 1 + GPT-6 Sol falls furthest behind on Barge-in and Overlap: 85%, against a median of 98%.

  • GPT-Live 1 + GPT-6 Sol has a task completion rate of 36.2%, 1st of 12. A call counts only when every step the caller needed was done.

  • $0.055 per minute of call at OpenAI's published rates, 2nd cheapest of 8 priced models. Includes the delegated backend model.

  • Cekura ran GPT-Live 1 + GPT-6 Sol as the whole agent with the same prompt, tools and phone connection as every other model. It took the same 70 recorded real human callers on live calls, three times each (210 calls), and each call was graded on 25 skills across Hearing, Turn Taking, Task Handling and Speaking.

Test your voice agent the same way.

Cekura runs these simulated calls on your agent and scores every one.

Book a demoStart free