CekuraBench

Gemini 3.8 Live Extended ThinkingvsGPT-Live 1 + GPT-6 Sol

All comparisonsLeaderboard
Compare
Gemini 3.8 Live Extended ThinkingGoogle
Wins 2 of 8
Reliability
52.4%
Response time
2.07s
Cost / min
n/a
GPT-Live 1 + GPT-6 SolOpenAI
Wins 5 of 8
Reliability
75.6%
Response time
2.02s
Cost / min
$0.055

GPT-Live 1 + GPT-6 Sol is ahead on reliability, success rate, agent responses, data accuracy and response time, and Gemini 3.8 Live Extended Thinking on calls where the agent went quiet and interruption.

Last updated Methodology by Dileep Chagam

Who is better at what

Gemini 3.8 Live Extended ThinkingGPT-Live 1 + GPT-6 Sol
  • Reliability52.4%75.6%
  • Success rate76.0%83.7%
  • Agent responses88.6%100.0%
  • Data accuracy84.4%89.0%
  • Went quiet5.3%12.2%
  • Interruption4.954.89
  • Response time2.07s2.02s
  • Cost / minNo verified rate$0.055

Results by call

Right every time, on booking and Medicare calls

Booking callsMedicare calls
  1. 59%
    35%
    Gemini 3.8 Live Extended Thinking
  2. 92%
    35%
    GPT-Live 1 + GPT-6 Sol

Related comparisons

Both providers, every model: Google vs OpenAI

Gemini 3.8 Live Extended Thinking vs GPT-Live 1 + GPT-6 Sol FAQ

  • GPT-Live 1 + GPT-6 Sol is more reliable, by 23.2 points. Gemini 3.8 Live Extended Thinking passed 43 of 82 scenarios on all three runs, and GPT-Live 1 + GPT-6 Sol passed 62. A scenario only counts when every run of it passed.

  • For a voice agent, GPT-Live 1 + GPT-6 Sol, since it gets more scenarios right on every run. GPT-Live 1 + GPT-6 Sol is ahead on reliability, success rate, agent responses, data accuracy and response time, and Gemini 3.8 Live Extended Thinking on calls where the agent went quiet and interruption.

  • GPT-Live 1 + GPT-6 Sol, by 4.6 points. Gemini 3.8 Live Extended Thinking saved everything exactly right on 84.4% of the calls that save data, and GPT-Live 1 + GPT-6 Sol on 89.0%. On Booking calls, 88.9% against 100.0%. On Medicare calls, 72.7% against 60.6%. A call counts only when nothing is missing, wrong, extra or saved twice.

  • No. GPT-Live 1 + GPT-6 Sol starts replying 0.05s sooner at the median. Gemini 3.8 Live Extended Thinking takes 2.07s at the median and 2.74s at p90; GPT-Live 1 + GPT-6 Sol takes 2.02s and 2.42s. Both are measured on the call audio, from the caller finishing to the agent starting to reply.

  • Gemini 3.8 Live Extended Thinking, by 0.06 on a 0 to 5 scale. Gemini 3.8 Live Extended Thinking scores 4.95 and GPT-Live 1 + GPT-6 Sol 4.89 for how well the agent handled being talked over.

  • Gemini 3.8 Live Extended Thinking, by 6.9 points. The agent went quiet for 10 seconds or more on 5.3% of Gemini 3.8 Live Extended Thinking calls and 12.2% of GPT-Live 1 + GPT-6 Sol calls.

  • There is no verified per-minute rate for Gemini 3.8 Live Extended Thinking, so cost cannot be compared yet.

  • Cekura ran both as the whole agent in the same open-source Pipecat pipeline, with the same prompt, tools and connection. A simulated caller worked through all 82 scenarios on live calls, three times each, 3,198 calls across the benchmark. A call passes only when the agent said the right things and saved the right data.