GPT-Live 1 + GPT-6 Sol vs Amazon Nova 2 Sonic

GPT-Live 1 + GPT-6 Sol is more reliable, by 25.6 points. GPT-Live 1 + GPT-6 Sol passed 62 of 82 scenarios on all three runs, and Amazon Nova 2 Sonic passed 41. A scenario only counts when every run of it passed.

For a voice agent, GPT-Live 1 + GPT-6 Sol, since it gets more scenarios right on every run. GPT-Live 1 + GPT-6 Sol is ahead on reliability, success rate, agent responses, data accuracy and response time, and Amazon Nova 2 Sonic on calls where the agent went quiet and interruption.

GPT-Live 1 + GPT-6 Sol, by 29.1 points. GPT-Live 1 + GPT-6 Sol saved everything exactly right on 89.0% of the calls that save data, and Amazon Nova 2 Sonic on 59.9%. On Booking calls, 100.0% against 82.5%. On Medicare calls, 60.6% against 1.5%. A call counts only when nothing is missing, wrong, extra or saved twice.

Yes. GPT-Live 1 + GPT-6 Sol starts replying 0.16s sooner at the median. GPT-Live 1 + GPT-6 Sol takes 2.02s at the median and 2.42s at p90; Amazon Nova 2 Sonic takes 2.18s and 2.76s. Both are measured on the call audio, from the caller finishing to the agent starting to reply.

Amazon Nova 2 Sonic, by 0.10 on a 0 to 5 scale. GPT-Live 1 + GPT-6 Sol scores 4.89 and Amazon Nova 2 Sonic 4.99 for how well the agent handled being talked over.

Amazon Nova 2 Sonic, by 11.0 points. The agent went quiet for 10 seconds or more on 12.2% of GPT-Live 1 + GPT-6 Sol calls and 1.2% of Amazon Nova 2 Sonic calls.

There is no verified per-minute rate for Amazon Nova 2 Sonic, so cost cannot be compared yet.

Cekura ran both as the whole agent in the same open-source Pipecat pipeline, with the same prompt, tools and connection. A simulated caller worked through all 82 scenarios on live calls, three times each, 3,690 calls across the benchmark. A call passes only when the agent said the right things and saved the right data.