Gemini 3.1 Flash Live PreviewvsAmazon Nova 2 Sonic

Compare
Gemini 3.1 Flash Live PreviewGoogle
Wins 4 of 8
Reliability
62.2%
Response time
2.88s
Cost / min
$0.070
Amazon Nova 2 SonicAmazon
Wins 3 of 8
Reliability
50.0%
Response time
2.18s
Cost / min
n/a

Gemini 3.1 Flash Live Preview is ahead on reliability, success rate, agent responses and data accuracy, and Amazon Nova 2 Sonic on calls where the agent went quiet, interruption and response time.

Last updated Methodology by Dileep Chagam

Who is better at what

Gemini 3.1 Flash Live PreviewAmazon Nova 2 Sonic
  • Reliability62.2%50.0%
  • Success rate76.0%59.3%
  • Agent responses95.9%93.9%
  • Data accuracy79.2%59.9%
  • Went quiet3.3%1.2%
  • Interruption4.984.99
  • Response time2.88s2.18s
  • Cost / min$0.070No verified rate

Results by call

Right every time, on booking and Medicare calls

Booking callsMedicare calls
  1. 83%
    9%
    Gemini 3.1 Flash Live Preview
  2. 68%
    4%
    Amazon Nova 2 Sonic

Gemini 3.1 Flash Live Preview vs Amazon Nova 2 Sonic FAQ

  • Gemini 3.1 Flash Live Preview is more reliable, by 12.2 points. Gemini 3.1 Flash Live Preview passed 51 of 82 scenarios on all three runs, and Amazon Nova 2 Sonic passed 41. A scenario only counts when every run of it passed.

  • For a voice agent, Gemini 3.1 Flash Live Preview, since it gets more scenarios right on every run. Gemini 3.1 Flash Live Preview is ahead on reliability, success rate, agent responses and data accuracy, and Amazon Nova 2 Sonic on calls where the agent went quiet, interruption and response time.

  • Gemini 3.1 Flash Live Preview, by 19.3 points. Gemini 3.1 Flash Live Preview saved everything exactly right on 79.2% of the calls that save data, and Amazon Nova 2 Sonic on 59.9%. On Booking calls, 96.5% against 82.5%. On Medicare calls, 34.8% against 1.5%. A call counts only when nothing is missing, wrong, extra or saved twice.

  • No. Amazon Nova 2 Sonic starts replying 0.70s sooner at the median. Gemini 3.1 Flash Live Preview takes 2.88s at the median and 4.00s at p90; Amazon Nova 2 Sonic takes 2.18s and 2.76s. Both are measured on the call audio, from the caller finishing to the agent starting to reply.

  • Amazon Nova 2 Sonic, by 0.01 on a 0 to 5 scale. Gemini 3.1 Flash Live Preview scores 4.98 and Amazon Nova 2 Sonic 4.99 for how well the agent handled being talked over.

  • Amazon Nova 2 Sonic, by 2.0 points. The agent went quiet for 10 seconds or more on 3.3% of Gemini 3.1 Flash Live Preview calls and 1.2% of Amazon Nova 2 Sonic calls.

  • There is no verified per-minute rate for Amazon Nova 2 Sonic, so cost cannot be compared yet.

  • Cekura ran both as the whole agent in the same open-source Pipecat pipeline, with the same prompt, tools and connection. A simulated caller worked through all 82 scenarios on live calls, three times each, 3,198 calls across the benchmark. A call passes only when the agent said the right things and saved the right data.