All comparisons
AmazonOpenAI

Amazon Nova 2 Sonic vs GPT Realtime 2.1 Mini

GPT Realtime 2.1 Mini is ahead on success rate, data accuracy and response time, and Amazon Nova 2 Sonic on agent responses and stalled calls. The two tie on reliability and interruption.

Last updated Methodology by Dileep Chagam

Compare

Success rate by suite

Higher is better
Appointments59 scenariosMedicare23 scenarios
  • Realtime 2.1 MiniOpenAI
    84%
    4%
  • Nova 2 SonicAmazon
    80%
    6%
Each model's share of calls that passed every check, on each suite.
Verdict

Which to pick

Pick Amazon Nova 2 Sonic for getting the agent's replies right (0.4 points higher) and fewer stalled calls (1.2 points lower). Pick GPT Realtime 2.1 Mini for calls that pass every check (2.0 points higher), saving the caller's data correctly (4.6 points higher) and fast replies (0.10s sooner). They are level on reliability across repeated calls and handling interruptions.

Every metric, side by side

Reliability

Scenarios that passed on all three runs.

Nova 2 Sonic
50.0%9th
Realtime 2.1 Mini
50.0%9th

Level

Success rate

Calls that passed every check.

Nova 2 Sonic
59.3%11th
Realtime 2.1 Mini
61.4%10th

Realtime 2.1 Mini, 2.0 points higher

Agent responses

Calls where the agent's replies reached the expected outcome.

Nova 2 Sonic
93.9%9th
Realtime 2.1 Mini
93.5%10th

Nova 2 Sonic, 0.4 points higher

Data accuracy

Calls where everything the agent saved matched exactly.

Nova 2 Sonic
59.9%11th
Realtime 2.1 Mini
64.5%10th

Realtime 2.1 Mini, 4.6 points higher

Stalled calls

Calls where the agent went silent for 10 seconds or more.

Nova 2 Sonic
1.2%2nd
Realtime 2.1 Mini
2.5%4th

Nova 2 Sonic, 1.2 points lower

Interruption

How well it handled being talked over, 0 to 5.

Nova 2 Sonic
4.991st
Realtime 2.1 Mini
4.992nd

Level

Response time

Median time to start replying after the caller finishes.

Nova 2 Sonic
2.18s9th
Realtime 2.1 Mini
2.08s8th

Realtime 2.1 Mini, 0.10s sooner

Cost / min

One minute of call at the vendor's published rates.

Nova 2 Sonic
No verified rate
Realtime 2.1 Mini
$0.0201st

Not comparable

The small figure is the place among ranked models. The cascade is not ranked.

Realtime 2.1 Mini answers first

Realtime 2.1 Mini 2.08s, Nova 2 Sonic 2.18s at the median.

Response time, median to p90

Lower is betterMedianTo p90
Medianp90
  • Realtime 2.1 MiniOpenAI
    Realtime 2.1 Mini: median 2.08s, p90 2.75s
    2.08s2.75s
  • Nova 2 SonicAmazon
    Nova 2 Sonic: median 2.18s, p90 2.76s
    2.18s2.76s
2.0s3.0s
Seconds from the caller finishing to the agent starting to reply, per model.

What we saw on the calls

Amazon Nova 2 Sonic

  • Best voice score of the field.
All 3 notes on Nova 2 Sonic
Model
amazon.nova-2-sonic-v1:0
Setting
Endpointing medium
Voice
matthew
Turn taking
Shared local turn detection
Audio
16 kHz
Cost
The vendor's rates for this model are not yet verified.

GPT Realtime 2.1 Mini

  • Gets most bookings right, at a fraction of the cost.
All 3 notes on Realtime 2.1 Mini
Model
gpt-realtime-2.1-mini
Setting
Reasoning high
Voice
marin
Turn taking
Service turn detection
Audio
24 kHz
Cost
Averaged over the calls with a usage record.

Frequently asked questions

Is Amazon Nova 2 Sonic or GPT Realtime 2.1 Mini more reliable?

They are level on reliability. Amazon Nova 2 Sonic passed 41 of 82 scenarios on all three runs, and GPT Realtime 2.1 Mini passed 41. A scenario only counts when every run of it passed.

Which should I pick, Amazon Nova 2 Sonic or GPT Realtime 2.1 Mini?

Reliability does not separate them, so pick on the metric your calls need most. GPT Realtime 2.1 Mini is ahead on success rate, data accuracy and response time, and Amazon Nova 2 Sonic on agent responses and stalled calls. The two tie on reliability and interruption.

Which saves caller data more accurately, Amazon Nova 2 Sonic or GPT Realtime 2.1 Mini?

GPT Realtime 2.1 Mini, by 4.6 points. Amazon Nova 2 Sonic saved everything exactly right on 59.9% of the calls that save data, and GPT Realtime 2.1 Mini on 64.5%. On Appointments, 82.5% against 88.8%. On Medicare, 1.5% against 0.0%. A call counts only when nothing is missing, wrong, extra or saved twice.

Is Amazon Nova 2 Sonic faster than GPT Realtime 2.1 Mini?

No. GPT Realtime 2.1 Mini starts replying 0.10s sooner at the median. Amazon Nova 2 Sonic takes 2.18s at the median and 2.76s at p90; GPT Realtime 2.1 Mini takes 2.08s and 2.75s. Both are measured on the call audio, from the caller finishing to the agent starting to reply.

Which handles interruptions better, Amazon Nova 2 Sonic or GPT Realtime 2.1 Mini?

They score the same. Amazon Nova 2 Sonic scores 4.99 and GPT Realtime 2.1 Mini 4.99 for how well the agent handled being talked over.

Which goes silent on callers less often, Amazon Nova 2 Sonic or GPT Realtime 2.1 Mini?

Amazon Nova 2 Sonic, by 1.2 points. The agent went silent for 10 seconds or more on 1.2% of Amazon Nova 2 Sonic calls and 2.5% of GPT Realtime 2.1 Mini calls.

Which is cheaper, Amazon Nova 2 Sonic or GPT Realtime 2.1 Mini?

There is no verified per-minute rate for Amazon Nova 2 Sonic, so cost cannot be compared yet.

Where does the Amazon Nova 2 Sonic vs GPT Realtime 2.1 Mini data come from?

Cekura ran both as the whole agent in the same open-source Pipecat pipeline, with the same prompt, tools and connection. A simulated caller worked through all 82 scenarios on live calls, three times each, 2,952 calls across the benchmark. A call passes only when the agent said the right things and saved the right data.