Gemini Live
- Strength
- Second-highest repetition score at 4.78/5 across 174 scored calls.
- What can be improved
- One rerun had no latency evidence and scored 0/5 for both task outcome and tool accuracy.
- reasoning: high
- hybrid VAD
Telnyx is ahead on repeatable reliability, task completion, infrastructure reliability, tool call accuracy and response time, and Gemini Live on interruption handling.
Last updated Methodology by Luis Ojeda
Pick Gemini Live for handling interruptions (0.34 higher). Pick Telnyx for reliability across repeated runs (37.80 points higher), completing the caller's task (9.76 points higher), calls that connect and stay up (27.64 points higher), accurate tool calls (0.31 higher) and fast replies (1.23s faster).
Bars share one scale across all 8 platforms. The place next to each figure is its rank in the field.
Share of the 82 scenarios that passed on all three runs.
Telnyx, 37.80 points higher
Calls where the expected outcome was fully reached.
Telnyx, 9.76 points higher
Calls with no connection, audio or platform failure.
Telnyx, 27.64 points higher
Mean score for calling the right tool with the right arguments.
Telnyx, 0.31 higher
Mean score for how clear and natural the agent sounds.
Not comparable
Mean score for yielding and recovering when the caller cuts in.
Gemini Live, 0.34 higher
Mean time for the agent to start replying after the caller stops.
Telnyx, 1.23s faster
246 calls per platform: 82 scenarios, 3 runs each.
Telnyx is more reliable, by 37.80 points. Gemini Live passed 30.49% of the 82 scenarios on all 3 runs and Telnyx passed 68.29%. A scenario only counts when every run of it passed.
Telnyx starts replying sooner, 1.23s faster. Mean response time is 3.05s for Gemini Live and 1.82s for Telnyx.
Gemini Live reached the expected outcome on 87.80% of calls and Telnyx on 97.56%. Telnyx is ahead on task completion.
Both ran the same Appointment and Medicare agents through the same 82 caller scenarios, 3 times each, with the same evaluators and mock tools. Only the platform and its speech and model components changed.