LiveKit
- Strength
- Ranks second on repeatable reliability with 99.19% infrastructure-clean calls.
- What can be improved
- Consent was collected, but consent_id was omitted from the handoff tool.
- nova-3
- openai/gpt-4.1
- sonic-3
Retell is ahead on repeatable reliability, tool call accuracy, interruption handling and response time, and LiveKit on task completion and infrastructure reliability. The two tie on voice tone and clarity.
Last updated Methodology by Luis Ojeda
Pick LiveKit for completing the caller's task (1.24 points higher) and calls that connect and stay up (0.82 points higher). Pick Retell for reliability across repeated runs (4.88 points higher), accurate tool calls (0.17 higher), handling interruptions (0.03 higher) and fast replies (0.38s faster). They are level on how the agent sounds.
Bars share one scale across all 8 platforms. The place next to each figure is its rank in the field.
Share of the 82 scenarios that passed on all three runs.
Retell, 4.88 points higher
Calls where the expected outcome was fully reached.
LiveKit, 1.24 points higher
Calls with no connection, audio or platform failure.
LiveKit, 0.82 points higher
Mean score for calling the right tool with the right arguments.
Retell, 0.17 higher
Mean score for how clear and natural the agent sounds.
Level
Mean score for yielding and recovering when the caller cuts in.
Retell, 0.03 higher
Mean time for the agent to start replying after the caller stops.
Retell, 0.38s faster
246 calls per platform: 82 scenarios, 3 runs each.
Retell is more reliable, by 4.88 points. LiveKit passed 70.73% of the 82 scenarios on all 3 runs and Retell passed 75.61%. A scenario only counts when every run of it passed.
Retell starts replying sooner, 0.38s faster. Mean response time is 2.59s for LiveKit and 2.21s for Retell.
LiveKit reached the expected outcome on 95.12% of calls and Retell on 93.88%. LiveKit is ahead on task completion.
Both ran the same Appointment and Medicare agents through the same 82 caller scenarios, 3 times each, with the same evaluators and mock tools. Only the platform and its speech and model components changed.