Left is faster. Higher reads more hard parts right.
Gemini 3.8 Flash-Lite is better on accuracy and price. Smallest Lightning v3.1 is better on non-streaming latency, streaming latency and naturalness.
Last updated Methodology by Dileep Chagam
Measure by measure, the same sentences, the same place.
An estimate: speech-to-text transcribers scored it, not people.
The same sentence, read by each voice.
Smallest Lightning v3.1. Gemini 3.8 Flash-Lite: 729 ms. Smallest Lightning v3.1: 357 ms.
Smallest Lightning v3.1. Gemini 3.8 Flash-Lite: 729 ms. Smallest Lightning v3.1: 357 ms.
Smallest Lightning v3.1. Gemini 3.8 Flash-Lite: Can't stream. Smallest Lightning v3.1: 363 ms.
Neither has a figure. Gemini 3.8 Flash-Lite: No stop message. Smallest Lightning v3.1: No stop message.
Gemini 3.8 Flash-Lite. Gemini 3.8 Flash-Lite: 88.6%. Smallest Lightning v3.1: 81.3%.
Gemini 3.8 Flash-Lite. Gemini 3.8 Flash-Lite: $19.03. Smallest Lightning v3.1: $19.50.