CekuraBench

Smallest Lightning v3.1vsMAI-Voice-2.1-Flash

Smallest Lightning v3.1MAI-Voice-2.1-Flash
Compare

Speed and accuracy

Left is faster. Higher reads more hard parts right.

Fast and accurate60%70%80%90%100%00.5s1s1.5s2sTime until the caller hears the voice
  • Smallest Lightning v3.1357 ms · 81.3%
  • MAI-Voice-2.1-Flash289 ms · 78.3%

Smallest Lightning v3.1 is better on streaming latency, accuracy and naturalness. MAI-Voice-2.1-Flash is better on non-streaming latency and price.

Last updated Methodology by Dileep Chagam

Which is better at what

Measure by measure, the same sentences, the same place.

MeasureSmallest Lightning v3.1MAI-Voice-2.1-Flash
  • Non-streaming latency (median)MAI-Voice-2.1-Flash is better357 ms289 ms
  • Streaming latency (median)Smallest Lightning v3.1 is better363 msCan't stream
  • Extra audio after a stopNo stop messageNo stop message
  • Hard parts read rightSmallest Lightning v3.1 is better81.3%78.3%
  • Naturalness (1 to 5)Smallest Lightning v3.1 is better4.494.32
  • Price per 1M charactersMAI-Voice-2.1-Flash is better$19.50$15.00
Hard parts read rightSmallest Lightning v3.1MAI-Voice-2.1-Flash
  • Numbers and shorthand7 a.m. · 20% · 36°F · approx.78%79%
  • Codes and addressesSAVE20 · help@north-clinic.org · 1-800-555-019981%67%
  • Read from contextSt. Mary's on Main St. · Dr. Okafor75%75%
  • Medical termslevothyroxine · gastroenterology97%92%

An estimate: speech-to-text transcribers scored it, not people.

Hear both

The same sentence, read by each voice.

19 sentences, the same for both
  1. 01A greetingThanks for calling Cedar Valley Family Practice, this is Riley. How can I help you today?
  2. 02MoneyYour current balance is $1,347.09.
  3. 03A dateThe order was placed on 2026-03-14 and shipped two days later.
  4. 04Tracking codeThe tracking number is 1Z 7A4 X29 0341 8867.
  5. 05Email addressI have m.rivera88@example.org, is that still current?
  6. 06An Irish nameSiobhan Ó Briain called about the invoice.

How each ranks among all 26

MeasureSmallest Lightning v3.1MAI-Voice-2.1-Flash
  • Non-streaming latency (median)17 of 2612 of 26
  • Streaming latency (median)16 of 18n/a
  • Extra audio after a stopn/an/a
  • Hard parts read right14 of 2618 of 26
  • Naturalness (1 to 5)4 of 2622 of 26
  • Price per 1M characters7 of 252 of 25

Related comparisons

Smallest Lightning v3.1 vs MAI-Voice-2.1-Flash FAQ

  • MAI-Voice-2.1-Flash. Smallest Lightning v3.1: 357 ms. MAI-Voice-2.1-Flash: 289 ms.

  • Smallest Lightning v3.1. Smallest Lightning v3.1: 363 ms. MAI-Voice-2.1-Flash: Can't stream.

  • Neither has a figure. Smallest Lightning v3.1: No stop message. MAI-Voice-2.1-Flash: No stop message.

  • Smallest Lightning v3.1. Smallest Lightning v3.1: 81.3%. MAI-Voice-2.1-Flash: 78.3%.

  • MAI-Voice-2.1-Flash. Smallest Lightning v3.1: $19.50. MAI-Voice-2.1-Flash: $15.00.