Left is faster. Higher reads more hard parts right.
Smallest Lightning v3.1 is better on non-streaming latency and streaming latency. Boson Higgs TTS 3 is better on accuracy, naturalness and price.
Last updated Methodology by Dileep Chagam
Measure by measure, the same sentences, the same place.
An estimate: speech-to-text transcribers scored it, not people.
The same sentence, read by each voice.
Smallest Lightning v3.1. Smallest Lightning v3.1: 357 ms. Boson Higgs TTS 3: 472 ms.
Smallest Lightning v3.1. Smallest Lightning v3.1: 357 ms. Boson Higgs TTS 3: 472 ms.
Smallest Lightning v3.1. Smallest Lightning v3.1: 363 ms. Boson Higgs TTS 3: Can't stream.
Neither has a figure. Smallest Lightning v3.1: No stop message. Boson Higgs TTS 3: No stop message.
Boson Higgs TTS 3. Smallest Lightning v3.1: 81.3%. Boson Higgs TTS 3: 88.8%.
Boson Higgs TTS 3. Smallest Lightning v3.1: $19.50. Boson Higgs TTS 3: $15.00.
Cekura runs these simulated calls on your agent and scores every one.