Overview
Lightning V3.1 Pro by Smallest AI is a low-latency, production-ready text-to-speech model built for real-time voice agents and high-volume speech generation. It produces natural, expressive speech at a native 44.1 kHz sample rate and supports synchronous HTTP, server-sent events, and WebSocket streaming. The WebSocket path accepts text incrementally and returns audio chunks as they are generated. Additional features include word-level timestamps, pronunciation dictionaries for brand names, acronyms, and technical terms, speech-rate control without pitch distortion, and multiple output formats (PCM, WAV, MP3, u-law) at sample rates from 8 kHz to 44.1 kHz for both telephony and high-fidelity playback. Its streaming pipeline is optimized for voice agents, IVR, contact centers, and other latency-sensitive workloads.
Highlights
- Low-latency text-to-speech for real-time voice agents and live calls (~120 ms time-to-first-byte under concurrent load)
- Multilingual speech synthesis in multiple languages with automatic language detection and code-switching.
- Built for conversational streaming: incremental text input over WebSocket, word-level timestamps, pronunciation dictionaries, and telephony-ready 8 kHz u-law output.
Details
Introducing multi-product solutions
You can now purchase comprehensive solutions tailored to use cases and industries.
Features and programs
Financing for AWS Marketplace purchases
Pricing
Dimension | Description | Cost/host/hour |
|---|---|---|
ml.g6e.2xlarge Inference (Batch) Recommended | Model inference on the ml.g6e.2xlarge instance type, batch mode | $10.00 |
ml.g6e.2xlarge Inference (Real-Time) Recommended | Model inference on the ml.g6e.2xlarge instance type, real-time mode | $10.00 |
ml.g6e.4xlarge Inference (Batch) | Model inference on the ml.g6e.4xlarge instance type, batch mode | $10.00 |
ml.g6e.4xlarge Inference (Real-Time) | Model inference on the ml.g6e.4xlarge instance type, real-time mode | $10.00 |
ml.g6e.8xlarge Inference (Real-Time) | Model inference on the ml.g6e.8xlarge instance type, real-time mode | $10.00 |
ml.g6e.16xlarge Inference (Real-Time) | Model inference on the ml.g6e.16xlarge instance type, real-time mode | $10.00 |
ml.g7e.2xlarge Inference (Real-Time) | Model inference on the ml.g7e.2xlarge instance type, real-time mode | $40.00 |
ml.g7e.4xlarge Inference (Real-Time) | Model inference on the ml.g7e.4xlarge instance type, real-time mode | $40.00 |
ml.g7e.8xlarge Inference (Real-Time) | Model inference on the ml.g7e.8xlarge instance type, real-time mode | $40.00 |
ml.p5.4xlarge Inference (Real-Time) | Model inference on the ml.p5.4xlarge instance type, real-time mode | $35.00 |
Vendor refund policy
N/A
How can we make this page better?
Legal
Vendor terms and conditions
Content disclaimer
Delivery details
Amazon SageMaker model
An Amazon SageMaker model package is a pre-trained machine learning model ready to use without additional training. Use the model package to create a model on Amazon SageMaker for real-time inference or batch processing. Amazon SageMaker is a fully managed platform for building, training, and deploying machine learning models at scale.
Version release notes
- Text to speech Model, English and Hindi
Additional details
Inputs
- Summary
Model input summary application/json. A UTF-8 JSON body with text (required), voice_id, and optional model, language, sample_rate, speed, output_format, and pronunciation_dicts.
The batch link is the synchronous endpoint page. It shows POST https://api.smallest.ai/waves/v1/tts , which takes text and voice_id and returns binary audio. The real-time link is the WebSocket reference for /waves/v1/tts/live. The SSE page says the same URL serves the WebSocket endpoint, accepting a WebSocket upgrade for streaming-text scenarios such as LLM token streams and live captioning. I found the WebSocket page linked from the SSE reference but didn’t open it directly, so click through once before you paste it in. If you want to point at SSE instead, use https://docs.smallest.ai/models/api-reference/text-to-speech/synthesize-speech-sse .
- Input MIME type
- application/json
Support
Vendor support
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.