Amazon Transcribe is a speech foundation model-powered automatic speech recognition (ASR) service that supports over 100 languages. Transcribe’s features enable you to ingest audio input, produce easy to read and review transcripts, improve accuracy with customization, and filter content to ensure customer privacy.
Transcribe is designed to process live and recorded audio or video input to provide high quality transcriptions for search and analysis. We also offer separate APIs that uniquely understand customer calls (Amazon Transcribe Call Analytics) and medical conversations (Amazon Transcribe Medical).
Streaming & batch transcription
You can process your existing audio recordings or stream the audio for real-time transcription. Using a secure connection, you can send a live audio stream to the service, and receive a stream of text in response.
Domain specific models
Select a model that is tuned to telephone calls or multimedia video content. For example, Transcribe adapts to low-fidelity phone audio common in contact centers.
Automatic language identification
With Amazon Transcribe, you can automatically identify the dominant language in an audio file and generate transcriptions. This is useful when your media library contains audio files in different languages. You can also use this feature for media content classification and verify that the main spoken language in your videos and podcasts is correctly labeled.
Easy to read transcripts
Amazon Transcribe enables you produce accurate transcripts that are easy to read, review, and integrate into your specific applications. We work to make the output ready for downstream activities such as call transcript analysis, subtitling, and content search.
Punctuation & number normalization
Amazon Transcribe automatically adds punctuation and number formatting, so that the output closely matches the quality of manual transcription at a fraction of the time and expense. Numbers are also transcribed into digits or “normal form” instead of words.
Amazon Transcribe returns a timestamp for each word, so that you can easily find a word or phrase in the original recording or add subtitles to video.
Recognize multiple speakers
Speaker changes are automatically recognized and attributed in the text to capture scenarios like telephone calls, meetings, and television shows accurately. To learn more about speaker identification.
Contact centers can submit a single audio file to Amazon Transcribe, and the service will identify produce a single transcript annotated by channel labels automatically.
Customize your output
Accuracy is critical and we provide you many options to customize transcripts to your specific business needs and vernacular. Transcribe also provides up to 10 alternative transcriptions for each sentence, so you can quickly choose the best option that applies to your content and domain. This is useful for human in-the-loop subtitling workflows.
With custom vocabulary, you can add new words to the base vocabulary to generate more accurate transcriptions for domain-specific words and phrases like product names, technical terminology, or names of individuals.
Custom language models
When needed, you can build and train your own custom language model (CLM) for your use case and domain by submitting a corpus of text data to Amazon Transcribe. CLM is a suitable feature for enhancing speech recognition accuracy with your own data.
User safety & privacy features
Ensuring customer privacy and safety is critical. When needed, Transcribe enables you to mask or remove words that are sensitive or unsuitable for your audience from transcription results.
You can specify a list of words to remove from transcripts with vocabulary filtering. For example, you can specify a list of profane or offensive words and Amazon Transcribe removes them from transcripts automatically.
Automatic content redaction / PII redaction
When instructed, Amazon Transcribe can help customers identify and redact sensitive personally identifiable information (PII) from the supported language transcripts. This allows contact centers to easily review and share the transcripts for customer experience insight and agent training.
Secure data at rest using Amazon S3 key (SSE-S3) or specify your own AWS Key Management Service key. Amazon Transcribe uses TLS (Transport Layer Security) 1.2, a cryptographic protocol that enables authenticated connections and secure data transport over the internet via HTTP, with AWS certificates to encrypt data in transit. This includes streaming transcriptions.
Toxic audio content detection
Amazon Transcribe Toxicity Detection uses Machine Learning to keep audio conversations civil and constructive to encourage a safe and inclusive online environment. Toxic audio content is flagged into one of several categories for human moderators to easily identify and take appropriate action.
Amazon Transcribe Call Analytics
Extract conversation insights such as call sentiment and speech loudness to improve agent productivity and customer experience with Amazon Transcribe Call Analytics.
Improve productivity in contact centers with generative AI-powered call summarization
Automatically generate call summaries to help agents focus on providing excellent customer experiences and increase productivity by reducing after-call manual summarization. This capability summarizes an interaction with a caller, capturing key components such as the reason for the call, steps taken to resolve issue, and next steps. Contact center supervisors can review call summaries to quickly understand the context of an interaction without reading the whole transcript while investigating caller issues.
Extract detailed call analytics & conversation insights
Using the power of machine learning, you can quickly apply speech-to-text and natural language processing capabilities to uncover valuable conversation insights. You can then integrate insights such as customer and agent sentiment, detected issues, and speech characteristics like non-talk time, interruptions, and talk-speed into your inbound and outbound call analytics applications. This can help your supervisors more readily identify potential customer issues, agent coaching opportunities, and call trends.
Improve compliance & monitoring with automated call categorization
Monitor your calls at scale to track compliance with company policies or regulatory requirements. Build and train your own custom categories based on your specified criteria (e.g. words/phrases or conversation characteristics). For example, you can setup category labels to see what percentage of calls are upsells or account cancellation.
Produce rich call transcripts
Give your agents access to the conversation details from past interactions. The turn-by-turn transcripts provide insights such as customer sentiment, detected issues and interruptions.
Protect sensitive customer data
Conversations often contain sensitive customer data such as names, addresses, credit card numbers, and social security numbers. Transcribe Call Analytics helps customers identify and redact this information from both the audio and text.
Contact center integrations
Genesys Cloud CX
Genesys Cloud CX is a cloud contact center solution that unifies customers and agent experiences across multiple channels such as phone, text and chat. You can stream your call audio to Amazon Transcribe from the Genesys Cloud environment to improve agent productivity and extract customer interaction insights. Please refer to Genesys Cloud AudioHook integration for more information. In addition, start analyzing yourGenesys Cloud calls with the AWS Live Call Analytics solution.
Amazon Chime SDK
The Amazon Chime SDK is a set of real-time communications components that developers can use to quickly add audio calling, video calling, and screen sharing capabilities to their own web, mobile or telephony applications.
Amazon Chime Voice Connector
Amazon Chime Voice Conector lets you easily integrate with SIP-based contact centers to generate live, user attributed transcripts with Amazon Transcribe. Please refer to the Amazon Chime Voice Connector documentation for more information.
Amazon Transcribe Medical
Easily transcribe your medical conversations with Transcribe Medical, a HIPAA-eligible automatic speech recognition (ASR) service.
Accurately transcribe single-speaker audio commonly found in medical dictation use cases. Learn more »
Accurately transcribe multi-speaker conversational audio consisting of clinicians and/or patients alike. Learn more »
Transcribe speech to text across a diverse range of medical specialties. Learn more »
Transcribe recorded medical audio files at scale with high concurrency. Learn more »
Transcribe audio streams in near real time via either WebSocket Secure or HTTP/2 protocols. Learn more »
Boost transcription accuracy by using custom vocabulary for potentially out-of-lexicon terminology. Learn more »
Concurrently transcribe multi-channel audio at no extra charge. Get one final coherent transcript. Learn more »
Separate speech from different speakers within any mono-channel audio. Learn more »