Amazon Web Services (AWS) offers powerful and cost-effective services to help customers process, analyze and extract meaningful data from their audio, image, and video files. Customers who want to obtain a broader understanding of their media libraries can use these services to develop solutions that analyze and extract valuable metadata from their media files. However, developing these solutions can sometimes require extensive knowledge of deep-learning algorithms and artificial intelligence (AI) services.

To help customers more easily analyze and understand their media files, AWS offers the Media Analysis Solution, a reference implementation that uses serverless, AWS-native AI services to automatically extract valuable metadata from media files. The solution also includes a web-based user interface that customers can use to upload and search their image, audio, and video libraries.

This webpage provides best practices and guidance to consider when extracting metadata from media files, and introduces an AWS solution that combines Amazon Rekognition, AWS Elemental MediaConvert, Amazon Transcribe, and Amazon Comprehend to quickly and seamlessly extract key details from media files.

For more information about the Media Analysis Solution

Contact AWS

Get started with the AWS Media Analysis Solution with this step-by-step tutorial

Learn More

When analyzing media files in the cloud, there are some universal best practices to follow that will help you build effective media analysis solutions. Consider the following best practices as part of any media processing solution:  

  • Leverage managed AI services to significantly reduce the time and effort required to process and extract meaningful information from your media files. AWS services like Amazon Rekognition, Amazon Transcribe, and Amazon Comprehend provide insights into images, videos, audio files, and transcripts without the need to develop extensive knowledge in deep-learning algorithms or manage underlying infrastructures.
  • Choose a solution that can be customized and extended to extract more metadata using new managed AI services or custom-built machine learning models.
  • Clearly define an end-to-end workflow for processing and analyzing your media files, with a well-understood design for redundancy and failure.

This solution enables customers to quickly and seamlessly extract key details from their media files in their AWS accounts without machine learning expertise. The solution also includes a web-based user interface that customers can use to upload and search their image, audio, and video files.


1. When new media files are uploaded to the Amazon Simple Storage Service (Amazon S3) media analysis bucket, an AWS Lambda function invokes the AWS Step Functions state machine. Metadata is extracted by Amazon Rekognition, Amazon Transcribe, and Amazon Comprehend.

2. When an MP4 video file is uploaded, AWS Elemental MediaConvert extracts audio for the analysis by Amazon Transcribe and Amazon Comprehend.

3. Another Lambda function retrieves, processes, and stores the results in the Amazon S3 bucket and an Amazon Elasticsearch cluster. The resulting metadata can be authenticated, securely searched, and retrieved using Amazon Cognito and an Amazon API Gateway RESTful API.  

4. The solution also deploys a static Amazon S3 web interface that customers can use to immediately start uploading, analyzing, and interacting with small media files. Amazon CloudFront is used to restrict access to the solution's website bucket contents.

Deploy Solution
Implementation Guide

What you'll accomplish:

Deploy the Media Analysis Solution using AWS CloudFormation. The AWS CloudFormation templates automatically launch and configure the necessary components.

           Extract metadata from your media files, and store the resulting metadata for future search and analysis.

What you'll need before starting:

An AWS account: You will need an AWS account to begin provisioning resources. Sign up for AWS.

Skill level: This solution is intended for IT infrastructure and developers who have practical experience working with web application and architecting on the AWS cloud.

Q: Are there any limitations in the Media Analysis Solution?

Yes. Currently, media files uploaded through the web interface are limited to 100MB. However, you can upload larger files to Amazon S3 using your own tools. Additionally, the audio analysis state machine will not process audio files greater than 1024MB. For more information, see the implementation guide.

Q: Can I customize the solution for my specific use case?

The Media Analysis Solution includes a default set of features, but you can extend and customize the solution to include additional features and functionalities for your specific use case. For more information, see the implementation guide.

Q: Can I deploy the solution in any AWS Region?

The Media Analysis Solution must be deployed in an AWS Region where Amazon Rekognition, Amazon Comprehend, and Amazon Transcribe are currently available.

Need more resources to get started with AWS? Visit the Getting Started Resource Center to find tutorials, projects and videos to get started with AWS.

Tell us what you think