What is Amazon Rekognition Video?

Amazon Rekognition Video is a deep learning powered video analysis service that detects activities; understands the movement of people in frame; and recognizes people, objects, celebrities, and inappropriate content from your video stored in Amazon S3. Results are paired with time stamps so that you can easily create an index to facilitate highly detailed video search. For people and faces, Rekognition Video also returns the bounding box coordinates, which is the specific location of the person or face in the frame.

Amazon Rekognition Video can also monitor a live stream that you create from Amazon Kinesis Video Steams to detect and recognize faces from face data that you provide.

Key features

Real-time Analysis of Streaming Video

Amazon Rekognition Video can analyze your live video streams in real time to detect and recognize faces. By providing a stream from Amazon Kinesis Video Streams as an input to Rekognition Video, you can perform facial recognition against collections of up to tens of millions of faces that you provide with very low latency. For batch processing use cases, Amazon Rekognition Video can also analyze previously recorded video data stored in Amazon S3.

Person Identification and Pathing

With Amazon Rekognition Video, you can capture the position of each person in a video. The TrackPersons API detects people and how they move even when the camera is in motion. It can also attribute motion to the same person even when their face is blocked or they move in and out of the frame. The TrackPersons API returns time segments and confidence scores.

Face Recognition

Amazon Rekognition Video allows you to perform real time face searches against collections of tens of millions of faces that you provide. Using the CreateCollection API, you can easily create a face collection from your images with vectors representing facial features. Rekognition then searches the provided face collection for visually similar faces throughout your video. This can enable use cases such as access control or automatic identification of friends in photo sharing apps.

Facial Analysis

With Rekognition Video, you can locate faces that appear in a video and analyze their attributes, such as whether the face is smiling, the eyes are open, and emotions. Using the DetectFaces API, Rekognition Video will return the landmark points: left eye, right eye, nose, left corner of the mouth, and right corner of the mouth. This position, along with the timestamps, can be used to easily track user sentiment over time and it enables you to build your own filtering applications with features such as automatic face frames, highlights, or crops.

Objects, Scenes and Activities Detection

Rekognition Video enables you to automatically identify thousands of objects such as vehicles or pets, scenes like a city, beach, or wedding; and activities such as delivering a package or dancing. Rekognition Video relies on motion in the video to accurately identify complex activities, such as “blowing out a candle” or “extinguishing fire”.

Inappropriate Video Detection

Rekognition Video enables you to detect explicit and suggestive content so that you can filter videos based on your applications requirements. Rekognition provides a range of different moderation levels, from explicit to suggestive, so you can apply the correct moderation level for you audience.

Celebrity Recognition

With Rekognition Video, you can detect and recognize when and where well known persons appear in a video. The time-coded output includes the name and unique id of the celebrity, and URLs pointing to related content for the celebrity, for example, the celebrity's IMDB link. This allows you to index and search digital video libraries for use cases related to your specific marketing and media needs.

Administration via API, Console, or Command Line

Amazon Rekognition can be accessed using the Amazon Rekognition API, AWS Management Console, and the AWS command-line interface (CLI). The console, API, and CLI provide the ability to use the Rekognition APIs to detect labels, analyze faces, compare faces, and find a face. AWS Lambda has blueprints for Rekognition that make it easy to initiate image analysis based on events in your AWS data stores such as Amazon S3 and Amazon DynamoDB.

Administrative Security

Amazon Rekognition is integrated with AWS Identity and Access Management (IAM). IAM policies can be used to control access to the Amazon Rekognition API as well as manage resource-level permissions for your account.

API Summary

For a summary of the Rekognition API, please see the API Reference in the Rekognition documentation.

Learn more about Amazon Rekognition pricing

Visit the pricing page
Ready to build?
Get started with AWS Rekognition
Have more questions?
Contact us