Skip to main content

Guidance for Contextual Intelligence Advertising Using Generative AI on AWS

Overview

This Guidance shows how to use generative AI to derive contextual insights from multimedia assets and identify relevant audience segments for targeted advertising placements. By analyzing video, audio, and text, you can identify the most relevant audience segments and deliver personalized advertising experiences. Moreover, the use of multimodal large language models (LLMs) facilitates the extraction of insights from both visual and transcript components so you can align your media with the right advertising opportunities and monetize content more effectively.

How it works

These technical details feature an architecture diagram to illustrate how to effectively use this solution. The architecture diagram shows the key components and their interactions, providing an overview of the architecture's structure and functionality step-by-step.

Well-Architected Pillars

The architecture diagram above is an example of a Solution created with Well-Architected best practices in mind. To be fully Well-Architected, you should follow as many Well-Architected best practices as possible.

The Amazon CloudWatch logging service provides valuable insights into API calls across various AWS services, enabling the identification of errors and the subsequent troubleshooting of issues. Furthermore, the integration of EventBridge and Step Functions streamlines the discovery and processing of events, negating the need to maintain a dedicated event bus infrastructure. Additionally, the Step Functions console facilitates the visualization of workflow executions, including the input and output of each step, allowing you to troubleshoot challenges and pinpoint performance gaps.

Read the Operational Excellence whitepaper

CloudFront, the content delivery network service, helps ensure the protection of served content against Distributed Denial of Service (DDoS) attacks while also providing encryption for the transmitted traffic. Notably, CloudFront offers built-in DDoS protection at no additional cost to users. Furthermore, by creating least privilege access policies, you can authorize access to specific Amazon S3 buckets and control which systems have access to the contextual metadata. Complementing these measures, AWS Identity and Access Management (IAM) enforces the principle of least privilege, restricting access to the required resources based on the specific roles assigned to users and applications.

Read the Security whitepaper

The services outlined in this Guidance are all Regional AWS offerings, inherently providing built-in resilience against Availability Zone failures. The architecture's design uses the loosely coupled nature of EventBridge and Lambda, enabling the parallel execution of multiple contextual insights jobs without mutual impact. Furthermore, Lambda employs provisioned concurrency to support rate limiting, thereby managing service quotas and transactions per second for downstream systems. Complementing these measures, Step Functions facilitate retries and throttling of requests for the extraction of contextual insights and the execution of media preparation workflows.

Read the Reliability whitepaper

Lambda, Step Functions, and EventBridge are designed to accommodate the performance requirements for a diverse range of use cases pertaining to the extraction of contextual insights. These services can be used to execute batch jobs for processing large volumes of media assets stored in Amazon S3 buckets as well as to process individual media assets. These services support consistent performance, provided the transactions per second remain within the established AWS service quotas. Complementing these capabilities, CloudFront delivers low-latency content distribution to end-user devices.

Read the Performance Efficiency whitepaper

Lambda, the serverless compute service, is responsible for processing events triggered by the availability of new Amazon S3 objects or the execution of workflows. Furthermore, the Amazon DynamoDB Standard Infrequent Access (DynamoDB Standard-IA) storage tier enables cost reductions of up to 60% for the contextual metadata associated with media assets that are infrequently accessed by end-users. Additionally, the Amazon S3 Intelligent Tiering storage class automatically migrates Amazon S3 objects to less frequently accessed tiers based on observed access patterns.

Read the Cost Optimization whitepaper

Lambda, Amazon Bedrock, and DynamoDB are designed to optimize resource utilization and dynamically scale to accommodate fluctuations in the volume of media assets and advertising requests. This inherent scalability and efficient resource management help minimize the environmental impact by reducing unnecessary resource consumption and energy usage. The serverless nature of these services also eliminates the need for dedicated infrastructure management, further enhancing the overall sustainability of this Guidance.

Read the Sustainability whitepaper

Disclaimer

The sample code; software libraries; command line tools; proofs of concept; templates; or other related technology (including any of the foregoing that are provided by our personnel) is provided to you as AWS Content under the AWS Customer Agreement, or the relevant written agreement between you and AWS (whichever applies). You should not use this AWS Content in your production accounts, or on production or other critical data. You are responsible for testing, securing, and optimizing the AWS Content, such as sample code, as appropriate for production grade use based on your specific quality control practices and standards. Deploying AWS Content may incur AWS charges for creating or using AWS chargeable resources, such as running Amazon EC2 instances or using Amazon S3 storage.