What does this AWS Solutions Implementation do?
This solution automatically receives new AWS Data Exchange dataset revisions and initiates downstream processing when new data becomes available from a data provider.
This solution only receives dataset revisions from one data provider at a time. If you want to receive data from multiple providers, deploy the solution multiple times. Data providers can use the AWS Data Exchange Publisher Coordinator solution to automate publishing of their AWS Data Exchange dataset revisions.
AWS Solutions Implementation overview
The diagram below presents the architecture you can automatically deploy using the solution's implementation guide and accompanying AWS CloudFormation template.
AWS Data Exchange Subscriber Coordinator Solutions Implementation architecture
The AWS CloudFormation template deploys all of the serverless infrastructure necessary to coordinate the download steps required for AWS Data Exchange. This includes the following:
- Three AWS Lambda functions to start an AWS Data Exchange job, periodically check its progress, and get the job for the downstream hook function.
- An AWS Step Functions to orchestrate the AWS functions that download new revisions to the AWS Data Exchange dataset.
- An Amazon CloudWatch Events rule to identify the publishing of any new revisions by publishers.
- AWS Identity and Access Management (IAM) roles that provide an AWS Step Functions and three associated Lambda functions with permissions to initiate their API calls.
AWS Data Exchange Subscriber Coordinator
Version 1.0.0
Released: 12/2020
Author: AWS
Estimated deployment time: 5 min
Implementation resources
Download implementation guideFeatures
End-to-end automation
Visualization
Reliability
Browse our library of AWS Solutions Implementations to get answers to common architectural problems.
Find AWS certified consulting and technology partners to help you get started.
Browse our portfolio of Consulting Offers to get AWS-vetted help with solution deployment.