reference deployment

Etleap ETL on AWS

An ETL for AWS warehouses and data lakes

Etleap offers an extract, transform, and load (ETL) service for building Amazon Web Services (AWS) data warehouses and data lakes. Using Etleap on the AWS Cloud, you can extract from any source, including databases, applications, files, and event streams. You can also integrate legacy, on-premises sources with no extra effort.

Preview and transform your data using the Etleap interactive data wrangler without writing any code. Transformations run at scale on an auto scaling Amazon EMR cluster, which is included with this Quick Start.

Load data into Amazon Redshift or Amazon Simple Storage Service (Amazon S3) with an AWS Glue data lake for immediate analysis, on-demand access, and long-term data archiving. Model your data with SQL queries for unification and performance. Automatic detection and guided resolution of schema changes and performance issues keep your data repository available and reliable.

Etleap logo

This Quick Start was developed by Etleap in collaboration with AWS. Etleap is an AWS Partner.

AWS Service Catalog administrators can add this architecture to their own catalog.  

  •  What you'll build
  • The Quick Start sets up the following:

    • A virtual private network (VPC) configured with public and private subnets, according to AWS best practices, to provide you with your own virtual network on AWS.*
    • In the public subnets:
      • A managed network address translation (NAT) gateway to allow outbound internet access for resources in the private subnets.*
      • An Amazon Elastic Compute Cloud (Amazon EC2) instance running Etleap.
    • In the private subnets:
      • An Amazon Relational Database Service (Amazon RDS) MySQL database used by Etleap to store metadata.
      • An Amazon EMR cluster used by Etleap to run extractions and transformations.
    • An Amazon S3 bucket used by Etleap to store extracted and transformed data.
    • An AWS Key Management Service (AWS KMS) key in different AWS Regions to encrypt secrets within Etleap.
    • Four AWS Identity and Access Management (IAM) roles.

    * The template that deploys the Quick Start into an existing VPC skips the components marked by asterisks and prompts you for your existing VPC configuration.

  •  How to deploy
  • To deploy Etleap, follow the instructions in the deployment guide. The deployment process takes about 20 minutes and includes these steps:

    1. If you don't already have an AWS account, sign up at, and sign in to your account.
    2. Subscribe to the Amazon Machine Image (AMI) for Etleap ETL. Skip this step if Etleap has provided you with a deployment ID.
    3. Launch the Quick Start, choosing from the following options:
    4. Test the deployment.

    Amazon may share user-deployment information with the AWS Partner that collaborated with AWS on this solution.  

  •  Cost and licenses
  • You are responsible for the cost of the AWS services used while running this Quick Start reference deployment. There is no additional cost for using the Quick Start. 

    The AWS CloudFormation template for this Quick Start includes configuration parameters that you can customize. Some of these settings, such as instance type, affect the cost of deployment. For cost estimates, see the pricing pages for each AWS service you use. Prices are subject to change.

    Tip: After you deploy the Quick Start,  create AWS Cost and Usage Reports to track costs associated with the Quick Start. These reports deliver billing metrics to an Amazon S3 bucket in your account. They provide cost estimates based on usage throughout each month and aggregates the data at the end of the month. For more information about the report, refer to  What are AWS Cost and Usage Reports?

    This Quick Start requires either a subscription to the AMI for Etleap or a license provided by Etleap. An AMI subscription is available from the AWS Marketplace.