Sold by: Pipeliner
Free Trial
AWS Free Tier
Pipeliner is an automation tool that delivers ETL code directly to your GitHub repository. It accelerates the development of Data Lakes and enforces data governance.
Overview
Deliver production-grade complex data transformation pipelines and the cloud infrastructure of your choice with Data Pipeliner; a meta-data driven ETL code and infrastructure management tool for modern data engineering teams who like to be in control of their code. Users send mapping specifications to Pipeliner API and receive Pyspark ETL code and infrastructure as code for their data lake tables and transformation jobs. The code is delivered directly to their configured GitHub repository. Currently, Pipeliner supports AWS Glue for ETL pipeliners and Catalog tables, and Cloud Formation for Infrastructure as Code. Pipeliner will automatically check the mapping specification for errors to speed up development and ensure standard governance of metadata. We do not store or log your code or metadata in our services.
Highlights
- Reduce development time of ETL code and infrastructure for Data Lakes.
- Easy maintenance of pipelines with one API call to Pipeliner.
- Ensure high standards across your team with mapping specifications that map exactly to your cloud environments.
New
Introducing multi-product solutions
You can now purchase comprehensive solutions tailored to use cases and industries.
Features and programs
Financing for AWS Marketplace purchases
AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.
Pricing
Free trial
Try this product free according to the free trial terms set by the vendor.
Pricing is based on actual usage, with charges varying according to how much you consume. Subscriptions have no end date and may be canceled any time.
Additional AWS infrastructure costs may apply. Use the AWS Pricing Calculator to estimate your infrastructure costs.
Dimension | Cost/request |
|---|---|
Calls to the Pipeliner API | $4.00 |
Dimensions summary
Pipeliner uses a single usage-based dimension: calls to the Pipeliner API, billed per request. You pay based on how many API calls you make to the Pipeliner engine. Each time you submit a mapping specification to generate ETL and infrastructure code, you make a call. There are no tiers or fixed subscription levels. Your cost scales directly with the number of requests you send. This structure ties your spending to actual usage rather than a flat commitment.
Top-of-mind questions for buyers
A call is one request sent to the Pipeliner engine. When you submit your mapping specification via the CLI to generate ETL and infrastructure code, that submission counts as a request. Validation and configuration commands interact with the engine too. Each request you send adds to your metered usage.
Your cost scales directly with the number of API calls you send. Generating more code means submitting more mapping specifications, which means more requests. There are no tiers or fixed cutoffs. Each additional request adds to your bill. Sending fewer requests lowers your usage-based charges.
Validation uses a separate CLI command that checks your mapping specification without generating code. Both validate and submit commands talk to the Pipeliner engine. Any request that reaches the engine may count toward your metered API calls. For confirmation on which commands meter, contact the vendor.
datapipeliner.io+1
Helpful?
Vendor refund policy
This is a pay as you go service. You will be invoiced based on your usage.
Legal
Vendor terms and conditions
Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA) .
Content disclaimer
Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.
Delivery details
Software as a Service (SaaS)
SaaS delivers cloud-based software applications directly to customers over the internet. You can access these applications through a subscription model. You will pay recurring monthly usage fees through your AWS bill, while AWS handles deployment and infrastructure management, ensuring scalability, reliability, and seamless integration with other AWS services.
Resources
Vendor resources
Support
Vendor support
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.
Similar products
Deliver secure, high-quality software faster with DevOps Pipeline Automation from cloudEQ. This AWS Validated Solution has undergone a rigorous process conducted by AWS to ensure that the software it generates strictly adheres to AWS’s Well-Architected best practices.
Supercharge your APIs beyond standard compression by reducing your data transfer fees, processing and transmission rates by 116x on average, without any refactoring or any loss of information! Currently supports JSON.
Are you currently managing a Redshift data warehouse and looking to supercharge your data ingestion and transformation processes? We have the perfect solution for you.
Hevo is the trusted choice of over 2,500 data teams across over 40 countries to replicate data from all their sources into a cloud data warehouse. Using Hevo, you can set up a data pipeline in just 3 simple steps and replicate data in as little as 5 minutes. Moreover, Hevo's CDC (change data capture) feature ensures that any changes made to data sources are automatically updated in the warehouse. Hevo automates schema management; any changes in the source schema are automatically updated in the destination schema, eliminating the need for manual schema management. Hevo also includes built-in pre-load and post-load transformation capabilities. The pre-load transformation formats and cleans the data on the fly, while the post-load transformation allows you to run SQL-based transformations and dbt Core models in sync with your pipelines on the data warehouse.
Customer reviews
No customer reviews yet
Be the first to review this product . We've partnered with PeerSpot to gather customer feedback. You can share your experience by writing or recording a review, or scheduling a call with a PeerSpot analyst.