Listing Thumbnail

    Spark Workload Migration to Amazon EMR on EKS by Dedicatted

     Info
    Sold by: Dedicatted 
    For data teams running Apache Spark on self-managed Hadoop, on-premises clusters or another analytics platform with bottlenecks, high cost or a renewal deadline. Dedicatted migrates your Spark workloads to Amazon EMR on EKS: job inventory and compatibility checks, shared Kubernetes capacity for analytics, data and catalog moves to Amazon S3 and the AWS Glue Data Catalog, parallel runs that compare outputs, and cutover by job group.

    Overview

    Who this is for

    Fintech, ad-tech, retail and SaaS companies in Canada, the United States and Europe with hundreds of Spark jobs feeding reports, models or client deliveries. The buyer is the Head of Data, data platform lead or CTO.

    The problem

    Spark estates outgrow their platforms. Clusters sit idle between batches or queue at peaks, upgrades lag, licences and hardware renew on fixed terms, and moving hundreds of jobs feels too risky to schedule.

    What we deliver

    Inventory and compatibility. We inventory jobs, dependencies, schedules and data, check Spark version and library compatibility, and group jobs into migration waves.

    Platform. Amazon EMR on EKS virtual clusters on shared Amazon EKS capacity with Karpenter and Spot, job templates, and data access through the AWS Glue Data Catalog and AWS Lake Formation.

    Migration waves. Jobs and data move wave by wave, run in parallel with the old platform, and outputs are compared before cutover.

    Handover. Runbooks, cost per job baselines and training, with ongoing operation available.

    For running EMR after the migration, see Managed Spark Operations for Amazon EMR by Dedicatted.

    AWS services integrated

    Amazon EMR on EKS, Amazon EKS, Karpenter, Amazon EC2 Spot Instances, Amazon S3, AWS Glue Data Catalog, AWS Lake Formation, Amazon Managed Workflows for Apache Airflow, AWS DataSync and Amazon CloudWatch.

    Outcomes

    • Spark jobs run on shared, autoscaled capacity instead of idle clusters.
    • Outputs are compared with the old platform before each cutover.
    • Data and catalogs live in Amazon S3 and the AWS Glue Data Catalog.
    • Cost per job is known from the first month.

    Evidence

    Dedicatted holds the AWS Service Delivery validation for Amazon EMR and the AWS Migration and Modernization Consulting Competency. We moved a US financial reporting provider's data processing to Amazon EMR on EKS and run the platform under a managed service.

    Where we deliver

    Dedicatted is an AWS Premier Tier Services Partner and AWS Managed Service Provider headquartered in Toronto and Montreal, Canada. It is the first Canadian partner to hold both AWS AI Competencies (Generative AI and Agentic AI) and the first and only Canadian AWS Partner to hold the AWS Digital Sovereignty Services Competency. We deliver across Canada, the United States and Europe, in English and French, and support Canadian data residency in the AWS Canada (Central) and Canada West (Calgary) Regions.

    AWS infrastructure charges

    AWS bills you for EMR on EKS usage, EKS clusters and EC2 or Spot capacity, S3, Glue, Lake Formation, Amazon MWAA, DataSync and CloudWatch. During parallel runs both platforms incur charges until cutover. We work through IAM roles you create.

    Highlights

    • Spark workloads moved to Amazon EMR on EKS: job inventory and compatibility checks, virtual clusters on shared Amazon EKS capacity with Karpenter and Spot, and data and catalogs in Amazon S3 and the AWS Glue Data Catalog.
    • Migration waves with proof: jobs run in parallel with the old platform and outputs are compared before each cutover, with runbooks and cost per job baselines at handover.
    • From an AWS Premier Tier Services Partner with the Amazon EMR Service Delivery validation, which moved a US financial reporting provider's processing to Amazon EMR on EKS and runs it under a managed service.

    Details

    Delivery method

    Deployed on AWS
    New

    Introducing multi-product solutions

    You can now purchase comprehensive solutions tailored to use cases and industries.

    Multi-product solutions

    Features and programs

    Trust center

    Trust center
    Access real-time vendor security and compliance information through their Trust Center powered by Drata or Vanta. Review certifications and security standards before purchase.

    Pricing

    Custom pricing options

    Pricing is based on your specific requirements and eligibility. To get a custom quote for your needs, request a private offer.

    How can we make this page better?

    Tell us how we can improve this page, or report an issue with this product.
    Tell us how we can improve this page, or report an issue with this product.

    Legal

    Content disclaimer

    Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.

    Support

    Vendor support

    Contact

    Before you buy

    • A scoping call confirms the jobs, data, schedules and current platform in scope and any renewal deadline, followed by a written scope and a private offer through AWS Marketplace.

    During delivery

    • A named engagement lead and a shared channel with the engineers doing the work, in English or French.

    Response time

    • Support requests receive a response within two business days.

    After handover

    • Job code, infrastructure as code, runbooks and baselines are yours, and ongoing operation is available under Managed Spark Operations for Amazon EMR by Dedicatted.