Qubole on Data Lake Foundation

Qubole Data Service (QDS) for business insights through machine learning (ML) and artificial intelligence (AI)

Qubole Data Service (QDS) is integrated with a data lake foundation on Amazon Web Services (AWS) to provide a fully functional data lake, with data submission, ingest processing, aggregation, analysis, and searching capabilities. QDS is a cloud-native, autonomous data platform for analyzing and processing data. It self-manages and constantly analyzes and learns about the platform’s usage through a combination of heuristics and machine learning, and provides insights and recommendations to optimize reliability, performance, and costs.

This solution is supported by an AWS Quick Start and optional consulting offers crafted by AWS Partner Network (APN) Big Data Competency Partners.

  • Learn
  • Launch
  • Work with an APN Partner
  • Purchase
  • Get help
  • Learn
  • Learn

    Solution highlights:

    This data lake solution combines Qubole Data Service with the AWS data lake foundation to deliver a fully functional data lake.

    Qubole Data Service is a comprehensive big data platform that self-manages, self-optimizes and learns from your usage, allowing the data team to focus on business outcomes rather than on managing the platform.

    Alerts, Insights, and Recommendations (AIR)
    With AIR, QDS constantly analyzes metadata about infrastructure (cluster, nodes, CPU, memory, disk), platforms (data models and compute engines), and applications (SQL, reporting, ETL, machine learning), helping you better understand performance, usage patterns, and cloud spend.

    Qubole Cloud Agents
    AWS-optimized Qubole Cloud Agents minimize need for manual operations in the setup, scaling of clusters, and intelligent use of Amazon EC2 Spot Instances.

    • Workload Aware Auto Scaling Agent: Predictively manages cluster compute and storage size in real time, reducing compute spend by as much as 33%
    • Spot Shopper Agent: Shops for compute resources with optimal combination of price, performance, and availability, reducing the compute spend by as much as 50%
    • Data Caching Agent: Improves performance between cloud object store and compute
    qubole-data service-arch-diagram

    AWS Big Data Competency Partners deliver data lake implementations, integrate relevant AWS services, and accelerate the ramp-up of new users. This solution was developed in collaboration with 47Lining, a REAN Cloud Company, and an APN Advanced Consulting Partner and AWS Big Data Competency Partner.

    Discover value from this solution by gaining access to AWS credits to support a Proof-of-Concept (POC) and consulting offers from AWS Competency Partners that include AWS co-investments. Click below for more information.

  • Launch
  • Launch

    You can launch the Qubole on Data Lake Foundation solution utilizing an AWS Quick Start. AWS CloudFormation templates make deployment quick and simple—and templates can be customized to meet your specific requirements.

    Discover value from this solution by gaining access to AWS credits to support a Proof-of-Concept (POC) and consulting offers from AWS Competency Partners that include AWS co-investments. Click below for more information.

  • Work with an APN Partner
  • Work with an APN Partner

    APN Partners with Big Data Competency designation offer consulting services to help you quickly discover value from this data lake foundation solution. Follow these links to find more about these APN Partners and their consulting offers, and to request more information or support.

    Learn more about the AWS Competency Program »

    aws_competency_solutionspace
    47Lining-logo

    NORTH AMERICA

    Enable your data science team in weeks, not months

    Launch your Qubole on Data Lake Foundation on AWS with a Proof of Concept (PoC) leveraging a reference architecture, Qubole Data Service (QDS), AWS services, and 47Lining experts.

           

  • Purchase
  • Purchase

    The Quick Start deploys QDS Business Edition, which allows you to consume up to 10,000 Qubole Compute Usage Hours (QCUH) per month at no cost. However, you are responsible for the cost of AWS resources that Qubole manages on your behalf. To learn more about QDS Business Edition, see the Qubole FAQ.

    After you deploy the Quick Start, you can upgrade to QDS Enterprise Edition and use Qubole Cloud Agents, which provide actionable Alerts, Insights, and Recommendations (AIR) to optimize reliability, performance, and costs. To upgrade your license to QDS Enterprise Edition, see the Qubole listing on AWS Marketplace or visit the Qubole product website.

    Learn more about the Qubole QDS AWS Marketplace listing »

    You are responsible for the cost of the AWS services used while running this Quick Start reference deployment. The AWS CloudFormation templates for this Quick Start include configuration parameters that you can customize. Some of these settings, such as instance type, will affect the cost of deployment.

    See the pricing pages for each AWS service you will be using for cost estimates.

  • Get help
  • Get help

    Discover value from this solution by gaining access to AWS credits to support a Proof-of-Concept (POC) and consulting offers from AWS Competency Partners that include AWS co-investments. Click below for more information.

    icon-aws-credits-solutionspace
    AWS Credits
    icon-aws-talk-solutionspace

Learn more about Data Lake solutions

Have more questions?