2_header-icon_solutionspace
rule

Qubole Data Service (QDS) is integrated with a data lake foundation on Amazon Web Services (AWS) to provide a fully functional data lake, with data submission, ingest processing, aggregation, analysis, and searching capabilities. QDS is a cloud-native, autonomous data platform for analyzing and processing data. It self-manages and constantly analyzes and learns about the platform’s usage through a combination of heuristics and machine learning, and provides insights and recommendations to optimize reliability, performance, and costs.

This solution is supported by an AWS Quick Start and optional consulting offers crafted by AWS Partner Network (APN) Competency Partners.

 

  • Learn

    logos-datalake-qubole-s3-lambda-220x220-solutionspace

    This data lake solution combines Qubole Data Service with the AWS data lake foundation to deliver a fully functional data lake.  

    Qubole Data Service is a comprehensive big data platform that self-manages, self-optimizes and learns from your usage, allowing the data team to focus on business outcomes rather than on managing the platform.

    Alerts, Insights, and Recommendations (AIR)
    With AIR, QDS constantly analyzes metadata about infrastructure (cluster, nodes, CPU, memory, disk), platforms (data models and compute engines), and applications (SQL, reporting, ETL, machine learning), helping you better understand performance, usage patterns, and cloud spend.

    Qubole Cloud Agents
    AWS-optimized Qubole Cloud Agents minimize need for manual operations in the setup, scaling of clusters, and intelligent use of Spot instances

    • Workload Aware Auto Scaling Agent: Predictively manages cluster compute and storage size in real time, reducing compute spend by as much as 33%
    • Spot Shopper Agent: Shops for compute resources with optimal combination of price, performance, and availability, reducing the compute spend by as much as 50%
    • Data Caching Agent: Improves performance between cloud object store and compute

    AWS Big Data Competency Partners deliver data lake implementations, integrate relevant AWS services, and accelerate the ramp-up of new users. This solution was developed in collaboration with 47Lining, a REAN Cloud Company, and an APN Advanced Consulting Partner and AWS Big Data Competency Partner.

    Discover value from this solution by gaining access to AWS credits to support a Proof-of-Concept (POC) and consulting offers from AWS Competency Partners that include AWS co-investments. Click below for more information.

  • Launch

    aws-quickstart-graphic

    You can build the Qubole on data lake foundation in about 50 minutes, by following these steps:

    1. Sign up for an AWS account, if you don't already have one, at https://aws.amazon.com.
    2. Create a Qubole account.
    3. Obtain a Qubole ID token, AWS account ID, and external ID.
    4. Launch the Quick Start into a new VPC, if you want to build a new AWS infrastructure.
      —or—
      Launch the Quick Start into an existing VPC, if you already have your AWS environment set up.
      Each deployment takes about 50 minutes.
    5. Finish the Qubole configuration.
    6. Test the deployment.


    The Quick Start includes parameters that you can customize. For example, you can configure your network or customize the settings for Qubole, Hadoop, Spark, and AWS services.

    For complete details, see the Quick Start deployment guide.

    Discover value from this solution by gaining access to AWS credits to support a Proof-of-Concept (POC) and consulting offers from AWS Competency Partners that include AWS co-investments. Click below for more information.

    Get started
  • Work with an APN Partner

    aws_competency_solutionspace

    APN Partners with Big Data Competency designation offer consulting services to help you quickly discover value from this data lake foundation solution. Follow these links to find more about these APN Partners and their consulting offers, and to request more information or support.

    Learn more about the AWS Competency Program »

    AlienVault

    Launch your Qubole on Data Lake Foundation in the AWS Cloud with a Proof of Concept (PoC) leveraging a reference architecture, Qubole Data Service (QDS), AWS services, and 47Lining experts.

    See consulting offer

    Discover value from this solution by gaining access to AWS credits to support a Proof-of-Concept (POC) and consulting offers from AWS Competency Partners that include AWS co-investments. Click below for more information.

    Get started
  • Purchase

    AWS-Logo_Full-Color_100x60

    You are responsible for the cost of the AWS services used while running this Quick Start reference deployment. The AWS CloudFormation templates for this Quick Start include configuration parameters that you can customize. Some of these settings, such as instance type, will affect the cost of deployment.

    See the pricing pages for each AWS service you will be using for cost estimates.

    aws-marketplace-200

    The Quick Start deploys QDS Business Edition, which allows you to consume up to 10,000 Qubole Compute Usage Hours (QCUH) per month at no cost. However, you are responsible for the cost of AWS resources that Qubole manages on your behalf. To learn more about QDS Business Edition, see the Qubole FAQ.

    After you deploy the Quick Start, you can upgrade to QDS Enterprise Edition and use Qubole Cloud Agents, which provide actionable Alerts, Insights, and Recommendations (AIR) to optimize reliability, performance, and costs.

    To upgrade your license to QDS Enterprise Edition, see the Qubole listing on AWS Marketplace or visit the Qubole product website.

    Learn more about the Qubole QDS AWS Marketplace listing »

    Discover value from this solution by gaining access to AWS credits to support a Proof-of-Concept (POC) and consulting offers from AWS Competency Partners that include AWS co-investments. Click below for more information.

    Get started
  • Get help

    icon-aws-credits-solutionspace

    AWS Credits

    icon-aws-talk-solutionspace

    Other AWS-related Inquiries

    Discover value from this solution by gaining access to AWS credits to support a Proof-of-Concept (POC) and consulting offers from AWS Competency Partners that include AWS co-investments. Click below for more information.