reference deployment

Axomo on AWS

Use machine learning and analytics to optimize cluster and license usage

This Quick Start automatically deploys Axomo on the Amazon Web Services (AWS) Cloud. It’s intended for users who manage IBM Spectrum LSF RTM, which is an operations dashboard for IBM Spectrum LSF environments that monitors, reports on, and manages load sharing facility (LSF) workloads.

Axomo on AWS is available as a cost-effective, secure, AWS serverless architecture that includes AWS Glue, Amazon Simple Storage Service (Amazon S3), Amazon SageMaker, and Amazon Athena.

Axomo helps you improve the efficiency of resource allocation and mitigate opportunity cost from productivity loss. Via a pre-built dashboard, you can use Axomo on AWS to:

  • Optimize, predict, and provide insights on cluster resources and license consumption of jobs on LSF clusters.
  • Identify underused hardware and misconfigurations.
  • Scale compute and storage resources.
portworx logo

This Quick Start was developed by Mactores in collaboration with AWS. Mactores is an APN Partner.

  •  What you'll build
  •  How to deploy
  •  Cost and licenses
  •  What you'll build
  • Use this Quick Start to automatically set up the following environment on AWS:

    • A new virtual private cloud (VPC), a private subnet, and security groups. *
    • A structured data lake in Amazon Simple Storage Service (Amazon S3) to hold raw, modeled, enhanced, and transformed data.
    • A staging bucket for the feature-engineered and transformed data that will be ingested into Amazon SageMaker for machine learning (ML).
    • Data transformation code hosted on AWS Lambda to prepare raw data for consumption and ML model training, and to transform data input and output.
    • Amazon SageMaker automation through Lambda functions to build, manage, and create REST endpoints for new models, based on a schedule or triggered by data changes in the data lake. Amazon SageMaker uses Amazon Athena for training ML models and for predictions, such as resource forecasting.
    • AWS Identity and Access Management (IAM) to enforce the principle of least privilege on each processing component. The IAM role and policy restrict access to only the resources that are necessary.
    • AWS Data Migration Service (AWS DMS) that reads from an on-premises IBM Spectrum LSF RTM MySQL database to migrate the IBM Spectrum LSF RTM data to Amazon S3 over a secured virtual private network (VPN).
    • An S3copy command that is used on IBM Spectrum LSF and Telegraf log files to transfer them over secured VPN to Amazon S3.

    *  The template that deploys the Quick Start into an existing VPC skips the components marked by asterisks and prompts you for your existing VPC configuration.

  •  How to deploy
  • To deploy the Axomo environment in your AWS account, follow the instructions in the deployment guide. The deployment process takes about 25 minutes and includes these steps:

    1. If you don't already have an AWS account, sign up at https://aws.amazon.com, and sign in to your account.
    2. Launch the Quick Start, choosing from the following options:
    3. Test the deployment by connecting to the Axomo portal.
  •  Cost and licenses
  • You are responsible for the cost of the AWS services used while running this Quick Start reference deployment. There is no additional cost for using the Quick Start.

    The AWS CloudFormation templates for this Quick Start include configuration parameters that you can customize. Some of these settings, such as instance type, will affect the cost of deployment. For cost estimates, see the pricing pages for each AWS service you will be using. Prices are subject to change.

    Tip   After you deploy the Quick Start, we recommend that you enable the AWS Cost and Usage Report to track costs associated with the Quick Start. This report delivers billing metrics to an Amazon Simple Storage Service (Amazon S3) bucket in your account. It provides cost estimates based on usage throughout each month, and finalizes the data at the end of the month. For more information about the report, see the AWS documentation.

    This Quick Start is free for all AWS customers without production support. To use the Quick Start in your production environment with support, sign up for a production license at https://www.mactores.com/axomo-qs.

    If you don’t have a license, the Quick Start deploys an unlimited trial license, which allows unlimited days of free usage in a non-production environment. You can upgrade to a production license by following the instructions at https://www.mactores.com/axomo-qs.