Overview
The Improving Forecast Accuracy with Machine Learning solution automatically produces forecasts and generates visualization dashboards for Amazon QuickSight or Amazon SageMaker Jupyter Notebooks—providing a quick, easy, drag-and-drop interface that displays time series input and forecasted output. Forecasting can be applied to predict retail inventory demand, supply-chain planning, workforce status, web traffic forecasting, and more.
Forecasts can be compared across dimensions (for example, retail store location) or item-level metadata (for example, product brand, size, and color). You can use this data for the following:
- Optimize existing forecasts - Save time and retain compatibility with your legacy tools, or gain insight into over- and under-provisioning, with the p50 forecast.
- Meet variable customer demand - Provide high levels of customer satisfaction with the p90 forecast, where the true value is expected to be lower than the predicted value 90% of the time.
- Avoid over-provisioning - Save on costs and avoid over-provisioning with the p10 forecast, where the true future demand value is expected to be lower than the predicted value only 10% of the time.
Benefits
Streamline the process of ingesting, modeling, and forecasting multiple experiments through the automation of Amazon Forecast.
Provide a secure one-click deployment using an AWS CloudFormation template developed with the AWS Well-Architected Framework methodologies.
Easily monitor forecasts by emailing users when successes and failures occur.
Facilitate collaboration and experimentation by combining your input data and forecast output in an Amazon QuickSight Analysis or Jupyter Notebook.
Technical details
The AWS CloudFormation template deploys the resources required to automate your Amazon Forecast usage and deployments. Based on the capabilities of the solution, the architecture is divided into three parts: data preparation, forecasting, and data visualization. The template includes the following components:
Step 1
An Amazon Simple Storage Service (Amazon S3) bucket for Amazon Forecast configuration where you specify configuration settings for your dataset groups, dataset predictors, and forecasts, as well as the datasets themselves.
Step 2
An Amazon S3 event notification that triggers when new datasets are uploaded to the related Amazon S3 bucket.
Step 3
An Improving Forecast Accuracy with Machine Learning AWS Step Functions state machine. This combines a series of AWS Lambda functions that build, train, and deploy your Machine Learning (ML) models in Amazon Forecast. All AWS Step Functions log to Amazon CloudWatch.
Step 4
An Amazon Simple Notification Service (Amazon SNS) email subscription that notifies administrative users with the results of the AWS Step Functions.
Step 5
An Amazon SageMaker notebook instance that data scientists and developers can use to prepare and process data, and evaluate Forecast output.
Step 6
An AWS Glue job combines raw forecast input data, metadata, predictor backtest exports, and forecast exports into an aggregated view of your forecasts.
Step 7
Amazon Athena can be used to query your forecast output using standard SQL queries.
Step 8
Amazon QuickSight analyses can be created on a per-forecast basis to provide users with forecast output visualization across hierarchies and categories of forecasted items, as well as item level accuracy metrics. Dashboards can be created from these analyses and shared within your organization.
Step 1
An Amazon Simple Storage Service (Amazon S3) bucket for Amazon Forecast configuration where you specify configuration settings for your dataset groups, dataset predictors, and forecasts, as well as the datasets themselves.
Step 2
An Amazon S3 event notification that invokes when new datasets are uploaded to the related Amazon S3 bucket.
Step 3
An Improving Forecast Accuracy with Machine Learning AWS Step Functions state machine. This combines a series of AWS Lambda functions that build, train, and deploy your Machine Learning (ML) models in Amazon Forecast. All AWS Step Functions log to Amazon CloudWatch.
Step 4
An Amazon Simple Notification Service (Amazon SNS) email subscription that notifies administrative users with the results of the AWS Step Functions.
Step 5
An Amazon SageMaker notebook instance that data scientists and developers can use to prepare and process data, and evaluate forecast output.
Step 6
An AWS Glue job combines raw forecast input data, metadata, predictor backtest exports, and forecast exports into an aggregated view of your forecasts.
Step 7
Amazon Athena can be used to query your forecast output using standard SQL queries.
Step 8
Amazon QuickSight analyses can be created on a per-forecast basis to provide users with forecast output visualization across hierarchies and categories of forecasted items, as well as item level accuracy metrics. Dashboards can be created from these analyses and shared within your organization.
Related content
Learn how tech company App8 developed a tool that could predict customer volume and demand for particular menu items using the Improving Forecast Accuracy with Machine Learning Solution.
In this blog post, we will show you how to build a reliable retail forecasting system using Amazon Forecast and an AWS-vetted solution called Improving Forecast Accuracy with Machine Learning.
Learn how the Improving Forecast Accuracy with Machine Learning Solution simplifies short-term electric load forecasting for power and utilities to improve grid reliability.
This courses clarifies both the machine learning stack and the terms and processes that will help you build a good foundation in machine learning.
After taking this set of courses, you’ll understand how Artificial Intelligence (AI) led to Machine Learning (ML), which then led to Deep Learning (DL).