Amazon Sagemaker
Amazon SageMaker is a fully-managed platform that enables developers and data scientists to quickly and easily build, train, and deploy machine learning models at any scale. With Amazon SageMaker, all the barriers and complexity that typically slow down developers who want to use machine learning are removed. The service includes models that can be used together or independently to build, train, and deploy your machine learning models.

Long-Memory Dynamic Factor Model (LMDFM) Free trial
By:
Latest Version:
0.4.0
Long-Memory Dynamic Factor Model (LMDFM) to analyze and forecast large number of time-series influenced by evolutions of unobserved factors.
Product Overview
The long-memory dynamic factor model (LMDFM) algorithm is to make (1) analysis of observed multiple (vector) time-series, (2) multi-step forecasts of multivariate (vector) time-series, and (3) multi-step forecasts of multivariate volatility (variance-covariance matrix) of vector time-series. The LMDFM assumes the large set of time-series are influenced by evolution histories of a number of unobserved factors commonly affecting all or many of the time-series. LMDFM is estimated by an implementation of dynamic principal components analysis (DPCA), reviewed by Doz and Fuleky (2020), with 2-dimensional discrete Fourier transform (2D-DFT). LMDFM algorithm can estimate the influences of longer histories of common factors. the LMDFM algorithm estimates (a) dynamic factor loadings matrixes, (b) vector autoregressive (VAR) coefficients of dynamic factor scores, (c) multi-step forecasts of multivariate values and variance-covariance matrix of the factor scores and the observed time-series.
Key Data
Version
Show other versions
Type
Algorithm
Highlights
WHY DFM? Dynamic factor models (DFMs) can be used to analyze and forecast large set of time-series, such as measurements and indicators of national or multinational economies, prices of products or instruments constantly traded in markets, measurements and observations of natural or engineering processes, social or political trends, and scores of sports. The evolutions of these time-series are influenced by evolutions of a number of unobserved dynamic factors commonly affecting all or many of the time-series.
WHY Long-Memory? The LMDFM algorithm estimates influence of longer histories of dynamic common factors with concepts of DPCA (dynamic principal components analysis) and 2D or 1D and inverse DFT (discrete Fourier transform). Such longer-memory estimates make LMDFM accommodate wider range of values of model learning parameters. The wider ranges can further enhance the power of machine learning.
WHAT next? Many real-world large sets of time-series are nonstationary. In general, a filtering approach could be the best for analysis and forecasts on nonstationary time-series. Bayesian filters are among more adaptive filters: more powerful due to fewer restrictive conditions. A variational Bayesian filtering is the fastest one. We, i4cast LLC, is an advanced developer in variational Bayesian filtering: we listed VBfFA algorithm here on AWS. We are now working on developing and offering a long memory dynamic factor model estimated by a variational Bayesian filtering for better forecasts.
Not quite sure what you’re looking for? AWS Marketplace can help you find the right solution for your use case. Contact us
Pricing Information
Use this tool to estimate the software and infrastructure costs based your configuration choices. Your usage and costs might be different from this estimate. They will be reflected on your monthly AWS billing reports.
Contact us to request contract pricing for this product.
Estimating your costs
Choose your region and launch option to see the pricing details. Then, modify the estimated price by choosing different instance types.
Version
Region
Software Pricing
Algorithm Training$0.10/hr
running on ml.m5.xlarge
Model Realtime Inference$0.10/hr
running on ml.m5.xlarge
Model Batch Transform$0.10/hr
running on ml.m5.xlarge
Infrastructure PricingWith Amazon SageMaker, you pay only for what you use. Training and inference is billed by the second, with no minimum fees and no upfront commitments. Pricing within Amazon SageMaker is broken down by on-demand ML instances, ML storage, and fees for data processing in notebooks and inference instances.
Learn more about SageMaker pricing
With Amazon SageMaker, you pay only for what you use. Training and inference is billed by the second, with no minimum fees and no upfront commitments. Pricing within Amazon SageMaker is broken down by on-demand ML instances, ML storage, and fees for data processing in notebooks and inference instances.
Learn more about SageMaker pricing
SageMaker Algorithm Training$0.23/host/hr
running on ml.m5.xlarge
SageMaker Realtime Inference$0.23/host/hr
running on ml.m5.xlarge
SageMaker Batch Transform$0.23/host/hr
running on ml.m5.xlarge
About Free trial
Try this product for 120 days. There will be no software charges, but AWS infrastructure charges still apply. Free Trials will automatically convert to a paid subscription upon expiration.
Algorithm Training
For algorithm training in Amazon SageMaker, the software is priced based on hourly pricing that can vary by instance type. Additional infrastructure cost, taxes or fees may apply.InstanceType | Algorithm/hr | |
---|---|---|
ml.m4.4xlarge | $0.10 | |
ml.c5n.18xlarge | $0.10 | |
ml.g4dn.4xlarge | $0.10 | |
ml.m5.4xlarge | $0.10 | |
ml.m4.16xlarge | $0.10 | |
ml.m5.2xlarge | $0.10 | |
ml.p3.16xlarge | $0.10 | |
ml.g5.xlarge | $0.10 | |
ml.g5.12xlarge | $0.10 | |
ml.g4dn.2xlarge | $0.10 | |
ml.g5.4xlarge | $0.10 | |
ml.m4.2xlarge | $0.10 | |
ml.c5.2xlarge | $0.10 | |
ml.c4.2xlarge | $0.10 | |
ml.g4dn.12xlarge | $0.10 | |
ml.p4d.24xlarge | $0.10 | |
ml.m4.10xlarge | $0.10 | |
ml.m5.24xlarge | $0.10 | |
ml.g4dn.xlarge | $0.10 | |
ml.g5.48xlarge | $0.10 | |
ml.g4dn.16xlarge | $0.10 | |
ml.m5.12xlarge | $0.10 | |
ml.p3dn.24xlarge | $0.10 | |
ml.p2.16xlarge | $0.10 | |
ml.c4.4xlarge | $0.10 | |
ml.g5.8xlarge | $0.10 | |
ml.m5.xlarge Vendor Recommended | $0.10 | |
ml.c5.9xlarge | $0.10 | |
ml.g5.16xlarge | $0.10 | |
ml.m4.xlarge | $0.10 | |
ml.c5.4xlarge | $0.10 | |
ml.p3.8xlarge | $0.10 | |
ml.c4.8xlarge | $0.10 | |
ml.g4dn.8xlarge | $0.10 | |
ml.p2.8xlarge | $0.10 | |
ml.c5n.2xlarge | $0.10 | |
ml.c5n.9xlarge | $0.10 | |
ml.c5.18xlarge | $0.10 | |
ml.g5.2xlarge | $0.10 | |
ml.c5n.4xlarge | $0.10 | |
ml.g5.24xlarge | $0.10 |
Usage Information
Training
The long-memory dynamic factor model (LMDFM) algorithm is to analyze and forecast large sets of time-series when the time-series are influenced by evolution histories of a number of unobserved factors commonly affecting all or many of the time-series.
The LMDFM algorithm takes, as input data, multiple time-series data contained in a CSV (comma separated value) data table, in a format of a CSV text-string or a CSV text-file. Each row of the data table is for values of an individual time-series (TS). Each column is for values of all time-series at a specific moment in time.
Metrics
Name | Regex |
---|---|
projection_coefficient_#_13 | projection_coefficient_#_13=(.*?); |
projection_coefficient_#_26 | projection_coefficient_#_26=(.*?); |
projection_coefficient_#_52 | projection_coefficient_#_52=(.*?); |
diff_FE_loglike | diff_FE_loglike=(.*?); |
diff_FS_loglike | diff_FS_loglike=(.*?); |
Channel specification
Fields marked with * are required
train
*Training dataset
Input modes: File
Content types: text/csv
Compression types: None
Hyperparameters
Fields marked with * are required
len_learn_window
*Length of moving/rolling time window for model learning/estimate
Type: Integer
Tunable: Yes
var_order
*Order, p, of VAR (vector autoregressive) model
Type: Integer
Tunable: Yes
num_factors
*Number of dynamic factors of DFM
Type: Integer
Tunable: Yes
forecast_type
*Type of estimation method for time-series forecasts
Type: Integer
Tunable: No
shock_list
*Dict type list of time-series shocks {time-series symbol: shock level}
Type: FreeText
Tunable: No
max_forecast_step
*Maximum number of future/forward/lead steps to be forecasted
Type: Integer
Tunable: No
target_type
*Type of time-series value target to be forecasted
Type: Categorical
Tunable: No
fwd_cumsum
*Forward cumulative summation in forecasts (True/False)
Type: Categorical
Tunable: No
model_utility
*LMDFM algorithm/model training/inference utility
Type: Categorical
Tunable: No
num_forecasts
*Number of rolling forecasts for model evaluation
Type: Integer
Tunable: No
half_life_list
*List of half-life of time-weightings applying to time-series forecast model evaluation
Type: FreeText
Tunable: No
eval_metric_list
*List of model evaluation metrics
Type: FreeText
Tunable: No
Model input and output details
Input
Summary
The LMDFM (long-memory dynamic factor model) algorithm takes, as input data, multiple time-series data contained in a CSV (comma separated value) data table, in a format of a CSV text-string or a CSV text-file.
Each row of the data table is for values of an individual time-series (TS). Row header is the label or symbol of the time-series. Each column is for values of all time-series at a specific moment in time. Column header is the time-index or time-stamp of the moment.
Input MIME type
text/csvSample input data
Output
Summary
Outputs from LMDFM model are multi-step forecasts of multivariate time-series, or of multivariate volatility (variance-covariance matrix). Additional outputs include a variety of parameter/coefficient matrixes, as well as (common and idiosyncratic) components of all time-series.
Output in format of CSV tables can be used to make quick review by using a spreadsheet application. Output in format of JSON strings can be used as input data for further analysis.
Output MIME type
text/csv, application/jsonSample output data
Sample notebook
End User License Agreement
By subscribing to this product you agree to terms and conditions outlined in the product End user License Agreement (EULA)
Support Information
Long-Memory Dynamic Factor Model (LMDFM)
For questions or call-back number, please send email to i4cast LLC at prod.i4cast@gmail.com.
AWS Infrastructure
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.
Learn MoreRefund Policy
We offer full refund for academic works. Other refunds are offered according to common practices.
Customer Reviews
There are currently no reviews for this product.
View allWrite a review
Share your thoughts about this product.
Write a customer review