Select your cookie preferences

We use essential cookies and similar tools that are necessary to provide our site and services. We use performance cookies to collect anonymous statistics, so we can understand how customers use our site and make improvements. Essential cookies cannot be deactivated, but you can choose “Customize” or “Decline” to decline performance cookies.

If you agree, AWS and approved third parties will also use cookies to provide useful site features, remember your preferences, and display relevant content, including relevant advertising. To accept or decline all non-essential cookies, choose “Accept” or “Decline.” To make more detailed choices, choose “Customize.”

Sign in
Your Saved List Become a Channel Partner Sell in AWS Marketplace Amazon Web Services Home Help

Amazon Sagemaker

Amazon SageMaker is a fully-managed platform that enables developers and data scientists to quickly and easily build, train, and deploy machine learning models at any scale. With Amazon SageMaker, all the barriers and complexity that typically slow down developers who want to use machine learning are removed. The service includes models that can be used together or independently to build, train, and deploy your machine learning models.

product logo

Long-Memory Dynamic Factor Model (LMDFM) Free trial

Latest Version:
0.4.0
Long-Memory Dynamic Factor Model (LMDFM) to analyze and forecast large number of time-series influenced by evolutions of unobserved factors.

    Product Overview

    The long-memory dynamic factor model (LMDFM) algorithm is to make (1) analysis of observed multiple (vector) time-series, (2) multi-step forecasts of multivariate (vector) time-series, and (3) multi-step forecasts of multivariate volatility (variance-covariance matrix) of vector time-series. The LMDFM assumes the large set of time-series are influenced by evolution histories of a number of unobserved factors commonly affecting all or many of the time-series. LMDFM is estimated by an implementation of dynamic principal components analysis (DPCA), reviewed by Doz and Fuleky (2020), with 2-dimensional discrete Fourier transform (2D-DFT). LMDFM algorithm can estimate the influences of longer histories of common factors. the LMDFM algorithm estimates (a) dynamic factor loadings matrixes, (b) vector autoregressive (VAR) coefficients of dynamic factor scores, (c) multi-step forecasts of multivariate values and variance-covariance matrix of the factor scores and the observed time-series.

    Key Data

    Version
    Show other versions
    Type
    Algorithm
    Fulfillment Methods
    Amazon SageMaker

    Highlights

    • WHY DFM? Dynamic factor models (DFMs) can be used to analyze and forecast large set of time-series, such as measurements and indicators of national or multinational economies, prices of products or instruments constantly traded in markets, measurements and observations of natural or engineering processes, social or political trends, and scores of sports. The evolutions of these time-series are influenced by evolutions of a number of unobserved dynamic factors commonly affecting all or many of the time-series.

    • WHY Long-Memory? The LMDFM algorithm estimates influence of longer histories of dynamic common factors with concepts of DPCA (dynamic principal components analysis) and 2D or 1D and inverse DFT (discrete Fourier transform). Such longer-memory estimates make LMDFM accommodate wider range of values of model learning parameters. The wider ranges can further enhance the power of machine learning.

    • WHAT next? Many real-world large sets of time-series are nonstationary. In general, a filtering approach could be the best for analysis and forecasts on nonstationary time-series. Bayesian filters are among more adaptive filters: more powerful due to fewer restrictive conditions. A variational Bayesian filtering is the fastest one. We, i4cast LLC, is an advanced developer in variational Bayesian filtering: we listed VBfFA algorithm here on AWS. We are now working on developing and offering a long memory dynamic factor model estimated by a variational Bayesian filtering for better forecasts.

    Not quite sure what you’re looking for? AWS Marketplace can help you find the right solution for your use case. Contact us

    Pricing Information

    Use this tool to estimate the software and infrastructure costs based your configuration choices. Your usage and costs might be different from this estimate. They will be reflected on your monthly AWS billing reports.

    Contact us to request contract pricing for this product.


    Estimating your costs

    Choose your region and launch option to see the pricing details. Then, modify the estimated price by choosing different instance types.

    Version
    Region

    Software Pricing

    Algorithm Training$0.10/hr

    running on ml.m5.xlarge

    Model Realtime Inference$0.10/hr

    running on ml.m5.xlarge

    Model Batch Transform$0.10/hr

    running on ml.m5.xlarge

    Infrastructure Pricing

    With Amazon SageMaker, you pay only for what you use. Training and inference is billed by the second, with no minimum fees and no upfront commitments. Pricing within Amazon SageMaker is broken down by on-demand ML instances, ML storage, and fees for data processing in notebooks and inference instances.
    Learn more about SageMaker pricing

    SageMaker Algorithm Training$0.23/host/hr

    running on ml.m5.xlarge

    SageMaker Realtime Inference$0.23/host/hr

    running on ml.m5.xlarge

    SageMaker Batch Transform$0.23/host/hr

    running on ml.m5.xlarge

    About Free trial

    Try this product for 120 days. There will be no software charges, but AWS infrastructure charges still apply. Free Trials will automatically convert to a paid subscription upon expiration.

    Algorithm Training

    For algorithm training in Amazon SageMaker, the software is priced based on hourly pricing that can vary by instance type. Additional infrastructure cost, taxes or fees may apply.
    InstanceType
    Algorithm/hr
    ml.m4.4xlarge
    $0.10
    ml.c5n.18xlarge
    $0.10
    ml.g4dn.4xlarge
    $0.10
    ml.m5.4xlarge
    $0.10
    ml.m4.16xlarge
    $0.10
    ml.m5.2xlarge
    $0.10
    ml.p3.16xlarge
    $0.10
    ml.g5.xlarge
    $0.10
    ml.g5.12xlarge
    $0.10
    ml.g4dn.2xlarge
    $0.10
    ml.g5.4xlarge
    $0.10
    ml.m4.2xlarge
    $0.10
    ml.c5.2xlarge
    $0.10
    ml.c4.2xlarge
    $0.10
    ml.g4dn.12xlarge
    $0.10
    ml.p4d.24xlarge
    $0.10
    ml.m4.10xlarge
    $0.10
    ml.m5.24xlarge
    $0.10
    ml.g4dn.xlarge
    $0.10
    ml.g5.48xlarge
    $0.10
    ml.g4dn.16xlarge
    $0.10
    ml.m5.12xlarge
    $0.10
    ml.p3dn.24xlarge
    $0.10
    ml.p2.16xlarge
    $0.10
    ml.c4.4xlarge
    $0.10
    ml.g5.8xlarge
    $0.10
    ml.m5.xlarge
    Vendor Recommended
    $0.10
    ml.c5.9xlarge
    $0.10
    ml.g5.16xlarge
    $0.10
    ml.m4.xlarge
    $0.10
    ml.c5.4xlarge
    $0.10
    ml.p3.8xlarge
    $0.10
    ml.c4.8xlarge
    $0.10
    ml.g4dn.8xlarge
    $0.10
    ml.p2.8xlarge
    $0.10
    ml.c5n.2xlarge
    $0.10
    ml.c5n.9xlarge
    $0.10
    ml.c5.18xlarge
    $0.10
    ml.g5.2xlarge
    $0.10
    ml.c5n.4xlarge
    $0.10
    ml.g5.24xlarge
    $0.10

    Usage Information

    Training

    The long-memory dynamic factor model (LMDFM) algorithm is to analyze and forecast large sets of time-series when the time-series are influenced by evolution histories of a number of unobserved factors commonly affecting all or many of the time-series.

    The LMDFM algorithm takes, as input data, multiple time-series data contained in a CSV (comma separated value) data table, in a format of a CSV text-string or a CSV text-file. Each row of the data table is for values of an individual time-series (TS). Each column is for values of all time-series at a specific moment in time.

    Metrics

    Name
    Regex
    projection_coefficient_#_13
    projection_coefficient_#_13=(.*?);
    projection_coefficient_#_26
    projection_coefficient_#_26=(.*?);
    projection_coefficient_#_52
    projection_coefficient_#_52=(.*?);
    diff_FE_loglike
    diff_FE_loglike=(.*?);
    diff_FS_loglike
    diff_FS_loglike=(.*?);

    Channel specification

    Fields marked with * are required

    train

    *
    Training dataset
    Input modes: File
    Content types: text/csv
    Compression types: None

    Hyperparameters

    Fields marked with * are required

    len_learn_window

    *
    Length of moving/rolling time window for model learning/estimate
    Type: Integer
    Tunable: Yes

    var_order

    *
    Order, p, of VAR (vector autoregressive) model
    Type: Integer
    Tunable: Yes

    num_factors

    *
    Number of dynamic factors of DFM
    Type: Integer
    Tunable: Yes

    forecast_type

    *
    Type of estimation method for time-series forecasts
    Type: Integer
    Tunable: No

    shock_list

    *
    Dict type list of time-series shocks {time-series symbol: shock level}
    Type: FreeText
    Tunable: No

    max_forecast_step

    *
    Maximum number of future/forward/lead steps to be forecasted
    Type: Integer
    Tunable: No

    target_type

    *
    Type of time-series value target to be forecasted
    Type: Categorical
    Tunable: No

    fwd_cumsum

    *
    Forward cumulative summation in forecasts (True/False)
    Type: Categorical
    Tunable: No

    model_utility

    *
    LMDFM algorithm/model training/inference utility
    Type: Categorical
    Tunable: No

    num_forecasts

    *
    Number of rolling forecasts for model evaluation
    Type: Integer
    Tunable: No

    half_life_list

    *
    List of half-life of time-weightings applying to time-series forecast model evaluation
    Type: FreeText
    Tunable: No

    eval_metric_list

    *
    List of model evaluation metrics
    Type: FreeText
    Tunable: No

    Model input and output details

    Input

    Summary

    The LMDFM (long-memory dynamic factor model) algorithm takes, as input data, multiple time-series data contained in a CSV (comma separated value) data table, in a format of a CSV text-string or a CSV text-file.

    Each row of the data table is for values of an individual time-series (TS). Row header is the label or symbol of the time-series. Each column is for values of all time-series at a specific moment in time. Column header is the time-index or time-stamp of the moment.

    Input MIME type
    text/csv
    Sample input data

    Output

    Summary

    Outputs from LMDFM model are multi-step forecasts of multivariate time-series, or of multivariate volatility (variance-covariance matrix). Additional outputs include a variety of parameter/coefficient matrixes, as well as (common and idiosyncratic) components of all time-series.

    Output in format of CSV tables can be used to make quick review by using a spreadsheet application. Output in format of JSON strings can be used as input data for further analysis.

    Output MIME type
    text/csv, application/json
    Sample output data

    End User License Agreement

    By subscribing to this product you agree to terms and conditions outlined in the product End user License Agreement (EULA)

    Support Information

    Long-Memory Dynamic Factor Model (LMDFM)

    For questions or call-back number, please send email to i4cast LLC at prod.i4cast@gmail.com.

    AWS Infrastructure

    AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.

    Learn More

    Refund Policy

    We offer full refund for academic works. Other refunds are offered according to common practices.

    Customer Reviews

    There are currently no reviews for this product.
    View all