Hugging Face Neuron Deep Learning AMI (Ubuntu 22.04) logo

    Hugging Face Neuron Deep Learning AMI (Ubuntu 22.04)

    Hugging Face Neuron Deep Learning AMI (DLAMI) makes it easy to use Amazon EC2 Inferentia & Trainium instances for training and inference of Hugging Face Transformers and Diffusers models, offering up to 50% cost-to-train savings over comparable GPU-based DLAMIs.

    Ratings and reviews

    5
    1 ratings
    4 star
    3 star
    2 star
    1 star
    100%
    0%
    0%
    0%
    0%
    1 AWS reviews

    Filters

    Review type

    AWS Marketplace reviews
    External reviews
    Reviews (1)
    Paul-HF

    Used it to compile a model to Neuron

    Reviewed on Feb 20, 2024
    Review from a verified AWS customer

    I've used this AMI to compile a tiny LLama model to Neuron and it works as expected with the necessary libraries, and with opimum-neuron among them.