PyTorch on AWS

PyTorch on AWS Resources

Amazon EC2 Inf1 instances and AWS Inferentia

Getting started

Get started on using PyTorch-based models for inference on EC2 Inf1 instances

Learn more about PyTorch Neuron

Review the AWS re:Invent 2021 Inferentia Workshop

Accelerate BERT inference with Hugging Face Transformers and AWS Inferentia

TorchServe

Optimize your inference jobs using dynamic batch inference with TorchServe on Amazon SageMaker

Choose the best AI accelerator and model compilation for computer vision inference with Amazon SageMaker

Amazon SageMaker JumpStart simplifies access to prebuilt models and machine learning solutions

Further reading

TorchElastic

Run fault-tolerant distributed machine learning training with the TorchElastic Controller for Kubernetes

PyTorch on AWS blog posts

Explore more PyTorch on AWS blog posts

Loading

Loading

Loading

Loading

Loading

Next steps

Sign up for a free account

Instantly get access to the AWS Free Tier.

Have more questions?

Get in touch with the Support Specialist.