Detalhes do evento
-
-
Build LLMs efficiently and at scale with SageMaker AI, Spot, EKS, Slurm, and Ray
IA
Amazon Bedrock
IA generativa
SageMaker
-
-
ONLINE
English
300 - Avançado
-
-
This webinar discusses large language models (LLMs) fine-tuning and training across different scale and various options. This includes fine-tuning/pre-training proprietary models with Bedrock and tuning/training open models with SageMaker AI training job which can leverage spot instances, SageMaker AI HyperPod with Slurm, and EKS. Learn also about larger scale training leveraging multiple GPUs and even multiple nodes with Ray on EKS or SageMaker AI HyperPod.
In addition to the training orchestration, this webinar will also highlight the available infrastructure, including the available GPUs on AWS, the way to run them on spot to save training cost, and also the supporting components (e.g. training observability, scalability,
Join us online to learn about the topics above, and discover potential AWS credits you could leverage to potentially bring your model into AWS Marketplace and SageMaker Jumpstart, bring your solution closer to your customers.
Agenda
6:00 AM UTC
Overview
Overview of GenAI solutions on AWS, ML accelerators on AWS (GPU, trainium, inferentia)
6:15 AM UTC
Technical session 1
Demo & dive deeper into Bedrock, SageMaker AI, and EKS, Model choices: SLM vs LLM, Fine-tuning & knowledge distillation with Bedrock and fine-tuning with SageMaker AI
7:00 AM UTC
Break
7:10 AM UTC
Technical Session 2
LLM training with Karpenter and Ray on EKS, LLM training with Slurm on SageMaker HyperPod, Model hosting options: SageMaker AI & EKS
8:00 AM UTC
Next steps
Go-to-market: Bedrock Marketplace and SageMaker Jumpstart, Information on available AWS credits, AWS partners, and GenAI Innovation Center program