Skip to main contentAWS Startups
    1. Events
    2. Build LLMs efficiently and at scale with SageMaker AI, Spot, EKS, Slurm, and Ray

    Build LLMs efficiently and at scale with SageMaker AI, Spot, EKS, Slurm, and Ray

    AI

    Amazon Bedrock

    Generative AI

    SageMaker

    Day:

    -

    Time:

    -

    Type:

    ONLINE

    Language:

    English

    Level(s):

    300 - Advanced

    Event details

    -

    -

    ONLINE

    This webinar discusses large language models (LLMs) fine-tuning and training across different scale and various options. This includes fine-tuning/pre-training proprietary models with Bedrock and tuning/training open models with SageMaker AI training job which can leverage spot instances, SageMaker AI HyperPod with Slurm, and EKS. Learn also about larger scale training leveraging multiple GPUs and even multiple nodes with Ray on EKS or SageMaker AI HyperPod.

    In addition to the training orchestration, this webinar will also highlight the available infrastructure, including the available GPUs on AWS, the way to run them on spot to save training cost, and also the supporting components (e.g. training observability, scalability,

    Join us online to learn about the topics above, and discover potential AWS credits you could leverage to potentially bring your model into AWS Marketplace and SageMaker Jumpstart, bring your solution closer to your customers.

    Agenda

    6:00 AM UTC

    Overview

    Overview of GenAI solutions on AWS, ML accelerators on AWS (GPU, trainium, inferentia)

    6:15 AM UTC

    Technical session 1

    Demo & dive deeper into Bedrock, SageMaker AI, and EKS, Model choices: SLM vs LLM, Fine-tuning & knowledge distillation with Bedrock and fine-tuning with SageMaker AI

    7:00 AM UTC

    Break

    7:10 AM UTC

    Technical Session 2

    LLM training with Karpenter and Ray on EKS, LLM training with Slurm on SageMaker HyperPod, Model hosting options: SageMaker AI & EKS

    8:00 AM UTC

    Next steps

    Go-to-market: Bedrock Marketplace and SageMaker Jumpstart, Information on available AWS credits, AWS partners, and GenAI Innovation Center program