Select your cookie preferences

We use essential cookies and similar tools that are necessary to provide our site and services. We use performance cookies to collect anonymous statistics, so we can understand how customers use our site and make improvements. Essential cookies cannot be deactivated, but you can choose “Customize” or “Decline” to decline performance cookies.

If you agree, AWS and approved third parties will also use cookies to provide useful site features, remember your preferences, and display relevant content, including relevant advertising. To accept or decline all non-essential cookies, choose “Accept” or “Decline.” To make more detailed choices, choose “Customize.”

Skip to main contentAWS Startups

    Hosting DeepSeek and Open Source LLMs on AWS (Timing updated)

    Amazon Bedrock

    EC2

    Generative AI

    Machine Learning

    SageMaker

    Day:

    Wednesday, February 19, 2025

    Time:

    7:00 AM - 8:30 AM GMT

    Type:

    ONLINE

    Speakers:

    Girish Dilip Patil | Head of Technology, GenAI, ASEAN, AWS, Yudho Ahmad Diponegoro | Sr. Solutions Architect, AWS, Kien Nguyen | Solutions Architect, AWS, Kyven Tan | Account Representative - Startups, AWS

    Language:

    English

    Level(s):

    200 - Intermediate

    Event details

    Wednesday, February 19, 2025

    7:00 AM - 8:30 AM GMT

    ONLINE

    As DeepSeek-R1 has become a trending topic due to its reasoning ability, we have heard questions on how to deploy the model or its distilled models on AWS.

    This topic is extended into how startups can deploy open source LLMs on AWS in general. This 1.5 hour session is exactly about that. Let's dive deeper into DeepSeek-R1 models, the possible ways to deploy them on AWS, and how to get started with those models on AWS including potential experimentation credits.

    Learn about deploying DeepSeek-R1 distilled models in a cost-optimized way with Scale Down to Zero on Amazon SageMaker and with Graviton4 CPU on EC2.

    Join this session to learn all this together.

    Agenda

    7:00 AM UTC

    DeepSeek-R1 Technical Deep-Dive: Architecture, model types and why it matters

    Girish Dilip Patil | Head of Technology, GenAI, ASEAN, AWS

    7:15 AM UTC

    Overview of DeepSeek-R1 & Opensource LLMs on AWS: Deployment options

    8:00 AM UTC

    Production Deployment Guide: Opensource LLMs on AWS

    8:20 AM UTC

    Next Steps: AWS Funding Programs and Partners