Containers
Author: Shawn Zhang
Shawn is a Specialist Solutions Architect at AWS Hong Kong, with expertise in multiple domains, including containers and serverless computing. He is passionate about application architecture and Generative AI solutions, serving as a local advocate for these technologies in Hong Kong. Prior to joining AWS, Shawn gained valuable experience in DevOps and cloud platform engineering with several prominent companies in the region.
Scaling a Large Language Model with NVIDIA NIM on Amazon EKS with Karpenter
Many organizations are building artificial intelligence (AI) applications using Large Language Models (LLMs) to deliver new experiences to their customers, from content creation to customer service and data analysis. However, the substantial size and intensive computational requirements of these models may have challenges in configuring, deploying, and scaling them effectively on graphic processing units (GPUs). […]