AWS Public Sector Blog
Category: Amazon SageMaker Studio
Deploy LLMs in AWS GovCloud (US) Regions using Hugging Face Inference Containers
Government agencies are increasingly using large language models (LLMs) powered by generative artificial intelligence (AI) to extract valuable insights from their data in the Amazon Web Services (AWS) GovCloud (US) Regions. In this guide, we walk you through the process of hosting LLMs on Amazon Elastic Compute Cloud (Amazon EC2) instances, using the Hugging Face Text Generation Inference (TGI) Container (TGI) for serving custom LLMs.
Recapping the top announcements for K12 education from AWS re:Invent 2023
Amazon Web Services (AWS) made more than 140 announcements at re:Invent 2023. In this blog post, we’ll take key announcements from re:Invent and apply them to relevant K12 education use cases. From generative artificial intelligence (AI) to cost optimization, AWS can support your school, district, or educational service agency and enhance both the classroom and administrative experience.