Posted On: Nov 13, 2023
You can now access Meta’s Llama 2 Chat model (13B) in Amazon Bedrock. Llama 2 models are next generation large language models (LLM) provided by Meta. Amazon Bedrock is a fully managed service that offers a choice of high-performing foundation models from leading AI companies, like Meta, along with a broad set of capabilities that provide you with the easiest way to build and scale generative AI applications with foundation models.
With this launch, Amazon Bedrock is the first public cloud service to offer a fully managed API for Llama 2. Now, organizations can access the Llama 2 13B Chat model in Amazon Bedrock without having to manage the underlying infrastructure, giving you even greater choice when developing generative AI applications. Llama Chat is optimized for dialog use cases. It has undergone testing by Meta to identify performance gaps and mitigate potentially problematic responses in chat use cases, such as inappropriate responses. You can now integrate the Llama 2 Chat 13B model in your applications written in any programming language by calling the Amazon Bedrock API, or using the AWS SDKs or AWS Command Line Interface (AWS CLI).
Meta’s Llama 2 Chat 13B model in Amazon Bedrock is available in on-demand and provisioned throughput options in the US East (N. Virginia) and US West (Oregon) AWS Regions. To learn more, read the AWS News launch blog, Llama 2 on Amazon Bedrock product page, and documentation. To get started with Llama 2 in Amazon Bedrock, visit the Amazon Bedrock console.