Meta Llama 2 on Amazon Bedrock

Quickly and easily build generative AI-powered experiences

Benefits

The fine-tuned model, Llama Chat, leverages publicly available instruction datasets and over 1 million human annotations.
Llama 2 models are trained on 2 trillion tokens from online public data sources.
The fine-tuned model has over 1,000 hours of red-teaming and annotation effort to ensure safety with model performance.
Amazon Bedrock is the first public cloud service to offer a fully managed API for Llama 2. Organizations of all sizes can access Llama 2 Chat models on Amazon Bedrock without having to manage the underlying infrastructure.

Meet Llama 2

Amazon Bedrock is the first public cloud service to offer a fully managed API for Llama 2, Meta’s next-generation large language model (LLM). Now, organizations of all sizes can access Llama 2 models on Amazon Bedrock without having to manage the underlying infrastructure. This means you can focus on what you do best—building your AI applications. The partnership between Meta and Amazon signifies collective generative AI innovation. Meta and Amazon are working together to push the boundaries of what's possible.

Use cases

Meta's fine-tuned LLMs, called Llama-2-Chat, are optimized for dialogue use cases.

Model versions

Llama-2-13b-chat

Fine-tuned model in the parameter size of 13B. Suitable for smaller-scale tasks such as text classification, sentiment analysis, and language translation.

Max tokens: 4K

Languages: English

Supported use cases: Assistant-like chat

Llama-2-70b-chat

Fine-tuned model in the parameter size of 70B. Suitable for larger-scale tasks such as language modeling, text generation, and dialogue systems.

Max tokens: 4K

Languages: English

Supported use cases: Assistant-like chat