Listing Thumbnail

    Meta Llama 2 Chat 70B (Amazon Bedrock Edition)

     Info
    Deployed on AWS
    AWS Free Tier
    A dialogue use case optimized variant of Llama 2 models. Llama 2 is an auto-regressive language model that uses an optimized transformer architecture. Llama 2 is intended for commercial and research use in English.

    Overview

    Llama is a family of large language models that uses publicly available data for training. These models are based on the transformer architecture, which allows it to process input sequences of arbitrary length and generate output sequences of variable length. One of the key features of Llama models is its ability to generate coherent and contextually relevant text. This is achieved through the use of attention mechanisms, which allow the model to focus on different parts of the input sequence as it generates output. Additionally, Llama models use a technique called masked language modeling to pre-train the model on a large corpus of text, which helps it learn to predict missing words in a sentence.

    Llama models have shown to perform well on a variety of natural language processing tasks, including language translation, question answering, and text summarization and are also capable of generating human-like text, making Llama models a useful tool for creative writing and other applications where natural language generation is important.

    Overall, Llama models are powerful and versatile language models that can be used for a wide range of natural language processing tasks. The models ability to generate coherent and contextually relevant text makes it particularly useful for applications such as chatbots, virtual assistants, and language translation.

    Highlights

    • Llama 2 pretrained models are trained on 2 trillion tokens, and have a 4k context length. Its fine-tuned chat models have been trained on over 1 million human annotations.
    • Llama 2 has undergone internal and external adversarial testing across our fine-tuned models to identify potential toxicity, bias, and other gaps in performance. Our Responsible Use Guide also provides developers with best practices for responsible development and safety evaluations.
    • Our model and weights are licensed for both researchers and commercial entities, upholding the principles of openness. Our mission is to empower individuals, and industry through this opportunity, while fostering an environment of discovery and ethical AI advancements.

    Details

    Delivery method

    Deployed on AWS
    New

    Introducing multi-product solutions

    You can now purchase comprehensive solutions tailored to use cases and industries.

    Multi-product solutions

    Features and programs

    Financing for AWS Marketplace purchases

    AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.
    Financing for AWS Marketplace purchases

    Pricing

    Meta Llama 2 Chat 70B (Amazon Bedrock Edition)

     Info
    Pricing is based on actual usage, with charges varying according to how much you consume. Subscriptions have no end date and may be canceled any time.
    Additional AWS infrastructure costs may apply. Use the AWS Pricing Calculator  to estimate your infrastructure costs.

    Usage costs (14)

     Info
    Dimension
    Cost/unit
    Provisioned Throughput Hourly Price (6 Months Commit)
    $13.08
    Provisioned Throughput Hourly Price (1 Month Commit)
    $21.18
    Model Storage cost per month
    $1.95
    Provisioned Throughput Hourly Price (No Commit)
    $23.50
    Model Storage cost per month
    $1.95
    Provisioned Throughput Hourly Price (1 Month Commit)
    $21.18
    Price per 1 million output tokens
    $2.56
    Price per 1 million input tokens
    $1.95
    Price per 1 million output tokens
    $2.56
    Price per 1 million input tokens
    $1.95

    Vendor refund policy

    No Refunds

    How can we make this page better?

    We'd like to hear your feedback and ideas on how to improve this page.
    We'd like to hear your feedback and ideas on how to improve this page.

    Legal

    Vendor terms and conditions

    Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA) .

    Content disclaimer

    Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.

    Usage information

     Info

    Delivery details

    Software as a Service (SaaS)

    SaaS delivers cloud-based software applications directly to customers over the internet. You can access these applications through a subscription model. You will pay recurring monthly usage fees through your AWS bill, while AWS handles deployment and infrastructure management, ensuring scalability, reliability, and seamless integration with other AWS services.

    Support

    AWS infrastructure support

    AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.

    Similar products

    Customer reviews

    Ratings and reviews

     Info
    0 ratings
    5 star
    4 star
    3 star
    2 star
    1 star
    0%
    0%
    0%
    0%
    0%
    0 reviews
    No customer reviews yet
    Be the first to review this product . We've partnered with PeerSpot to gather customer feedback. You can share your experience by writing or recording a review, or scheduling a call with a PeerSpot analyst.