Listing Thumbnail

    Zephyr 7B beta: OpenAI API Compatible

     Info
    Sold by: Meetrix.io 
    This is an OpenAi API compatible single-click deployment AMI package of Zephyr 7B-Beta, which is a fine-tuned version of the Mistral-7B-v0.1 model, trained on a mix of publicly available and synthetic datasets using Direct Preference Optimization (DPO). The model is primarily designed to act as a helpful assistant, capable of generating fluent, interesting, and helpful conversations.
    Listing Thumbnail

    Zephyr 7B beta: OpenAI API Compatible

     Info
    Sold by: Meetrix.io 

    Overview

    Zephyr 7B-Beta is a 7 billion parameter GPT-like model. It is licensed under the MIT license and is fine-tuned from the Mistral-7B-v0.1 model. The model was trained using a technique called Direct Preference Optimization (DPO), which has proven to be effective in enhancing the performance of language models.

    At the time of its release, Zephyr-7B was the highest-ranked 7B chat model on the MT-Bench and AlpacaEval benchmarks. It achieved a score of 7.34 on MT-Bench and a win rate of 90.60% on AlpacaEval, outperforming many larger models.

    In comparison to larger open models like Llama2-Chat-70B, Zephyr-7B has shown strong performance on several categories of MT-Bench.

    Usage Zephyr 7B can be used in a variety of applications, including:

    -Conversational AI: It is capable of engaging in human conversations, providing assistance, and answering queries. -Text generation: It can generate text for a variety of tasks, including answering questions, telling stories, and writing poems. -Research and education: It can be used as a tool for research and educational purposes.

    Key Features & USPs:

    OpenAI Compatibility: At its core, Zephyr 7B AI is designed to be harmonious with OpenAI standards. This ensures that users familiar with OpenAI will find the Mixtral AI experience intuitive and consistent.

    API Compatibility: Our AMI product offers seamless API compatibility for effortless integration.

    Easy and User-Friendly Deployment and Scalability: Zephyr 7B AI emphasizes ease of AWS deployment, allowing users to scale their AI operations as needed. Whether you're a startup venturing into AI or a large enterprise expanding its AI capabilities, Zephyr 7B AI ensures a hassle-free and scalable solution.

    Highlights

    • OpenAI Compatibility: Harness the Power of Integration. Zephyr 7B AI isn't just another AI solution; it's crafted for seamless integration with OpenAI standards. Dive into an intuitive AI experience and leverage the prowess of two industry giants, ensuring your projects benefit from the best of both worlds. Stay aligned with the leading edge of AI technology.
    • Effortless Deployment: Designed for ease-of-use, this AMI provides users with a hassle-free setup experience, ensuring quick implementation without the complexities.
    • Pay-as-You-Go Flexibility: Enjoy cost efficiency with a pay-as-you-go pricing model.

    Details

    Delivery method

    Delivery option
    cloudformation template for Zephyr deployment

    Latest version

    Operating system
    Ubuntu 22.04

    Features and programs

    Financing for AWS Marketplace purchases

    AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.
    Financing for AWS Marketplace purchases

    Pricing

    Zephyr 7B beta: OpenAI API Compatible

     Info
    Pricing is based on actual usage, with charges varying according to how much you consume. Subscriptions have no end date and may be canceled any time. Alternatively, you can pay upfront for a contract, which typically covering your anticipated usage for the contract duration. Any usage beyond contract will incur additional usage-based costs.
    Additional AWS infrastructure costs may apply. Use the AWS Pricing Calculator  to estimate your infrastructure costs.

    Usage costs (7)

     Info
    Instance type
    Product cost/hour
    EC2 cost/hour
    Total/hour
    g4dn.xlarge
    $0.104
    $0.526
    $0.63
    g4dn.2xlarge
    $0.104
    $0.752
    $0.856
    g4dn.4xlarge
    $0.104
    $1.204
    $1.308
    g4dn.8xlarge
    $0.104
    $2.176
    $2.28
    g4dn.12xlarge
    $0.104
    $3.912
    $4.016
    g4dn.16xlarge
    $0.104
    $4.352
    $4.456
    g4dn.metal
    $0.104
    $7.824
    $7.928

    Vendor refund policy

    We do not currently support refunds, but you can cancel at any time.

    Legal

    Vendor terms and conditions

    Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA) .

    Content disclaimer

    Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.

    Usage information

     Info

    Delivery details

    cloudformation template for Zephyr deployment

    Zephyr is capable of generating text, answering questions, generating content, and performing a range of text-related tasks in response to the provided prompts

    CloudFormation Template (CFT)

    AWS CloudFormation templates are JSON or YAML-formatted text files that simplify provisioning and management on AWS. The templates describe the service or application architecture you want to deploy, and AWS CloudFormation uses those templates to provision and configure the required services (such as Amazon EC2 instances or Amazon RDS DB instances). The deployed application and associated resources are called a "stack."

    Version release notes

    First Release

    Additional details

    Usage instructions

    Click the "Continue to Subscribe" button. After subscribing, you will need to accept the terms and conditions. Click on "Accept Terms" to proceed. Please wait for a few minutes while the processing takes place. Once it's completed, click on "Continue to Configuration".

    IAM Role is set up and configured with the necessary permissions to assume the role for the Zephyr service. The IAM Policy is created and responsible for accessing Route53 and creating Letsencrypt SSL certificates. Apart from that volume permissions also given for changing volume type of instance. Access the application via a browser at http://<your domain name>/docs or http://<Public IPv4 address>/docs.

    Product will try to setup SSL based on provided domain name, if domain hosted on route53. If the automatic SSL creation unsuccesful then you have to point domain name into server ip, ssh into server and run /root/certificate_generate_standalone.sh. Admin email is also using for generate SSL certificates.

    Support

    Vendor support

    Please contact us through support@meetrix.io . Please allow up to 12 hours for our support team to address your request.

    AWS infrastructure support

    AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.

    Similar products

    Customer reviews

    Ratings and reviews

     Info
    0 ratings
    5 star
    4 star
    3 star
    2 star
    1 star
    0%
    0%
    0%
    0%
    0%
    0 AWS reviews
    No customer reviews yet
    Be the first to write a review for this product.