Listing Thumbnail

    EXAONE_v3.0 7.8B Instruct

     Info
    Sold by: LG CNS 
    Deployed on AWS
    The first open model in the family of Large Language Models (LLMs) developed by LG AI Research.

    Overview

    EXAONE stands for EXpert AI for EveryONE, a vision that LG is committed to realizing in order to democratize access to expert-level artificial intelligence capabilities. What makes the EXAONE 3.0 truly revolutionary is its integration of advanced deep learning algorithms that enable dynamic adaptation to evolving data sets. This flexibility ensures ongoing improvements in the system's predictive analytics and decision-making abilities, establishing a new standard for AI models. LG AI Research plans to continue enriching the EXAONE’s capabilities by incorporating data from over 100 million sources across disciplines like law, biology, medicine, and education. With diverse model scales tailored to different applications, EXAONE promises to revolutionize the AI landscape and drive innovation across industries.

    Highlights

    • **Excellent Performance in Korean ** EXAONE 3.0 has a competitive overall performance in English against the comparison models, smaller than 20B while it shows an excellent performance in Korean. The EXAONE language model is a bilingual model trained mainly on English and Korean. As trace amounts of other languages are also included in the training data, output content can be generated in other languages, but the performance is very limited.**
    • **Rigorous Data Compliance** LG AI Research conducts AI Compliance reviews throughout the entire process of data collection, AI model training, and information provision. Each training dataset is subjected to a licensing review process. After this review, the AI model is trained using the approved data. Subsequently, a data risk assessment is conducted to establish the criteria for the AI model’s distribution. The language model, developed pursuant to this robust compliance system, distinctly omits legally precarious data such as news articles and books.
    • **Trustworthy AI through Responsible Practices** We have strived to develop and deploy EXAONE models responsibly in accordance with the LG AI Ethics Principles. Throughout the entire model development process, we performed an AI ethics impact assessment to mitigate potential risks and create a reliable model. We have followed the LG AI Ethics Principles to ensure the responsible development and deployment of the EXAONE 3.0 7.8B instruction-tuned model. We focused on improving the model’s safety and maintaining high ethical standards throughout the development process.

    Details

    Sold by

    Delivery method

    Latest version

    Deployed on AWS

    Unlock automation with AI agent solutions

    Fast-track AI initiatives with agents, tools, and solutions from AWS Partners.
    AI Agents

    Features and programs

    Financing for AWS Marketplace purchases

    AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.
    Financing for AWS Marketplace purchases

    Pricing

    EXAONE_v3.0 7.8B Instruct

     Info
    Pricing is based on actual usage, with charges varying according to how much you consume. Subscriptions have no end date and may be canceled any time.
    Additional AWS infrastructure costs may apply. Use the AWS Pricing Calculator  to estimate your infrastructure costs.

    Usage costs (2)

     Info
    Dimension
    Description
    Cost/host/hour
    ml.g5.2xlarge Inference (Batch)
    Recommended
    Model inference on the ml.g5.2xlarge instance type, batch mode
    $3.197
    ml.g5.4xlarge Inference (Real-Time)
    Recommended
    Model inference on the ml.g5.4xlarge instance type, real-time mode
    $4.283

    Vendor refund policy

    Please note that all sales of this product/service are final. We do not offer refunds, exchanges, or cancellations. By completing your purchase, you acknowledge and agree that all fees are non-refundable.

    How can we make this page better?

    We'd like to hear your feedback and ideas on how to improve this page.
    We'd like to hear your feedback and ideas on how to improve this page.

    Legal

    Vendor terms and conditions

    Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA) .

    Content disclaimer

    Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.

    Usage information

     Info

    Delivery details

    Amazon SageMaker model

    An Amazon SageMaker model package is a pre-trained machine learning model ready to use without additional training. Use the model package to create a model on Amazon SageMaker for real-time inference or batch processing. Amazon SageMaker is a fully managed platform for building, training, and deploying machine learning models at scale.

    Deploy the model on Amazon SageMaker AI using the following options:
    Deploy the model as an API endpoint for your applications. When you send data to the endpoint, SageMaker processes it and returns results by API response. The endpoint runs continuously until you delete it. You're billed for software and SageMaker infrastructure costs while the endpoint runs. AWS Marketplace models don't support Amazon SageMaker Asynchronous Inference. For more information, see Deploy models for real-time inference  .
    Deploy the model to process batches of data stored in Amazon Simple Storage Service (Amazon S3). SageMaker runs the job, processes your data, and returns results to Amazon S3. When complete, SageMaker stops the model. You're billed for software and SageMaker infrastructure costs only during the batch job. Duration depends on your model, instance type, and dataset size. AWS Marketplace models don't support Amazon SageMaker Asynchronous Inference. For more information, see Batch transform for inference with Amazon SageMaker AI  .
    Version release notes

    EXAONE v3.0.0 demonstrates highly competitive real-world performance with instruction-following capability against other state-of-the-art open models of similar size. Our comparative analysis shows that EXAONE v3.0.0 excels particularly in Korean, while achieving compelling performance across general tasks and complex reasoning.

    Additional details

    Inputs

    Summary

    The model accepts JSON requests with parameters that can be used to control the generated text. See examples and fields descriptions below.

    Input MIME type
    application/json
    { "text_input": Explain who you are, "max_tokens": 128, "temperature": 0.7, "top_k": 50, "top_p": 0.9 }
    https://github.com/LG-AI-EXAONE/EXAONE-Examples/blob/main/EXAONE_Text_Generation_AWS_Marketplace.ipynb

    Input data descriptions

    The following table describes supported input data fields for real-time inference and batch transform.

    Field name
    Description
    Constraints
    Required
    text_input
    Prompt text
    Type: FreeText
    Yes
    max_tokens
    number of tokens to generate
    Type: Integer Maximum: 4096
    Yes
    temperature
    Sampling Config param: temperature
    Default value: 0.7 Type: Continuous
    No
    top_k
    The number of highest probability vocabulary tokens to keep for top-k-filtering.
    Default value: 50 Type: Integer
    No
    top_p
    If set to < 1, only the smallest set of most probable tokens with probabilities that add up to top_p or higher are kept for generation.
    Default value: 1 Type: Continuous
    No

    Support

    Vendor support

    For inquiries regarding further performance improvement or collaboration for service applications, please contact us via email (contact_us@lgresearch.ai ). For inquiries regarding technical support, please create a new issue in our GitHub repository. https://github.com/LG-AI-EXAONE/EXAONE-Examples 

    AWS infrastructure support

    AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.

    Customer reviews

    Ratings and reviews

     Info
    0 ratings
    5 star
    4 star
    3 star
    2 star
    1 star
    0%
    0%
    0%
    0%
    0%
    0 AWS reviews
    No customer reviews yet
    Be the first to review this product . We've partnered with PeerSpot to gather customer feedback. You can share your experience by writing or recording a review, or scheduling a call with a PeerSpot analyst.