Listing Thumbnail

    LLM WebUI on Amazon Linux 2 (x86-64) with support by Hfimg

     Info
    Sold by: HFAMI 
    Free Trial
    AWS Free Tier
    This product incurs charges for building, maintaining, and supporting the Amazon Machine Image (AMI). Text-generation-webui is an open-source project that provides a web-based user interface for managing and deploying large language models. It supports various model formats, allowing users to easily load, configure, and run different language models directly in their browsers. This tool is ideal for tasks such as model inference and chatbot development. The AMI is particularly well-suited for developers and researchers who wish to quickly test or deploy models.
    Listing Thumbnail

    LLM WebUI on Amazon Linux 2 (x86-64) with support by Hfimg

     Info
    Sold by: HFAMI 

    Overview

    This is a repackaged open source software product wherein additional charges apply for support and maintenance by Hfimg.

    Text-generation-webui is an open-source tool designed for managing and deploying large language models, offering the following functionalities and advantages:

    Functionality: 1.Model Inference and Generation: Text-generation-webui provides a web-based interface that allows users to load and run various language models (such as LLaMA, GPT, etc.) for tasks like text generation, dialogue creation, and content completion. 2.Model Management: Users can easily load, configure, and switch between different language models, supporting multiple model formats, which makes managing and debugging models more intuitive and convenient. 3.Real-time Interaction: It allows users to input text in real-time through the web interface and view the model's generated output, facilitating the debugging and optimization of model behavior.

    Advantages: 1.Ease of Use: Managing models through a web interface reduces the complexity, making it accessible to a broad user base, including researchers and developers, without requiring mastery of complex command-line operations. 2.Multi-model Support: It is compatible with various pre-trained models and formats, allowing users to test and compare different models' performance in a single interface, greatly enhancing work efficiency. 3.Flexible Extension: It supports plugins and extensions, enabling users to customize the interface and functionalities according to specific needs, thus catering to various application scenarios. 4.Lightweight Deployment: It can run without requiring high-end hardware and supports deployment on local machines or servers, with relatively low resource requirements, making it suitable for individual developers and small to medium-sized projects.

    Disclaimer: The respective trademarks mentioned in the offering are owned by the respective companies. We do not provide the commercial license of any of these products.Use of them does not imply any affiliation or endorsement.

    Highlights

    • Multi-model support and flexibility
    • Highly customizable and scalable
    • User-friendly interactive interface

    Details

    Sold by

    Delivery method

    Delivery option
    64-bit (x86) Amazon Machine Image (AMI)

    Latest version

    Operating system
    AmazonLinux 2

    Typical total price

    This estimate is based on use of the seller's recommended configuration (g5.xlarge) in the US East (N. Virginia) Region. View pricing details

    $1.065/hour

    Features and programs

    Financing for AWS Marketplace purchases

    AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.
    Financing for AWS Marketplace purchases

    Pricing

    Free trial

    Try this product at no cost for 5 days according to the free trial terms set by the vendor. Usage-based pricing is in effect for usage beyond the free trial terms. Your free trial gets automatically converted to a paid subscription when the trial ends, but may be canceled any time before that.

    LLM WebUI on Amazon Linux 2 (x86-64) with support by Hfimg

     Info
    Pricing is based on actual usage, with charges varying according to how much you consume. Subscriptions have no end date and may be canceled any time. Alternatively, you can pay upfront for a contract, which typically covering your anticipated usage for the contract duration. Any usage beyond contract will incur additional usage-based costs.
    Additional AWS infrastructure costs may apply. Use the AWS Pricing Calculator  to estimate your infrastructure costs.

    Usage costs (601)

     Info
    • ...
    Instance type
    Product cost/hour
    EC2 cost/hour
    Total/hour
    t1.micro
    $0.029
    $0.02
    $0.049
    t2.nano
    $0.00
    $0.006
    $0.006
    t2.micro
    AWS Free Tier
    $0.029
    $0.012
    $0.041
    t2.small
    $0.029
    $0.023
    $0.052
    t2.medium
    $0.059
    $0.046
    $0.105
    t2.large
    $0.059
    $0.093
    $0.152
    t2.xlarge
    $0.059
    $0.186
    $0.245
    t2.2xlarge
    $0.119
    $0.371
    $0.49
    t3.nano
    $0.00
    $0.005
    $0.005
    t3.micro
    AWS Free Tier
    $0.029
    $0.01
    $0.039

    Additional AWS infrastructure costs

    Type
    Cost
    EBS General Purpose SSD (gp3) volumes
    $0.08/per GB/month of provisioned storage

    Vendor refund policy

    We do not currently support refunds. The instance can be terminated at anytime to stop incurring charges.

    Legal

    Vendor terms and conditions

    Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA) .

    Content disclaimer

    Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.

    Usage information

     Info

    Delivery details

    64-bit (x86) Amazon Machine Image (AMI)

    Amazon Machine Image (AMI)

    An AMI is a virtual image that provides the information required to launch an instance. Amazon EC2 (Elastic Compute Cloud) instances are virtual servers on which you can run your applications and workloads, offering varying combinations of CPU, memory, storage, and networking resources. You can launch as many instances from as many different AMIs as you need.

    Version release notes

    Update to latest

    Additional details

    Usage instructions

    Connecting to Your Linux Instance: Connect to your Linux instance via port 22 using SSH. Please refer this article: https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/connect-to-linux-instance.html  Sign-in credentials: Username: ec2-user For additional step-by-step instructions, see the links provided. http://docs.hfami.info/WebUI_Amazonlinux2/ 

    Support

    Vendor support

    Email support is available directly at support@hfami.info 

    AWS infrastructure support

    AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.

    Similar products

    Customer reviews

    Ratings and reviews

     Info
    0 ratings
    5 star
    4 star
    3 star
    2 star
    1 star
    0%
    0%
    0%
    0%
    0%
    0 AWS reviews
    No customer reviews yet
    Be the first to write a review for this product.