Overview
This is a repackaged open-source software product wherein additional charges apply for technical support and maintenance by Apps4Rent.
Llama 2 is an open-source project. This means Meta is publishing the entire model so anyone can use it to build new models or applications. Llama 2 is a large language model which has been trained on a vast dataset of publicly available internet data, enjoying the advantage of a dataset both more recent and more diverse.
Gradio is the fastest way to demo your machine learning model with a friendly web interface so that anyone can use it, anywhere. Gradio allows you to build demos and share them, all in Python. And usually in just a few lines of code.
Disclaimer: The respective trademarks mentioned in the offering are owned by the respective companies. We do not provide the commercial license of any of these products. Many of the products have a free, demo or Open-Source license as applicable. Image may take up to 5-7 minutes for initial launch.
Highlights
- Apps4Rent provides Llama2-7B and Gradio which is ready to use for Production Environment.
- Apps4Rent is offering "Pack of 2 product" (2 software's on a single machine) at an affordable price point of USD 0.1/hour (any vCPU).
- For any custom build AMI's of your choice contact us on "support@apps4rent.com"
Details
Typical total price
$0.292/hour
Features and programs
Financing for AWS Marketplace purchases
Pricing
- ...
Instance type | Product cost/hour | EC2 cost/hour | Total/hour |
|---|---|---|---|
t1.micro | $0.10 | $0.02 | $0.12 |
t2.nano | $0.10 | $0.006 | $0.106 |
t2.micro AWS Free Tier | $0.10 | $0.012 | $0.112 |
t2.small | $0.10 | $0.023 | $0.123 |
t2.medium | $0.10 | $0.046 | $0.146 |
t2.large | $0.10 | $0.093 | $0.193 |
t3.nano | $0.10 | $0.005 | $0.105 |
t3.micro AWS Free Tier | $0.10 | $0.01 | $0.11 |
t3.small | $0.10 | $0.021 | $0.121 |
t3.medium | $0.10 | $0.042 | $0.142 |
Additional AWS infrastructure costs
Type | Cost |
|---|---|
EBS General Purpose SSD (gp2) volumes | $0.10/per GB/month of provisioned storage |
Vendor refund policy
Apps4Rent does not offer commercial licenses of any of the products mentioned above. The products come with open-source licenses.
Legal
Vendor terms and conditions
Content disclaimer
Delivery details
64-bit (x86) Amazon Machine Image (AMI)
Amazon Machine Image (AMI)
An AMI is a virtual image that provides the information required to launch an instance. Amazon EC2 (Elastic Compute Cloud) instances are virtual servers on which you can run your applications and workloads, offering varying combinations of CPU, memory, storage, and networking resources. You can launch as many instances from as many different AMIs as you need.
Version release notes
Gradio release note: https://github.com/gradio-app/gradio/releases Python release note: https://www.python.org/downloads/release/python-3113/ Conda release notes: https://github.com/conda/conda/releases/tag/23.5.2 Git release notes: https://docs.github.com/en/repositories/releasing-projects-on-github/automatically-generated-release-notes
Additional details
Usage instructions
*For Linux: *Connect to your Linux instance via port no. 22 using SSH. *Please refer this article: https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/AccessingInstancesLinux.html *Sign-in credentials: Username: ubuntu
*To see the Llama2-7b installed directories follow the commands:
Get access to the machine using SSH. Become a super user: sudo su Locate the installed Llama2-7b directory: cd llama To list down the files inside Llama directory: ls To see the hidden Files aswell: ls -la
*Dependencies Version check:
To check Git version: git --version (2.25.1) To check Python version: python3 --version (3.11.3) To check Conda version: conda --version (23.5.2)
*Following are the steps to verify the version as well as installation of Gradio: Step i) Once you are logged into the instance, update the instance with sudo apt-get update. Step ii) Next run, source my-env/bin/activate. The given command is for activating the virtual environment 'my-env' created to install Gradio. Step iii) Run the command below inside the my-env: pip show gradio Step iv) To exit from the my-env, type deactivate and enter.
*Below are the minimum external resources subscriber needs to have to use this product: i)An Internet Connection is required for this product to function as expected. ii)We recommend keeping your crucial data in a custom made encrypted EBS to save from termination in future.
Support
Vendor support
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.
Similar products
