Sold by: Together AI
Train, fine-tune, and run generative AI models faster, at a lower cost, and at a production scale.
Sold by: Together AI
Overview
Together AI makes it easy to run, fine-tune, and manage open-source and custom models, at the production scale. Our platform enables you to:
- Run serverless or on-demand models for more consistent traffic
- Scale with monthly reserved instances and VPC for larger deployments
- Fine-tune via API and deploy your fine-tuned model for inference
- Deploy the Together Enterprise Platform in your VPC on EKS with 2-3x faster inference and up to 50% GPU savings
- Manage, orchestrate, and optimize models in one place, achieving low latency and high accuracy for your use cases
What to expect after your purchase:
Once you complete your AWS Marketplace purchase, you will be directed to a form to share your account information. You will also be prompted to set up your account here: http://api.together.ai/ .
Once these steps are complete, our team will be in touch within 48 hours to load the purchased Together AI credits into the account you have created.
Highlights
- Run over 200 open-source and custom models available via autoscaling Serverless and Dedicated Instances, with private deployment options for enterprise security.
- Fine-tune generative AI models with your proprietary data and maintain ownership of your custom models.
- Enterprise-grade security and reliability with SOC 2, HIPAA compliance, and custom SLAs.
Details
Features and programs
Financing for AWS Marketplace purchases
AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.
Pricing
Pricing is based on the duration and terms of your contract with the vendor, and additional usage. You pay upfront or in installments according to your contract terms with the vendor. This entitles you to a specified quantity of use for the contract duration. Usage-based pricing is in effect for overages or additional usage not covered in the contract. These charges are applied on top of the contract price. If you choose not to renew or replace your contract before the contract end date, access to your entitlements will expire.
Dimension | Description | Cost/month |
|---|---|---|
$5,000 | $5,000 Together AI Consumption Units package | $5,000.00 |
$10,000 | $10,000 Together AI Consumption Units package | $10,000.00 |
$20,000 | $20,000 Together AI Consumption Units package | $20,000.00 |
Custom Together AI Units | Get started on Together AI with Custom Together AI Consumption Units | $1.00 |
Dimension | Description | Cost/unit |
|---|---|---|
additional_usage | additional usage | $1.00 |
Vendor refund policy
All fees are non-refundable and non-cancellable except as required by law.
Legal
Vendor terms and conditions
Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA) .
Content disclaimer
Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.
Delivery details
Software as a Service (SaaS)
SaaS delivers cloud-based software applications directly to customers over the internet. You can access these applications through a subscription model. You will pay recurring monthly usage fees through your AWS bill, while AWS handles deployment and infrastructure management, ensuring scalability, reliability, and seamless integration with other AWS services.
Resources
Vendor resources
Support
Vendor support
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.
Similar products
LibreChat on Ubuntu 24.04 - Self-Host ChatGPT
By Cloud Infrastructure Services
LibreChat is an enhanced ChatGPT clone that brings together the latest advancements in AI technology. It serves as a centralized hub for all your AI conversations, providing a familiar, user-friendly interface enriched with advanced features and customization capabilities.
SingleStore Helios
By SingleStore
Cloud Database as a Service
Sign up for Free Shared Tier: https://www.singlestore.com/cloud-trial?utmcampaign=aws-marketplace&utmmedium=organic&utm_source=aws
SingleStore Self-Managed Standard with IBM
By IBM Software
SingleStore Self-Managed with IBM is a distributed SQL database designed to power modern interactive applications, AI, and real-time analytics. SingleStore Self-Managed with IBM can power high-performance transactional (OLTP), analytical (OLAP) workloads together with vector capabilities (GenAI) in a single engine.
SentinelOne Singularity Platform
By SentinelOne
The First Security AI Platform to Protect the Entire Enterprise.
Break Down Security Silos. Gain Enterprise-Wide Visibility and Control. Action Your Data In Real-time with AI.
One intelligent platform. Unprecedented speed. Infinite scale. Singularity™ enables unfettered visibility, industry-leading detection, and autonomous response. Discover the power of AI-powered, enterprise-wide cybersecurity. Enterprise security across endpoints, cloud, and identity, backed by a unified data lake, and with the power of Purple AI.
Customer reviews
Yash K.
Together AI provides many open source models and GPUs .
Reviewed on Nov 19, 2024
Review provided by G2
What do you like best about the product?
It has all the open source models deployed on their server, so i can try directly access with the help of API key and some models are even free.
What do you dislike about the product?
They should provide more free models to access.
What problems is the product solving and how is that benefiting you?
So i use the open source models from together to fine tune the llm on my own data and it is very cost efficiently.
Leave a comment0 comments
Md S.
Performance, Accuracy and production master at one place
Reviewed on Sep 11, 2024
Review provided by G2
What do you like best about the product?
The best thing I like about Together AI is 100% accurate most of the time. It performs best without losing accuracy. It scales with utmost models. And it works on faster way with almost 400 tokens/sec
What do you dislike about the product?
I don't see much disadvantage when it was implemented for our project. But it is sometimes slow which I have observed on long searched values. But it can be neglected with accuracy.
What problems is the product solving and how is that benefiting you?
Since we have the demand for qualitative implementation of best visuals in our project. And what we saw it uses optimised MHA and GEMMs implementation. 10× specexec innovation as per documentation which is yet to be implemented.