Sold by: X-ScaleSolutions
Deployed on AWS
Free Trial
X-ScaleAI is a high-performance solution for distributed pre-training, fine-tuning, and inference. It is an end-to-end optimized software stack providing optimal out-of-the-box performance with single-command execution. It includes an easy-to-use API to easily and reliably scale up AI workloads.
Overview
X-ScaleAI provides an optimized and integrated software stack for high-performance distributed pre-training, fine-tuning, and inference. We support any model defined in PyTorch or HuggingFace, including Large Language Models such as Llama-3, OLMo, Pythia, and BERT and Vision Models such as ResNet, U-Net, ViT and Stable Diffusion. You can also define your own model and your own dataset. Leave the headache of scaling up your AI workloads to us, and focus on your domain-specific strengths.
The end-to-end optimized software stack in X-ScaleAI provides out-of-the-box optimal performance for distributed AI workloads. It has a proprietary MVAPICH MPI implementation that has been tuned for the Elastic Fabric Adapter (EFA) instances on AWS. It comes with a very simple one-command launcher, xscale-ai-run, that significantly simplifies launching a distributed training workload on a AWS parallel cluster. No more complex commands and suboptimal performance.
X-ScaleAI also provides an easy-to-use API to easily scale up your AI workloads. The API automatically applies various optimizations pertaining to distributed data loading and training. It provides scalable model checkpoint and restart support for long-running training and fine-tuning applications. Use X-ScaleAI and save time and effort involved in getting a distributed AI set up and optimized. Reduce your carbon footprint and time to solution by using our optimized stacks.
Highlights
- Leave the headache of scaling up your AI workloads to us, and focus on your domain-specific strengths.
- Use X-ScaleAI and save time and effort involved in getting a distributed AI setup in place and scaling up your AI workloads.
- Reduce your carbon footprint and time to solution by using our optimized stacks.
Details
Sold by
Categories
Delivery method
Delivery option
64-bit (x86) Amazon Machine Image (AMI)
Latest version
Operating system
Ubuntu 24.04
Deployed on AWS
New
Introducing multi-product solutions
You can now purchase comprehensive solutions tailored to use cases and industries.
Features and programs
Financing for AWS Marketplace purchases
AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.
Pricing
Free trial
Try this product free for 5 days according to the free trial terms set by the vendor. Usage-based pricing is in effect for usage beyond the free trial terms. Your free trial gets automatically converted to a paid subscription when the trial ends, but may be canceled any time before that.
Pricing is based on actual usage, with charges varying according to how much you consume. Subscriptions have no end date and may be canceled any time.
Additional AWS infrastructure costs may apply. Use the AWS Pricing Calculator to estimate your infrastructure costs.
Dimension | Cost/hour |
|---|---|
g4dn.2xlarge Recommended | $0.45 |
g4dn.12xlarge | $2.35 |
g4dn.16xlarge | $2.61 |
g4dn.xlarge | $0.32 |
g4dn.4xlarge | $0.72 |
g4dn.metal | $4.69 |
g4dn.8xlarge | $1.31 |
Dimensions summary
You pay by the hour based on the GPU instance size you run. All seven options use the g4dn instance family, so the software runs the same across each. Pricing scales with the instance size you select, from g4dn.xlarge up through larger multi-GPU sizes like g4dn.12xlarge and g4dn.16xlarge, plus the bare-metal g4dn.metal option. You choose the size that matches your workload. Billing is usage-based, so you are charged only for the hours each instance runs. No upfront commitment applies.
Top-of-mind questions for buyers
Each option maps to a different g4dn instance size, which controls GPU count, CPU, and memory. Sizes range from g4dn.xlarge with one GPU up to g4dn.16xlarge and the bare-metal g4dn.metal with more GPUs. The software is identical; you pick the size matching your training or inference workload.
Charges accrue per instance-hour while the instance runs. Stopping an instance halts the hourly software charge. Note that stopped instances may still incur underlying AWS storage fees for attached volumes, but the X-ScaleAI software meters running time only. There is no upfront commitment.
Yes. X-ScaleAI supports distributed training and inference across GPU clusters using a CUDA-aware MPI library. Each running instance is billed separately at its own hourly rate. Running multiple instances means each one accrues charges for the hours it runs. Deployment works through container tools and orchestration systems.
x-scalesolutions.com
Helpful?
Vendor refund policy
We do not currently support refunds, but you can cancel at any time.
Legal
Vendor terms and conditions
Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA) .
Content disclaimer
Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.
Delivery details
64-bit (x86) Amazon Machine Image (AMI)
Amazon Machine Image (AMI)
An AMI is a virtual image that provides the information required to launch an instance. Amazon EC2 (Elastic Compute Cloud) instances are virtual servers on which you can run your applications and workloads, offering varying combinations of CPU, memory, storage, and networking resources. You can launch as many instances from as many different AMIs as you need.
Version release notes
- Optimized and integrated software stack for high-performance distributed training.
Additional details
Usage instructions
To use the X-ScaleAI AMI, you must first launch an instance. Our AMI supports standard instances and AWS ParallelCluster. After launching your instance, you can connect via SSH using ubuntu as the username.
Once you have connected to the instance, we provide a user guide in the /home/ubuntu/xscale_ai directory. This guide will provide the necessary instructions on how to run applications using xscale-ai-run and how to optimize your applications using the X-ScaleAI software stack and our custom API.
If you do have more questions, please reach out to us at contactus@x-scalesolutions.com .
Support
Vendor support
Our support email id is contactus@x-scalesolutions.com . Please let us know if you have any questions. There is also a user guide (~/x-scaleai/userguide.md) in the AMI.
We also offer custom support contracts to assist you in achieving the best performance and scaling of your distributed AI workloads on AWS and also on other cloud providers and even on-premise clusters. Please email us at contactus@x-scalesolutions.com , if you are interested. We would be happy to work with you.
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.
Similar products
Scale GenAI Platform accelerates the path to safe, highly performant, and lower-cost production deployment by embedding innovative test & evaluation technology throughout the development lifecycle.
Scale GenAI Platform accelerates the path to safe, highly performant, and lower-cost production deployment by embedding innovative test & evaluation technology throughout the development lifecycle.
Donovan is a platform built for government organizations to deploy AI and accelerate decision-making. Donovan uncovers insights, and expedite traditional workflows to achieve mission success.
Want to learn more about how to build your Generative AI with best practices and scale its development on AWS? This is a free, 60-minute consultation with one of Mission Cloud's AI Specialists to discuss your ideas, concerns, and needs.
Customer reviews
No customer reviews yet
Be the first to review this product . We've partnered with PeerSpot to gather customer feedback. You can share your experience by writing or recording a review, or scheduling a call with a PeerSpot analyst.