AWS HPC Blog
Category: High Performance Computing
Implementing e-mail and SMS notifications in AWS ParallelCluster with Slurm
Learn how to configure email and SMS alerts for job events to stay on top of your HPC workloads with AWS ParallelCluster using Slurm.
Gang scheduling pods on Amazon EKS using AWS Batch multi-node processing jobs
AWS Batch multi-node parallel jobs can now run on Amazon EKS to provide gang scheduling of pods across nodes for large scale distributed computing like ML model training. More details here.
Running FSI workloads on AWS with YellowDog
Financial services firms: we stress-tested YellowDog’s HPC environment to see if it could handle a 10m task batch at 3,000 tasks per second. Check out the results.
Improve HPC workloads on AWS for environmental sustainability
Need to cut your carbon footprint without sacrificing productivity? Migrating HPC workloads to the cloud allowed Baker Hughes to reduce emissions by 99%! Get tips for optimizing compute, storage, networking so you can do better.
Simulating autonomous mining operations using Robotec.ai on AWS
Big changes are underway in mining – see how the Boliden Group simulates fleets of autonomous trucks using AWS Batch – for safety and efficiency.
How vertical scaling and GPUs can accelerate mixed media modelling for marketing analytics
In marketing analytics, mixed media modeling (MMM) is a machine learning technique that combines information from various sources, like TV ads, online ads and social media to measure the impact of marketing and advertising campaigns. By using these techniques, businesses can make smarter decisions about where to invest their money for advertising, helping them get […]
Harnessing the scale of AWS for financial simulations
Struggling with long compute times for numerical simulations in finance? See how AWS makes it simple to leverage the cloud for large-scale financial modeling. We walk through a real example using QuantLib and Monte Carlo methods.
A library of HPC Applications Best Practices on AWS
Want insights on running HPC codes efficiently on AWS? Our HPC specialists compiled their know-how into a new public GitHub repo. Get best practices, templates, scripts and more to optimize your workloads.
Job queue snapshots: see what’s at the head of your queues in AWS Batch
AWS Batch just grew a neat new feature: Job queue snapshots. This gives you the visibility you need for managing throughput in a dynamic environment – with competing priorities – and across multiple queues and workloads. Today we give you the inside scoop on how this feature works – especially when you’re using fair share scheduling.
An agent-based simulation of Amazon’s inbound supply chain
Hundreds of millions of products, the entire *first-mile* of distribution – learn how Amazon simulated their massive US supply chain, end-to-end, with help from a company called Simudyne.