AWS Compute Blog

Category: AWS Batch

Deploy an 8K HEVC pipeline using Amazon EC2 P3 instances with AWS Batch

Contributed by Amr Ragab, HPC Application Consultant, AWS Professional Services AWS provides several managed services for file- and streaming-based media encoding options. Amazon Elastic Transcoder and AWS Elemental MediaConvert each provide several options for video/audio transcoding, optimized for various client devices. AWS Elemental Live provides online streaming-based encoding from edge camera devices. Through AWS Greengrass, edge […]

Read More

Using AWS CloudFormation to Create and Manage AWS Batch Resources

This post courtesy of Arya Hezarkhani. AWS CloudFormation allows developers and systems administrators to easily create and manage a collection of related AWS resources (called a CloudFormation stack) by provisioning and updating them in an orderly and predictable way. CloudFormation users can now deploy and manage AWS Batch resources in exactly the same way that […]

Read More

Building High-Throughput Genomics Batch Workflows on AWS: Workflow Layer (Part 4 of 4)

Aaron Friedman is a Healthcare and Life Sciences Partner Solutions Architect at AWS Angel Pizarro is a Scientific Computing Technical Business Development Manager at AWS This post is the fourth in a series on how to build a genomics workflow on AWS. In Part 1, we introduced a general architecture, shown below, and highlighted the […]

Read More

Building High-Throughput Genomic Batch Workflows on AWS: Batch Layer (Part 3 of 4)

Aaron Friedman is a Healthcare and Life Sciences Partner Solutions Architect at AWS Angel Pizarro is a Scientific Computing Technical Business Development Manager at AWS This post is the third in a series on how to build a genomics workflow on AWS. In Part 1, we introduced a general architecture, shown below, and highlighted the […]

Read More

Deep Learning on AWS Batch

Thanks to my colleague Kiuk Chung for this great post on Deep Learning using AWS Batch. —- GPU instances naturally pair with deep learning as neural network algorithms can take advantage of their massive parallel processing power. AWS provides GPU instance families, such as g2 and p2, which allow customers to run scalable GPU workloads. You […]

Read More

Creating a Simple “Fetch & Run” AWS Batch Job

Updated on April 26, 2018 to reflect changes in IAM create role process. Dougal Ballantyne, Principal Product Manager – AWS Batch Docker enables you to create highly customized images that are used to execute your jobs. These images allow you to easily share complex applications between teams and even organizations. However, sometimes you might just […]

Read More