Offload Ruby Background Jobs to Amazon EC2 instances using Amazon SWF

Posted on: Jan 22, 2015

Amazon SWF helps developers build, run, and scale background jobs that have parallel or sequential steps. If your app's steps take more than 500 milliseconds to complete, you need to track the state of processing, and you need to recover or retry if a task fails, Amazon SWF can help you.

It’s now easier to offload Ruby background jobs to Amazon EC2 instances, including Elastic Beanstalk workers, using Amazon SWF. This allows you to run long-running or compute-intensive tasks as SWF activities, and reliably process them on separate compute instances that are easy to maintain and scale.

When you use Amazon SWF to separate background jobs from the rest of your application, you can increase the reliability of those jobs and improve the responsiveness of your primary business logic. Amazon SWF also provides guaranteed delivery, automatic retries, and detailed auditing. Using Elastic Beanstalk to manage your worker instances simplifies deploying, configuring, and operating compute capacity to process your jobs.

To learn more, visit Getting Started in the AWS Flow Framework for Ruby Developer Guide. To learn more about using Amazon EC2 instances as worker instances, check out the Ruby Runner utility.