Amazon EMR Ruby Client (Deprecated)

Sample Code & Libraries>Amazon EMR Ruby Client (Deprecated)
Community Contributed Software

  • Amazon Web Services provides links to these packages as a convenience for our customers, but software not authored by an "@AWS" account has not been reviewed or screened by AWS.
  • Please review this software to ensure it meets your needs before using it.

Download page for EMR's Ruby Command Line Interface. NOTE: This is now deprecated. Please see below


Submitted By: Richard@AWS
AWS Products Used: Amazon Elastic MapReduce
Languages(s): Ruby
License: Apache License 2.0
Created On: April 1, 2009 1:48 AM GMT
Last Updated: January 9, 2015 11:42 PM GMT

EMR now available in the AWS CLI

You can download the AWS CLI here.

Ruby CLI (deprecated)

For information on how to install and configure the (deprecated) Ruby command line client, see Install the Amazon EMR Ruby Command Line Interface.


ruby bug
I'm getting this error when i try to run it, where can i make a bug report? elastic-mapreduce --help /usr/local/ec2/elastic-mapreduce-ruby/amazon/coral/httpdestinationhandler.rb:23: warning: else without rescue is useless /usr/local/ec2/elastic-mapreduce-ruby/amazon/coral/awsquery.rb:3:in `require': /usr/local/ec2/elastic-mapreduce-ruby/amazon/coral/httpdestinationhandler.rb:19: syntax error, unexpected ':', expecting keyword_then or ',' or ';' or '\n' (SyntaxError) /usr/local/ec2/elastic-mapreduce-ruby/amazon/coral/httpdestinationhandler.rb:36: syntax error, unexpected keyword_end, expecting $end from /usr/local/ec2/elastic-mapreduce-ruby/amazon/coral/awsquery.rb:3:in `' from /usr/local/ec2/elastic-mapreduce-ruby/amazon/coral/service.rb:5:in `require' from /usr/local/ec2/elastic-mapreduce-ruby/amazon/coral/service.rb:5:in `' from /usr/local/ec2/elastic-mapreduce-ruby/amazon/coral/elasticmapreduceclient.rb:3:in `require' from /usr/local/ec2/elastic-mapreduce-ruby/amazon/coral/elasticmapreduceclient.rb:3:in `' from /usr/local/ec2/elastic-mapreduce-ruby/elastic-mapreduce:7:in `require' from /usr/local/ec2/elastic-mapreduce-ruby/elastic-mapreduce:7:in `'
Tommy Chheng on August 16, 2010 7:52 PM GMT
ruby emr & json
This library was well built, but contains a few concerns for me. The lack of proper documentation and examples forced me to go to the actual amazon emr api to better understand how the library works. Also, if you take a closer look at the code, the JSON module and various methods are overwritten. Keep this in mind of you have implementations that rely on system or bundled json gems. Also, the library makes it extremely difficult to determine job flow and job flow step information since the responses returned are hashes within arrays within hashes where keys are string and camel cased. The implemenation would be much more DRY and concise if there were convenience methods to obtain information about job flows and steps. I will most likely work on refactoring this code for use internally. It's a great library, but be aware of the implementation and lack of documentation.
kennethcheung on July 8, 2010 4:48 PM GMT
Good tutorial...
a few things to clarify: for access_id: go to 'Accounts' -> 'Security Credentials' -> 'Access Keys' (its the 'Access Key ID' there) for private_key: from the above, click on 'Show' under 'Secret Access Key' to find that.
dammmitimmad on January 31, 2010 10:03 PM GMT
I think the keypair in the credentials.json means the name of the key pair, such as gsg-keypair
yuangw on November 16, 2009 10:00 PM GMT
edit/fix for "Terminate a Job Flow" section
Minor edit: the "Terminate a Job Flow" section shows use of "elastic-map-reduce" client script, which should be "elastic-mapreduce" instead.
insights4sharethis on July 18, 2009 5:08 AM GMT
Credentials File Needs More Docs
This tutorial works flawlessly except I can't figur eout wht goes in the following fields: "keypair": "" "log_uri": "" Is keypair the path to a file or is it the actual keypair? I found the docs for log_uri so that ok, thought Include it in the comment... s3n:\/\/[bucket name]/lastfm/logs/ What is the keypair value? What goes there? HELP!
Paul Kenjora on April 29, 2009 7:35 PM GMT
We are temporarily not accepting new comments.
©2017, Amazon Web Services, Inc. or its affiliates. All rights reserved.