Amazon Elastic MapReduce Ruby Client

Sample Code & Libraries>Ruby>Amazon Elastic MapReduce Ruby Client
Community Contributed Software

  • Amazon Web Services provides links to these packages as a convenience for our customers, but software not authored by an "@AWS" account has not been reviewed or screened by AWS.
  • Please review this software to ensure it meets your needs before using it.

Download page for EMR's Ruby Command Line Interface. NOTE: EMR is moving to the Python-based AWS Command Line Interface soon (see info below).

Details

Submitted By: Richard@AWS
AWS Products Used: Amazon Elastic MapReduce
Languages(s): Ruby
License: Apache License 2.0
Created On: April 1, 2009 1:48 AM GMT
Last Updated: June 19, 2014 11:22 PM GMT
Download

EMR moving to the AWS CLI

EMR has added support for the AWS CLI. This is currently in preview mode but will become the default shortly. Click here for more information.

Installation for Ruby CLI

For information on how to install and configure the command line client, see Install the Amazon EMR Command Line Interface in the Amazon Elastic MapReduce Developer Guide.

Usage for Ruby CLI

For information about how to use the command line client to launch, terminate, modify, and investigate job flows, see Command Line Interface Options in the Amazon Elastic MapReduce Developer Guide.

Change Log for Ruby CLI

For information about the releases and changes in the CLI versions, see Command Line Interface Releases in the Amazon Elastic MapReduce Developer Guide.

Additional Documentation

The archive comes with a README file.

Comments

ruby bug
I'm getting this error when i try to run it, where can i make a bug report? elastic-mapreduce --help /usr/local/ec2/elastic-mapreduce-ruby/amazon/coral/httpdestinationhandler.rb:23: warning: else without rescue is useless /usr/local/ec2/elastic-mapreduce-ruby/amazon/coral/awsquery.rb:3:in `require': /usr/local/ec2/elastic-mapreduce-ruby/amazon/coral/httpdestinationhandler.rb:19: syntax error, unexpected ':', expecting keyword_then or ',' or ';' or '\n' (SyntaxError) /usr/local/ec2/elastic-mapreduce-ruby/amazon/coral/httpdestinationhandler.rb:36: syntax error, unexpected keyword_end, expecting $end from /usr/local/ec2/elastic-mapreduce-ruby/amazon/coral/awsquery.rb:3:in `' from /usr/local/ec2/elastic-mapreduce-ruby/amazon/coral/service.rb:5:in `require' from /usr/local/ec2/elastic-mapreduce-ruby/amazon/coral/service.rb:5:in `' from /usr/local/ec2/elastic-mapreduce-ruby/amazon/coral/elasticmapreduceclient.rb:3:in `require' from /usr/local/ec2/elastic-mapreduce-ruby/amazon/coral/elasticmapreduceclient.rb:3:in `' from /usr/local/ec2/elastic-mapreduce-ruby/elastic-mapreduce:7:in `require' from /usr/local/ec2/elastic-mapreduce-ruby/elastic-mapreduce:7:in `'
Tommy Chheng on August 16, 2010 7:52 PM GMT
ruby emr & json
This library was well built, but contains a few concerns for me. The lack of proper documentation and examples forced me to go to the actual amazon emr api to better understand how the library works. Also, if you take a closer look at the code, the JSON module and various methods are overwritten. Keep this in mind of you have implementations that rely on system or bundled json gems. Also, the library makes it extremely difficult to determine job flow and job flow step information since the responses returned are hashes within arrays within hashes where keys are string and camel cased. The implemenation would be much more DRY and concise if there were convenience methods to obtain information about job flows and steps. I will most likely work on refactoring this code for use internally. It's a great library, but be aware of the implementation and lack of documentation.
kennethcheung on July 8, 2010 4:48 PM GMT
Good tutorial...
a few things to clarify: for access_id: go to 'Accounts' -> 'Security Credentials' -> 'Access Keys' (its the 'Access Key ID' there) for private_key: from the above, click on 'Show' under 'Secret Access Key' to find that.
dammmitimmad on January 31, 2010 10:03 PM GMT
re:
I think the keypair in the credentials.json means the name of the key pair, such as gsg-keypair
yuangw on November 16, 2009 10:00 PM GMT
edit/fix for "Terminate a Job Flow" section
Minor edit: the "Terminate a Job Flow" section shows use of "elastic-map-reduce" client script, which should be "elastic-mapreduce" instead.
insights4sharethis on July 18, 2009 5:08 AM GMT
Credentials File Needs More Docs
This tutorial works flawlessly except I can't figur eout wht goes in the following fields: "keypair": "" "log_uri": "" Is keypair the path to a file or is it the actual keypair? I found the docs for log_uri so that ok, thought Include it in the comment... s3n:\/\/[bucket name]/lastfm/logs/ What is the keypair value? What goes there? HELP!
Paul Kenjora on April 29, 2009 7:35 PM GMT
We are temporarily not accepting new comments.
©2014, Amazon Web Services, Inc. or its affiliates. All rights reserved.