How do I assign a static private IP address to the primary node of my Amazon EMR cluster?
I want to create a static private IP address and use a bootstrap action to associate it with the primary node of an Amazon EMR cluster.
Resolution
To create a static private IP address and use a bootstrap action to associate the IP address with your cluster's primary node, complete the following steps:
- Confirm that your AWS Identity and Access Management (IAM) policy allows EMR_EC2_DefaultRole and ec2:AssignPrivateIpAddresses permissions.
- Sign in to GitHub.
- Download the assign_private_ip.py script from AWS Labs.
- Save the script in an Amazon Simple Storage Service (Amazon S3) bucket.
- Specify the script as a custom bootstrap action, and then use the script to launch an Amazon EMR cluster. You can also run the script as an Amazon EMR step.
Note: The assign_private_ip.py script requires an argument that's a private IP address from the CIDR range of your subnet. The script attaches that private IP address to the network interface (eth0) of the primary node. The script also configures the network settings to redirect all traffic from the secondary IP address to the primary IP address. The script requires a private IP address and the cluster's AWS Region. It uses the s3://BUCKET_NAME/assign_private_ip.py PRIVATE_IP us-east-1 format. The us-east-1 Region is an example. - To find the new IP address, open the Amazon Elastic Compute Cloud (Amazon EC2) console. Then, select the EC2 instance that acts as the primary node of the EMR cluster. The new IP address appears on the Networking tab, in the Secondary private IPs field.
Related information
How do I determine whether to use a bootstrap action or a step on an Amazon EMR cluster?
Just one correction in the above steps,
When you pass the Bootstrap Action script, it requires to two input arguments. If missing any one of below might cause index out of range exception in BA failure.
- Private IP address
- Region where the cluster gets deployed.
Example:
s3://<bucket-name>/assign_private_ip.py <your private IP> us-east-1
Thank you for your comment. We'll review and update the Knowledge Center article as needed.
Thanks for the update
The assign_private_ip.py is outdated - does not support EMR 7.0.0. on Amazon Linux 2023: IMDSv2 not implemented.
Thank you for your comment. We'll review and update the Knowledge Center article as needed.
Relevant content
- asked 3 years ago
- asked 10 months ago
- AWS OFFICIALUpdated a year ago
- AWS OFFICIALUpdated 8 months ago
- AWS OFFICIALUpdated a year ago
- AWS OFFICIALUpdated 2 years ago
