How do I use Instance Scheduler with CloudFormation to schedule EC2 instances?

8 minute read
0

I want to use the AWS Instance Scheduler with AWS CloudFormation to schedule Amazon Elastic Compute Cloud (Amazon EC2) instances.

Short description

Use CloudFormation templates to automate the deployment of the AWS Instance Scheduler.

Important: If you use the Instance Scheduler for EC2 instances with an encrypted Amazon Elastic Block Store (Amazon EBS), then your instances can't be started. To start your instances, you must grant the Instance Scheduler a key user role with a key policy to encrypt or decrypt EBS volumes. You must add the key policy to the AWS Key Management Service (AWS KMS) key to allow the key user role to use this key.

Resolution

Install the Instance Scheduler

If you haven't already done so, follow the instructions to install the Instance Scheduler command line interface (CLI).

To verify that the installation is successful, run the following command:

$ scheduler-cli --version

Create a CloudFormation stack with the Instance Scheduler template

The stack deploys an AWS Lambda function, an Amazon DynamoDB table, an Amazon EventBridge rule, and Amazon CloudWatch custom metrics.

  1. Open the AWS Management Console.
  2. Open CloudFormation with the Instance Scheduler template. Or, go to the Step 1. Launch the instance scheduler hub stack page, and choose Launch Solution.
    Note: The template is launched in the US East (N. Virginia) Region by default.
  3. In the navigation bar, select the AWS Region where you want to launch your stack with the template, and then choose Next.
  4. For Stack name, name your stack.
  5. For Instance Scheduler TagName, you can keep the default value as Schedule, or customize it.
  6. For Frequency, choose a frequency in minutes to run your scheduler. For example, you can choose 5 minutes.
    Note: The frequency is the number of minutes that pass before EventBridge initiates the Lambda function again for the Instance Scheduler. If you have a large number of instances, then use the highest frequency possible to avoid throttling. If the frequency isn't often enough for your needs, then you can adjust the Frequency property later.
  7. For Enable CloudWatch Metrics, choose Yes.
  8. For Enable CloudWatch Logs, choose Yes.
  9. (Optional) For Started tags, enter state=started.
  10. (Optional) For Stopped tags, enter state=stopped.
  11. For cross-account scheduling, provide the Cross-account roles parameter. Put in the ARNs for every role from the secondary accounts, separated by commas. If you aren't using cross-account scheduling, then leave the parameter empty.
  12. For all other parameters, customize the stack for your needs.
  13. Choose Next.
  14. On the Options page, choose Next.
  15. Review your settings, and then select I acknowledge that AWS CloudFormation might create IAM resources.
  16. Choose Create.

Create the periods

To create periods, you can use the Instance Scheduler CLI, DynamoDB console, or custom resources. For more information on time periods, see Start and stop times.

The following example shows you how to create instances that:

  • Start at 9 AM and stop at 5 PM on Monday through Friday
  • Start at 9 AM and stop at 12 PM on Saturday

For this example, you must create two periods. For your own scenario, create the appropriate number of periods.

Using the Instance Scheduler CLI

Connect to the Instance Scheduler CLI, and then run the following commands:

$ scheduler-cli create-period --stack your\_stack\_name --region eu-west-1 --name mon-fri-9-5 --begintime 9:00 --endtime 16:59 --weekdays mon-fri  
  
$ scheduler-cli create-period --stack your\_stack\_name --region eu-west-1 --name sat-9-12 --begintime 9:00 --endtime 11:59 --weekdays sat

Note: Replace your_stack_name with the stack name that you chose in step 4 and eu-west-1 with your own Region.
Using the DynamoDB console

  1. Open the DynamoDB console.
  2. Choose Tables, and then choose the configuration table.
    Note: The Instance Scheduler template automatically creates two DynamoDB tables: state and configuration. The state table stores the state of instances that the template stops and starts. The configuration table allows you to specify the periods and schedules for your requirements.
  3. Choose Explore Table Items.
  4. Choose Create Item.
  5. Choose the JSON view, and then use the following JavaScript object notation (JSON) template:
{  
  "type": {  
    "S": "period"  
  },  
  "name": {  
    "S": "mon-fri-9-5"  
  },  
  "begintime": {  
    "S": "9:00"  
  },  
  "endtime": {  
    "S": "16:59"  
  },  
  "weekdays": {  
    "SS": \[  
      "mon-fri"  
    \]  
  }  
}

Note: The preceding JSON template creates the first period. Use a similar JSON template for the second period. Make sure to edit the templates for your requirements.

Create a schedule

To create a schedule, you can use the Instance Scheduler CLI, DynamoDB console, or custom resources.

Using the Instance Scheduler CLI

Run the following command:

$ scheduler-cli create-schedule --stack your\_stack\_name --name m-f9-5-sat9-12 --region eu-west-1 --periods mon-fri-9-5,sat-9-12 --timezone UTC

Using the DynamoDB console

  1. Open the DynamoDB console.
  2. Choose Tables, and then choose the configuration table.
  3. Choose Explore Table Items.
  4. Choose Create Item.
  5. Choose the JSON view, and then use the following JSON template:
{  
  "type": {  
    "S": "schedule"  
  },  
  "name": {  
    "S": "m-f9-5-sat9-12"  
  },  
  "timezone": {  
    "S": "UTC"  
  },  
  "periods": {  
    "SS": \[  
      "mon-fri-9-5"  
    \]  
  }  
}

Tag the instance and test the schedule

When you use a CloudFormation stack with the Instance Scheduler, you must define the Instance Scheduler TagName parameter. The default value for this parameter is Schedule.

The Instance Scheduler monitors tags on instances. If the instance tag key matches the defined scheduler tag, then the Instance Scheduler applies the schedule that's set for the instance tag value. For example, a tag's key is set to Schedule and the value is set to m-f9-5-sat9-12. In this example, the instances start at 9 AM and stop at 5 PM on Monday through Friday. The instances also start at 9 AM and stop at 12 PM on Saturday.

Note: Tag keys and values are case sensitive. The Instance Scheduler doesn't stop running instances if they're manually started outside of the running period. The Instance Scheduler also doesn't start an instance if the instance is stopped manually during the running period, unless the schedule is enforced. For more information, see Schedule definitions.

Use predefined schedules

In addition to custom schedules, you can also use any of the predefined schedules from the configuration table. For example, the following steps test the predefined schedule named running:

  1. Open the Amazon EC2 console.
  2. Choose the stopped instances that you want to tag.
  3. Choose the Tags view, and then choose Manage Tags.
  4. Choose Add Tag.
  5. For Key, enter Schedule.
  6. For Value, enter running.
  7. Choose Save.
  8. Refresh the Amazon EC2 console, and then wait for the Lambda function to be initiated.
    Note: When the Lambda function is initiated and runs without errors, then the Instance State displays as running, depending on the schedule that you're testing. In the CloudWatch console, you can check Lambda metrics for invocations and errors.
  9. Open the DynamoDB console.
  10. Choose Tables, and then choose the state table.
  11. Choose the Explore Table Items and confirm that the tagged instance is started. The state data is stored in the state table.
    Important: You can be charged additional costs based on the frequency and duration of the Lambda function that you're using. You can also be charged additional costs for the DynamoDB tables or EventBridge rules that you create.

For cross-account scheduling: Launch the remote stack in secondary accounts

To schedule instances in secondary accounts using the Instance Scheduler, deploy the aws-instance-scheduler-remote CloudFormation template. This template creates the role that allows the Instance Scheduler from the primary account to manage instances in the secondary account.

Note: You must provide the role's ARN as a parameter for the Instance Scheduler stack in the primary account. Make sure to create or update your Instance Scheduler stack with the correct parameter.

  1. Open the AWS Management Console of the secondary account and launch the aws-instance-scheduler-remote CloudFormation template. You can also download the template for future use.
    Note: The template is launched in the US East (N. Virginia) Region by default.
  2. In the navigation bar, select the AWS Region where you want to launch your stack with the template, and then choose Next.
  3. On the Select Template page, verify that you selected the correct template, and then choose Next.
  4. On the Specify Details page, assign a name to your remote stack.
  5. Under Parameters, review and modify the Primary account parameter. Put in the account number of the primary account.
  6. Choose Next.
  7. On the Options page, choose Next.
  8. Review your settings, and then select I acknowledge that AWS CloudFormation might create IAM resources.
  9. Choose Create.
  10. Choose the stack Outputs tab, and then copy the CrossAccountRole value.
  11. From the primary account, choose your CloudFormation stack, and then choose Update.
  12. On the Update stack page, choose Use current template.
  13. In the Cross-account roles parameter, paste the CrossAccountRole value.
  14. Choose Next, and then select I acknowledge that AWS CloudFormation might create IAM resources.
  15. Choose Update Stack.
AWS OFFICIAL
AWS OFFICIALUpdated a year ago
2 Comments

BEWARE that this post contains inconsistent link URLs. In step 2 it says "Open CloudFormation with the Instance Scheduler template." where both "CloudFormation" and "template" are hyperlinks. The problem is that the former links to CloudFormation set to use a template at https://s3.amazonaws.com/solutions-reference/aws-instance-scheduler/latest/instance-scheduler.template whereas it seems that the template is actually at https://s3.amazonaws.com/solutions-reference/aws-instance-scheduler/latest/aws-instance-scheduler.template i.e. ".../instance-scheduler.template" vs ".../aws-instance-scheduler.template"

They both give you a valid bit of data back so it's not obvious you've got a bad URL. The former gives you a really old copy ... which you'll think is the latest until you find the new one and then realise it's a subtly different URL that contains a newer version :-/

PJD
replied a year ago

Thank you for your comment. We'll review and update the Knowledge Center article as needed.

profile pictureAWS
MODERATOR
replied a year ago