AWS Open Source Blog

New! Open Distro for Elasticsearch’s Job Scheduler Plugin

中文版 – Open Distro for Elasticsearch’s JobScheduler plugin provides a framework for developers to accomplish common, scheduled tasks on their cluster. You can implement Job Scheduler’s Service Provider Interface (SPI) to take snapshots, manage your data’s lifecycle, run periodic jobs, and much more.

When you use Job Scheduler, you build a plugin that implements interfaces provided in the Job Scheduler library. You can schedule jobs by specifying an interval, or using a Unix Cron expression to define a more flexible schedule to execute your job. Job Scheduler has a sweeper that listens for update events on the Elasticsearch cluster, and a scheduler that manages when jobs run.

Build, install, code, run!

You can build and install the Job Scheduler plugin by following the instructions in the Open Distro for Elasticsearch Job Scheduler GitHub repo.

Please take a look at the source code – play with it, build with it! Let us know if it doesn’t support your use case or if you have ideas for how to improve it. The sample-extension-plugin example code in the Job Scheduler source repo provides a complete example of using Job Scheduler.

Join in on GitHub to improve project documentation, add examples, submit feature requests, and file bug reports. Check out the code, build a plugin, and open a pull request – we’re happy to review and figure out steps to integrate. We welcome your participation on the project. If you have any questions, don’t hesitate to ask on the community discussion forums.

Alolita Sharma

Alolita Sharma

Alolita Sharma is a Principal Technologist at AWS. She's an expert in internationalization and applying deep learning for natural language processing. She has led several engineering projects and teams at PayPal, Twitter, Wikipedia and IBM. She serves on the board of Unicode Consortium, is an invited expert on W3C and ECMA workgroups and has been on the board of the Open Source Initiative. She speaks internationally on open source, innersource, web and language technologies, deep learning and open standards such as Unicode. You can reach her on Twitter @alolita.

Jon Handler

Jon Handler

Jon Handler (@_searchgeek) is a Principal Solutions Architect at Amazon Web Services based in Palo Alto, CA. Jon works closely with the CloudSearch and Elasticsearch teams, providing help and guidance to a broad range of customers who have search workloads that they want to move to the AWS Cloud. Prior to joining AWS, Jon's career as a software developer included four years of coding a large-scale, eCommerce search engine. Jon holds a Bachelor of the Arts from the University of Pennsylvania, and a Master of Science and a Ph. D. in Computer Science and Artificial Intelligence from Northwestern University.