Posted On: Jun 9, 2023

Starting today, the state-of-the-art Falcon 40B foundation model from Technology Innovation Institute (TII) is available on Amazon SageMaker JumpStart, SageMaker’s machine learning (ML) hub that offers pre-trained models, built-in algorithms, and pre-built solution templates to help you quickly get started with ML. You can deploy and use this Falcon LLM with a few clicks in SageMaker Studio or programmatically through the SageMaker Python SDK.

Falcon 40B is a 40-billion-parameter large language model (LLM) available under the Apache 2.0 license that ranked #1 in Hugging Face Open LLM leaderboard, which tracks, ranks, and evaluates LLMs across multiple benchmarks to identify top performing models. Since its release in May 2023, Falcon 40B has demonstrated exceptional performance without specialized fine-tuning. To make it easier for customers to access this state-of-the-art model, AWS has made Falcon 40B available to customers via Amazon SageMaker JumpStart. Now customers can quickly and easily deploy their own Falcon 40B model and customize it to fit their specific needs for applications such as translation, question answering, and summarizing information.

Falcon 40B are generally available today through Amazon SageMaker JumpStart in US East (Ohio), US East (N. Virginia), US West (Oregon), Asia Pacific (Tokyo), Asia Pacific (Seoul), Asia Pacific (Mumbai), Europe (London), Europe (Frankfurt), Europe (Ireland), and Canada (Central), with availability in additional AWS Regions coming soon. To learn how to use this new feature, please see SageMaker JumpStart documentation, the Introduction to SageMaker JumpStart – Text Generation with Falcon LLMs example notebook, and the blog Technology Innovation Institute trains the state-of-the-art Falcon LLM 40B foundation model on Amazon SageMaker.