Artificial Intelligence
Author: Harish Rao
Build ultra-low latency multimodal generative AI applications using sticky session routing in Amazon SageMaker
In this post, we explained how the new sticky routing feature in Amazon SageMaker allows you to achieve ultra-low latency and enhance your end-user experience when serving multi-modal models.