This video from AWS re:Invent 2023 introduces Model Evaluation on Amazon Bedrock, a new feature that allows organizations to evaluate and select the best foundation models for their generative AI applications. The presenters, Jesse and Kishor, explain the importance of model evaluation, the challenges customers face, and how Amazon Bedrock simplifies the process. They demonstrate how to use automatic and human evaluations, compare models, and generate easy-to-read reports. The session covers features like curated datasets, predefined metrics, and the ability to bring your own data and metrics. The presenters also show how to set up evaluation jobs in just a few clicks and discuss the benefits of having a unified platform for both evaluation and production. This comprehensive overview aims to help businesses make informed decisions when choosing models for their specific use cases, considering factors like quality, cost, and latency.