AWS DevOps & Developer Productivity Blog
Category: Amazon OpenSearch Service
How A/B Testing and Multi-Model Hosting Accelerate Generative AI Feature Development in Amazon Q
Introduction In the rapidly evolving landscape of Generative AI, the ability to deploy and iterate on features quickly and reliably is paramount. We, the Amazon Q Developer service team, relied on several offline and online testing methods, such as evaluating models on datasets, to gauge improvements. Once positive results are observed, features were rolled out […]