Conquering large-scale inference

Large-scale AI model inference is a unique technical challenge. Luckily, Domenic Donato, VP of Technology at AssemblyAI, an API startup building state-of-the-art AI models, will share how to tackle it. Domenic will dive deep into the innovative solutions employed by AssemblyAI to address this complex undertaking and explore cutting-edge techniques to ensure efficient, effective inference processes on deep learning models. From optimizing computational resources to leveraging parallelization and distributed systems, you’ll learn strategies on how to make informed decisions at-scale.