Data science at Netflix goes far beyond eponymous recommendation systems and touches every aspect of the business, from optimizing content delivery to fighting fraud. Netflix’s unique culture affords its data scientists extraordinary freedom of choice in tools, which results in an ever-expanding set of machine learning (ML) approaches and systems. In 2019, Netflix open-sourced Metaflow, its human-centric ML platform. In this session, Netflix shares some lessons learned in its multi-year journey building the ML systems that Metaflow incorporates, covering a diverse range of scale from one-time experimentation on laptops to large-scale model training and serving systems on AWS.
Now, using Amazon S3 as our data lake has paid off significant benefits for us over the years. It has allowed us to decouple compute from data storage, which means that now we can invest in different querying engines, different compute engines, and we can move as the industry moves."
Software Engineer, Netflix
AWS Services Used
Amazon Simple Storage Service (Amazon S3) is an object storage service offering industry-leading scalability, data availability, security, and performance.
Organizations of all sizes across all industries are transforming their businesses and delivering on their missions every day using AWS. Contact our experts and start your own AWS journey today.