AWS Storage Blog
Author: Oz Katz
Oz Katz is the Co-Creator and CTO of the open source project lakeFS, a scalable data version control system that delivers resilience and manageability to object-storage based data lakes. Prior to lakeFS, Oz engineered and maintained petabyte-scale data infrastructure and skateboarded.
lakeFS and Amazon S3 Express One Zone: Highly performant data version control for ML/AI
Machine learning presents a number of new challenges to data teams, calling for technology solutions that can support training and fine-tuning performance-critical workloads with high performance. Data version control is one of the facets of high-performing ML pipelines, as it allows efficient experimentation and full ML pipeline reproducibility at scale. lakeFS by Treeverse, an AWS […]