A&T Systems AWS Data Lake Implementation

Data Ingestion and Data Access: Data Storage Design and Implementation – Provide prescriptive guidance to design and implement a Data Lake storage approach on AWS including what data-store, formats, encryption, compression and access controls. Data Ingestion Design and Implementation – Provide prescriptive guidance for onboarding of one (1) end to end data-set to the Data Lake and provision access. Data Catalog Design and Implementation Provide prescriptive guidance to design and implement a data catalog that democratizes data access in a secure manner to end users. Data Serving layer – Provide prescriptive guidance for recommended methods of connecting applications to Data Lake for data consumption. Key Activities Learn – Learn AWS Data Lake approaches including choosing the ”right” tool for the job Implement – Implement best practices in ingestion, storage, catalog and serving of data. Deliver – Deliver a Data Lake architecture that is easy to access, onboard new data and extend for analytics agility.