Resources & FAQ

Q: What can the Data Lake on AWS solution manage on my behalf?

A:The solution manages a persistent catalog of organizational datasets in Amazon S3 and business-relevant tags associated with each dataset. It allows companies to create simple governance policies that require specific tags when datasets are stored in the data lake solution.

Q: What type of datasets does this solution support?

A: You can register existing or new datasets of any file type or size because the solution leverages the flexibility of Amazon S3.

Q: How do I upload my data to the data lake?

A: You can upload data files from the solution's console, or directly to an Amazon S3 bucket and then register them in the data lake.

Q: Can I use the data lake if I have existing data in Amazon S3?

A: Yes. You can register datasets with descriptive tags of your choice that point to existing objects in Amazon S3.

Q: How can I monitor the data lake?

A: The data lake logs API calls, latency, and error rates to Amazon CloudWatch in your AWS account. Additionally, you can turn on audit logging for your data lake deployment to monitor all user activity for compliance tracking.

Q: How quickly are solution logs available?

A: Logs, alarms, error rates and other metrics are stored in Amazon CloudWatch and are available near real-time.

Q: How do I add and manage users in this solution?

A: After the data lake solution is deployed, you can invite users to self-register to start using the data lake. You can continue to manage users, groups, and permissions to the data lake in the Administration section of the solution console.

Q: How is data transmitted to the data lake?

A: You have several options to add data to the data lake solution: use the data lake console or data lake CLI to upload files, or link to existing content in Amazon S3.

Q: Can I deploy this solution in any AWS Region?

A: You can deploy the solution’s AWS CloudFormation template only in AWS Regions where Amazon Cognito, Amazon Athena, and AWS Glue are available. However, once deployed, you can invite users from around the globe to access the solution.

In addition to service-availability requirements, we recommend you deploy the data lake in the AWS Region where your data is stored for better performance and user interactivity.