AWS Storage Blog
NEW Amazon S3 sessions at AWS re:Invent are coming on Jan 12-14
UPDATE 9/8/2021: Amazon Elasticsearch Service has been renamed to Amazon OpenSearch Service. See details.
We are into week two of AWS re:Invent, and a lot of the Amazon S3 sessions we posted about are now available on-demand, with a few more to be broadcast over the next two weeks. Hopefully, you also heard about some of the major announcements for Amazon S3, including strong read-after-write consistency, replication to multiple destinations, support for two-way replication, and S3 Bucket Keys which reduce the cost server-side encryption by up to 99%.
It’s been a big start to re:Invent, but WAIT, THERE IS MORE!
You may have noticed that there was a curious time range in the initial re:Invent calendar for January 12-14, but there were not any sessions in the catalog for that timeframe, what was that about? Well, we wanted to kickstart 2021 with some exceptional content, and the session catalog has been updated in a BIG way. We just released 13 new Amazon S3 sessions for Jan 12-14, and all are highlighted below. These range from sessions covering S3 Storage Lens (Check this out!), to securing your Amazon s3 data, and how to optimize your storage costs, we are sure there is something for everyone.
Take a look, sign-up for the scheduled broadcast to ask questions of AWS Experts, or come back and watch sessions on-demand! Next, we will post a blog highlighting all of the launches of 2020 for Amazon S3, and how you can get started with each one. Stay tuned!
Optimizing and managing Amazon S3 sessions
Bytes to insights: Analyze and take action on your storage usage: As you use Amazon S3 to manage large shared datasets across tens to hundreds of accounts and buckets and multiple AWS Regions, it becomes more and more important to gather complete and up-to-date information about your storage to make decisions or implement optimizations. Amazon S3 offers a range of tools to aid in analysis and optimization of your storage. In this session, take a tour of Amazon S3 Storage Class Analysis, Amazon S3 Inventory, and the newly launched, Amazon S3 Storage Lens to learn valuable tips for how to optimize your storage and apply best practices to manage your data.
- JAN 12, 2021 | 11:45 AM – 12:15 PM EST
- Featured speaker: Mark Kalus, Principal Product Manager, Amazon S3
Better, faster, and lower-cost storage: Optimizing Amazon S3: Effective performance and cost optimization can require different approaches depending on application latency and access patterns. This session reviews key considerations for storing data in frequently accessed, infrequently accessed, and long-term backup and archive storage classes. Learn how Amazon S3 powers some of the most performance-sensitive workloads running in the cloud today. Finally, review how to get the most out of Amazon S3 to improve your architecture and enhance performance.
- JAN 12, 2021 | 2:45 PM – 3:15 PM EST
- Featured speaker: Matt Sidley, Senior Product Manager, Amazon S3
Best practices for archiving large datasets with AWS: The vast majority of data in the world is cold. Using Amazon S3 Glacier, businesses can safely and securely store data for years or decades without worrying about expensive and finicky tape drives or off-premises tape archival services. This session covers the unique challenges for managing cold data as well as best practices for migrating your data into and restoring your data from the Amazon S3 Glacier and Amazon S3 Glacier Deep Archive storage classes. You will learn about different options for ingesting and restoring your data at petabyte scale while taking into consideration cost and different tiers of performance.
- JAN 12, 2021 | 5:00 PM – 5:30 PM EST
- Featured speaker: Matt Jordan, Senior Software Development Engineer, Amazon S3
Achieving unparalleled scale on Amazon S3: Manage and analyze your data: As your dataset grows on Amazon S3 to millions of objects and petabytes of data or more, it becomes increasingly valuable to use tools and automation to handle that scale. Amazon S3 offers flexible management capabilities to classify, report, and visualize your data usage trends so that you can make informed decisions to optimize performance and cost. In this session, you learn how to use Amazon S3 management features to help you better understand, optimize, and perform actions across storage at scale. Learn how to create and manage S3 Replication rules, run S3 Batch Operations, configure Amazon S3 inventory and metrics, and more.
- JAN 13, 2021 | 6:30 PM – 7:00 PM EST
- Featured speaker: Lee Kear, Solution Architect, Amazon S3
Extend Amazon S3 to on-premises environments with AWS Outposts: AWS Outposts extends Amazon S3 to your on-premises and connected edge environments to support applications with data residency requirements. Learn how you can use Amazon S3 on AWS Outposts to create and manage object storage running on premises. AWS Outposts brings native AWS services, infrastructure, and operating models to virtually any data center, colocation space, or on-premises facility. This session covers how you can use the same Amazon S3 capabilities that you use today in the cloud to easily set up, operate, scale, and manage storage running on AWS Outposts in your data centers. Attend this session to learn more about how Amazon S3 on Outposts works and key use cases.
- JAN 13, 2021 | 12:45 PM – 1:15 PM EST
- Featured speaker: Paul Reed, Principal Product Manager, AWS
Amazon S3 to AWS Lambda: A flexible pattern at the core of serverless apps: It’s not just image resizing! In this session, see how to use Amazon S3 as an event source for the core of your application workflow, including language translation, transcription, data processing, and content management. This session walks through the architectures, discusses how these applications work, and provides code repos you can use to build your own scalable production applications.
- JAN 14, 2021 | 11:15 AM – 11:45 AM EST
- Featured speaker: James Beswick, AWS Senior Developer Advocate
S3 security and access control best practices sessions
A defense-in-depth approach to Amazon S3 security and access: Strong adherence to architecture best practices and proactive controls is the foundation of storage security and access controls. In this session, you learn best practices for data security in Amazon S3. The session reviews the fundamentals of Amazon S3 security architecture and dives deep into the latest enhancements in usability and functionality. You learn about options for encryption, access control, security monitoring, auditing, and remediation.
- JAN 14, 2021 | 12:00 PM – 12:30 PM EST
- Featured speaker: Paul Meighan, Senior manager, product management, Amazon S3
Protecting sensitive data with Amazon Macie and Amazon GuardDuty: As organizations manage growing volumes of data, identifying and protecting your sensitive data can become increasingly complex, expensive, and time-consuming. In this session, learn how Amazon Macie and Amazon GuardDuty together provide protection for your data stored in Amazon S3. Amazon Macie automates the discovery of sensitive data at scale and lowers the cost of protecting your data. Amazon GuardDuty continuously monitors and profiles S3 data access events and configurations to detect suspicious activities. Come learn about these security services and how to best use them for protecting data in your environment.
- JAN 12, 2021 | 2:00 PM – 2:30 PM EST
- Featured speaker: Himanshu Verma, AWS Speaker
Closing the lid on public S3 buckets: Preventing S3 bucket exposure – Part 1: In Part 1 of this session, discovery ways that your infrastructure is being used, and explores the steps you can take to enable the public access block feature on all Amazon S3 buckets within your organization. This session discusses how the Amazon S3 public access block feature works and the building blocks required to enable it at scale with minimal to no disruption. Explore how to get visibility into what’s happening within your buckets. Finally, explore patterns and anti-patterns for using S3 buckets within your organization.
- JAN 13, 2021 | 12:30 PM – 1:00 PM EST
- Featured speakers: Prateek Sharma, AWS Speaker, and Mike Grima, Sr Security Software Engineer – Netflix Inc.
Closing the lid on public S3 buckets: Preventing S3 bucket exposure – Part 2: In Part 2 of this session, learn how to query S3 access logs for interesting findings, detect which objects are being publicly accessed, and lock objects down without causing serious disruption to your infrastructure operations. Explore patterns to follow when developing tooling to enable and enforce the Amazon S3 public access block feature at scale.
- JAN 13, 2021 | 4:15 PM – 4:45 PM EST
- Featured speakers: Prateek Sharma, AWS Speaker, and Mike Grima, Sr Security Software Engineer – Netflix Inc.
Secure your file transfers to Amazon S3 over SFTP, FTPS, and FTP: In this session, you learn how AWS Transfer Family provides fully managed support for file transfers directly into and out of Amazon S3. With support for SFTP, FTPS, and FTP, AWS Transfer Family helps you seamlessly migrate your file transfer workflows to AWS by integrating with existing authentication systems. It also provides DNS routing with Amazon Route 53 so that nothing changes for your customers and partners or their applications. Learn how, with your data in Amazon S3, you can use it with AWS services for processing, analytics, machine learning, and archiving.
- JAN 13, 2021 | 2:45 PM – 3:15 PM EST
- Featured speaker: Smitha Sriram, AWS Speaker
Event-driven data security using Amazon Macie: Amazon Macie sensitive data discovery jobs for Amazon S3 buckets help you discover sensitive data such as personally identifiable information (PII), financial information, account credentials, and workload-specific sensitive information. In this session, you learn about an automated approach to discover sensitive information whenever changes are made to the objects in your S3 buckets. You also learn about how to optimize sensitive information discovery as well as align and maintain compliance with your data security and privacy by minimizing the classified information disclosure in S3 using one-time, scheduled, and event-driven sensitive data discovery jobs.
- JAN 14, 2021 | 11:00 AM – 11:30 AM EST
- Featured speaker: Neha Joshi, AWS
Data lake on Amazon S3 sessions
An introduction to data lakes and analytics on AWS: As data volumes grow exponentially, so do the costs to store and analyze that data. AWS data lakes and analytics provide the broadest and deepest portfolio of purpose-built analytics tools so you can quickly get insights from data using the most appropriate tool for the job. This session provides an overview of the major analytics services—including Amazon Redshift, Amazon EMR, and Amazon ES—walks you through which services fit various analytics use cases, and provides an introductory demo. Gain a better understanding in this session of where to begin or how you can keep growing with AWS analytics.
- JAN 12, 2021 | 11:15 AM – 11:45 AM EST
- Featured speakers: Francis Jayakumar, AWS Analytics, and Anna Coniglio, AWS Solution Architect
How Twilio scaled business intelligence with a data lake powered by AWS: Twilio has democratized communications channels like voice, text, chat, video, and email by virtualizing the world’s communications infrastructure with APIs. Twilio’s business intelligence platform provides a 360-degree view of the business and is foundational to company-wide decision-making. The complexities of integrating new acquisitions (SendGrid), third-party applications, and growing volumes and varieties of data continue to challenge this platform. In this session, learn how Twilio has adapted to these growing needs by leveraging AWS managed services like Amazon Redshift, Amazon ElastiCache, and Amazon S3 to scale its data lake for improved reliability, performance, cost-effectiveness, and operational excellence.
- JAN 12, 2021 | 1:30 PM – 2:00 PM EST
- Featured speakers: Vaidy Krishnan, AWS Solution Architect, Dhara Patel, Director of Engineering – Twilio, Rahul Chandel, Engineering Manager – Twilio
Until next time! Looking forward to your feedback, and don’t forget to ask us questions directly in the sessions by using the “Ask the AWS Experts” button. Thanks!