AWS Storage Blog

Running Apache Kafka with Amazon S3 Files

Update, October 2, 2026: We have removed the implementation guidance from this post while we further review it with Apache Kafka and Amazon S3 Files specialists. We will update the post shortly with guidance on when and how to use Amazon S3 Files with self-managed Apache Kafka. If you have already deployed this architecture, test it against your partition count per broker, latency targets, and failure scenarios before you run production workloads, or contact us through AWS Support to understand your use case in more detail.

Sean White

Sean White

Sean White leads product marketing for storage at AWS. He enjoys writing about the never ending ways customers use cloud storage, launching new features and innovations that that delight customers, and simplifying the complex. If you have seen and love Buckets the S3 Mascot, then his team helped bring the mascot to life. If you are scared of mascots, then he had nothing to do with it. He is based in Boston, loves spending time with his wife and two kids, formerly watched Boston pro sports teams, but now has more fun coaching the kids. When in Seattle, you can find him at Anchorhead Coffee and Cloudburst Brewing.