Category: Amazon Simple Storage Service (S3)

Many customers operate in a hybrid environment with on-premises infrastructure interconnected with a cloud provider’s infrastructure. This post details how HCLTech used the AWS Centralized Log Management Reference Architecture, and discusses how HCLTech removed the requirements for Amazon Kinesis Data Streams. We also explore how HCLTech used Amazon Kinesis Data Firehose to stream from an Amazon CloudWatch Logs destination in a centralized logging account.

Cloud security is the highest priority at AWS, and we work closely with industry-leading partners such as Trend Micro to build security solutions for customers. In this post, we share a malware scanning solution jointly built by Trend Micro and AWS that detects and automates response to malware payload uploaded to Amazon Simple Storage Service (Amazon S3). The solution uses Trend Micro threat intelligence capabilities and AWS Security Hub.

Bitbucket Pipelines, an integrated CI/CD tool within Bitbucket Cloud that enables developers to execute builds right from within Bitbucket, recently introduced an integration with OpenID Connect and AWS. OpenID Connect is an identity layer above the Oauth 2.0 protocol. With this integration, Bitbucket Pipelines users can authenticate with Amazon S3, Amazon CloudFront, and other AWS resources without having to store secret tokens in Bitbucket.

With the general availability of AWS PrivateLink for Amazon S3 released earlier this year, customers can take advantage of private connectivity between S3 and on-premises resources using private IPs from your virtual network. Learn how to leverage interface VPC endpoints (AWS PrivateLink) for Amazon S3 and its integrations with VMware Cloud on AWS, which brings VMware’s enterprise-class software-defined data center software to the AWS Cloud.

When you use Amazon S3 to store corporate data and host websites, you need additional logging to monitor access to your data and the performance of your applications. An effective logging solution enhances security and improves detection of security incidents. Learn how to use the Elastic Beats to extract logs stored in S3 buckets that can be indexed, analyzed, and visualized with the Elastic Stack. Elastic is an AWS ISV Partner that helps you find information, gain insights, and protect your data when you run on AWS.

Migrating your Veritas protected data, tape backups, and infrastructure to AWS allows for increased flexibility in managing data through its lifecycle. Leveraging this strategy in conjunction with Veritas NetBackup‘s deduplication capabilities allows you to realize cost savings over managing your data on-premises. Veritas on AWS ensures your data is highly available and provides savings over storing data in your data center and/or managing the tape backup archival process.

Building web applications in a serverless environment has brought many advantages, but with every big shift there are certain practices such as malware protection that need to be reinvented. Organizations need a solution that’s easy to query from web application via API with no infrastructure required. Learn how SophosLabs Intelix offers a suite of APIs which provide specific, actionable intelligence about files.

As we celebrate Amazon S3’s 15th birthday, we are excited to share stories of how AWS Partners are using S3 to provide a wide variety of solutions to address customer needs. It’s rare to find an ISV solution these days that does not support Amazon S3 in some way. AWS Partners have helped customers all across the world ingest exabytes of data into S3, and some AWS Partners have built entire businesses on Amazon S3.

Achieving “speed of thought” or instant analytics on large data sets is a key challenge for business intelligence platforms. Traditionally, data engineers would design and deliver an optimized, aggregated subset of the data to a data warehouse to drive the visualization. This can often take weeks of development and testing or incur significant infrastructure costs. Learn how Indexima uses machine learning and hyper indexes to automate this process and accelerate analytics by up to 1000x across a full data set on Amazon S3.

Amazon Managed Streaming for Apache Kafka (Amazon MSK) is a fully managed, highly available, and secure Apache Kafka service that makes it easy to build and run applications that use Kafka to process steaming data. Learn how to use the new open source Kafka Connect Connector (StreamReactor) from Lenses.io to query, transform, optimize, and archive data from Amazon MSK to Amazon S3. We’ll also demonstrate how to use Amazon Athena to query the partitioned parquet data directly from S3.