AWS Developer Tools Blog

Category: Amazon Simple Storage Service (S3)

Announcing Amazon S3 checksums support in the AWS SDK for Kotlin

We are excited to announce support for Amazon S3 checksums in the AWS SDK for Kotlin! A checksum is a unique fingerprint calculated from a set of data that can be used to check whether the data has been altered or corrupted during transfers. Configuring a checksum is a valuable precaution to help maintain the […]

Introducing CRT-based S3 Client and the S3 Transfer Manager in the AWS SDK for Java 2.x

We are excited to announce the general availability of two new features in the AWS SDK for Java 2.x that enable accelerated object transfer with Amazon Simple Storage Service (Amazon S3): An AWS Common Runtime (CRT)-based S3 SDK client, and the S3 Transfer Manager. The CRT-based S3 client allows you to transfer objects to and […]

Virus scan S3 buckets with a serverless ClamAV based CDK construct

Edit: March 10th 2022 – Updated post to use AWS Cloud Development Kit (CDK) v2. Protecting systems from malware is an essential part of a systems protection strategy. It is important to both scan binaries and other files before introducing them into your system boundary and appropriately respond to potential threats in accordance to your […]

Introducing Amazon S3 Transfer Manager in the AWS SDK for Java 2.x

We are pleased to announce the Developer Preview release of the Amazon S3 Transfer Manager – a high level file transfer utility for the Amazon Simple Storage Service (Amazon S3) in the AWS SDK for Java 2.x. Using Transfer Manager’s simple API, you can now perform accelerated uploads and downloads of objects to and from […]

Provision AWS infrastructure using Terraform (By HashiCorp): an example of running Amazon ECS tasks on AWS Fargate

AWS Fargate is a a serverless compute engine that supports several common container use cases, like running micro-services architecture applications, batch processing, machine learning applications, and migrating on premise applications to the cloud without having to manage servers or clusters of Amazon EC2 instances. AWS customers have a choice of fully managed container services, including […]

Orchestrating an application process with AWS Batch using AWS CDK

In many real work applications, you can use custom Docker images with AWS Batch and AWS Cloud Development Kit(CDK) to execute complex jobs efficiently. AWS CDK is an open source software development framework to model and provision your cloud application resources using familiar programming languages, including TypeScript, JavaScript, Python, C# and Java. For the solution […]

Configuring boto to validate HTTPS certificates

We strongly recommend upgrading from boto to boto3, the latest major version of the AWS SDK for Python. The previous major version, boto, does not default to validating HTTPS certificates for Amazon S3 when you are: Using a Python version less than 2.7.9 or Using Python 2.7.9 or greater and are connecting to S3 through […]

Generate an Amazon S3 presigned URL with SSE using the AWS SDK for C++

Amazon Simple Storage Service (Amazon S3) presigned URLs give you or your customers an option to access an Amazon S3 object identified in the URL, without having AWS credentials and permissions. With server-side encryption (SSE) specified, Amazon S3 will encrypt the data when the object is written to disks, and decrypt the data when the […]

Archiving Data to Amazon S3 Glacier using PowerShell

The final update of the AWS Tools for PowerShell in 2018 added support for Amazon S3 Glacier. Amazon S3 Glacier is a secure, durable, and extremely low-cost cloud storage service for data archiving and long-term backup. The update to the AWS PowerShell modules added cmdlets to support both control and data plane APIs for the […]

Amazon S3 Select Support in the AWS SDK for .NET

We are releasing support for Amazon S3 Select in the AWS SDK for .NET. This feature enables developers to run simple SQL queries against objects in Amazon S3. Today, if you’re frequently pulling entire objects to use portions of them, this functionality could dramatically improve performance. S3 Select works on objects stored in CSV format or JSON […]