AWS News Blog: Introducing default data integrity protections for new objects in Amazon S3

Source URL: https://aws.amazon.com/blogs/aws/introducing-default-data-integrity-protections-for-new-objects-in-amazon-s3/
Source: AWS News Blog
Title: Introducing default data integrity protections for new objects in Amazon S3

Feedly Summary: Amazon S3 updates the default behavior of object upload requests with new data integrity protections that build upon S3’s existing durability posture.

AI Summary and Description: Yes

Summary: The text details enhancements made to Amazon S3’s data integrity protections, notably automatic checksums, which ensure data transmitted over the internet is accurate. The updates aim to provide additional security without necessitating changes to client applications, thereby simplifying the implementation of data integrity protocols for developers.

Detailed Description:
The document outlines several key updates to the Amazon Simple Storage Service (Amazon S3) that enhance data integrity protections during uploads. These updates are significant for security professionals, developers, and compliance teams, who must ensure the accurate transmission and storage of data in cloud environments. Below are the major points of interest:

– **Automatic Client-Side Integrity Protection**:
– Amazon S3 has introduced default settings for automatic checksum verification on data uploads. This capability aims to maintain integrity throughout the data transmission process, even before the data reaches the AWS servers.
– Developers no longer need to write additional code for checksum calculations, minimizing complexity and potential errors.

– **Checksum Algorithms**:
– Supports CRC32, CRC32C, and a new algorithm, CRC64NVME, for checksum calculations.
– This diversity in algorithms allows flexibility based on application needs and enhances the robustness of data verification processes.

– **Implementation Without Code Changes**:
– The changes are designed to integrate seamlessly with existing applications. Users must only update to the latest AWS SDK or AWS CLI; no other modifications are required.
– This encourages widespread adoption among users still utilizing older SDK versions.

– **Multipart Upload Capability**:
– For large file uploads, checksums will be calculated for each part automatically, ensuring integrity checks across multipart uploads align with the full object verification.
– This feature simplifies the process for developers by eliminating the need for manual checksum tracking during multipart operations.

– **Consistent Data Integrity Checks**:
– Amazon S3 now provides full-object checksums across single-part and multipart uploads, strengthening data integrity across various operations.
– In instances where an application fails to send a checksum, Amazon S3 will generate one, safeguarding against potential transmission issues.

– **No Additional Costs**:
– The new checksum features come at no additional cost to users, making it a cost-effective enhancement for cloud data management.

– **Action Items for Users**:
– Users are encouraged to update SDKs and CLI tools to leverage the new capabilities immediately.
– Existing objects can have checksums added through the updated CopyObject API.

This update marks a significant advancement in cloud data security, ensuring enhanced integrity verification processes that align with best practices in information security and compliance, important for professionals managing cloud-based infrastructures. The ability to automatically verify data integrity reduces the risks associated with data corruption during transmission, making it a pivotal improvement in cloud service offerings.