new feature: Add more checksum support for S3

[Xuanwo]

Feature Description

crc64-nvme is the new crc algo that supported by s3: https://docs.aws.amazon.com/AmazonS3/latest/userguide/checking-object-integrity.html

Problem and Solution

• CRC64-NVME (Recommended)
  • crc64-nvme is the default algo used by s3. Adding it in opendal can make sure the data we upload is correct.
• CRC-32
• CRC-32C
• SHA-1
• SHA-256
• Also, content-md5.

Additional Context

No response

Are you willing to contribute to the development of this feature?

• Yes, I am willing to contribute to the development of this feature.

[geetanshjuneja]

Hi, I would like to work on this.

[Xuanwo]

The crc64-nvme related PR has been reverted in #5627 because it introduced dependencies we do not want.

[geetanshjuneja]

The crc64-nvme related PR has been reverted in #5627 because it introduced dependencies we do not want.

So how to get required crc64-nvme checksum without using available packages?

[Xuanwo]

The crc64-nvme related PR has been reverted in #5627 because it introduced dependencies we do not want.

So how to get required crc64-nvme checksum without using available packages?

We are trying to contact the author regarding this and will choose to maintain our own if we receive no response.