s3Object.Body.transformToWebStream().pipeTo(Writable.toWeb(destinationStream)) promise never settle from 3.729.0

[ert78gb]

Checkboxes for prior research

• I've gone through Developer Guide and API reference
• I've checked AWS Forums and StackOverflow.
• I've searched for previous similar issues and didn't find any solution.

Describe the bug

await s3Object.Body.transformToWebStream().pipeTo(Writable.toWeb(destinationStream)) never settle from @aws-sdk/[email protected].
Everything works fine with @aws-sdk/[email protected]

The issue is present in the latest 3.731.1 version too.

Regression Issue

• Select this option if this issue appears to be a regression.

SDK version number

@aws-sdk/[email protected], @aws-sdk/[email protected]

Which JavaScript Runtime is this issue in?

Node.js

Details of the browser/Node.js/ReactNative version

v22.13.0, v23.6.0

Reproduction Steps

Reproduction repo https://github.com/ert78gb/aws-sdk3-729-0-s3-streampipe-issue

Observed Behavior

The stream pipe crashes

Expected Behavior

no crash

Possible Solution

If you don't use stream, but consume much memory in case of large files.

Additional Information/Context

Maybe the related Node.js issue nodejs/node#56139
BUT everything works fine with node 22 and 23 with @aws-sdk/[email protected]
so an aws sdk modification breaks this.

[agustin-golmar]

Exactly the same problem, but in another context:

It stops between steps C and D forever:

This methods works perfectly for years, but brokes after update NPM dependency @aws-sdk/client-s3 to 3.731.1.

The Node.js runtime version is 20.18.0. I think that the method that cause the halt was:

const manifest = await (integrityManifest.Body?.transformToString("utf-8"))

but I was wrong, it was the previously getObjectAsync that was called just before this.

Good luck!

[s1owjke]

We encountered a similar issue during the upgrade of @aws-sdk/client-s3 from 3.717.0 to 3.731.1.

The problem only occurs for files with checksum (which is now calculated by default since 3.729.0 release). This issue only affects the transformToWebStream method, which appears to never close properly, which is a root cause.

[gsf4726]

We just encountered this bug as well after upgrading @aws-sdk/client-s3 from 3.726.1 that is blocking our S3 downloads.

I'm surprised there's not more activity around this or investigation started?

Here's our usage that demonstrates the issue:

const downloadFileStream = fs.createWriteStream(filePath);
const response = await this.client.send(new GetObjectCommand(input));
await pipeline(response.Body.transformToWebStream(), writableStream); // <-- Never resolves

[kuhe]

Hi, thanks to everyone who reported this issue.

This should be fixed as of https://github.com/aws/aws-sdk-js-v3/releases/tag/v3.735.0 with
https://www.npmjs.com/package/@aws-sdk/client-s3/v/3.735.0.

[dimfeld]

Confirmed that our tests which were failing on 3.729 work with 3.735. Thanks!

[agustin-golmar]

We test GetObjectCommand again and it works perfectly with the new realease v3.735.0. Problem solved. Thanks!

[ert78gb]

I can confirm the referenced version solves the problem. Thx for the fix

[github-actions]

This issue is now closed. Comments on closed issues are hard for our team to see.
If you need more assistance, please open a new issue that references this one.

[github-actions]

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs and link to relevant comments in this thread.