Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rate limit on tootctl media remove-orphans #14955

Closed
mashirozx opened this issue Oct 7, 2020 · 3 comments
Closed

Rate limit on tootctl media remove-orphans #14955

mashirozx opened this issue Oct 7, 2020 · 3 comments

Comments

@mashirozx
Copy link
Contributor

mashirozx commented Oct 7, 2020

Pitch

I hope there to be an option in tootctl media remove-orphans to set the S3 API request rate.

Motivation

Default is about 1000 per second I guess? It exceeds my S3 provider's rate limit, so it always failures in half way.

I hope to set the rate by my self.

@mashirozx
Copy link
Contributor Author

Always failure with msg below because rate limit:

Error fetching list of files: Net::ReadTimeout with #TCPSocket:(closed)
If you want to continue from this point, add --start-after=accounts/avatars/000/005/476/original/dbd437bf08953f0f.jpeg to your command

Sad TAT

@Eriner
Copy link

Eriner commented May 17, 2021

This issue is still present as of v3.4.0.

Edit: actually, this issue is fixed. for anyone else who stumbles on this, it can be resolved with:

$ S3_READ_TIMEOUT=30 tootctl media remove-orphans

This was added in #14952

I think this issue can be safely closed.

@travnewmatic
Copy link

S3_READ_TIMEOUT should REALLY BE in the documentation

@trwnh trwnh closed this as completed May 20, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants