Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

snapshot_download does not show the name of the files downloaded in parallel #1281

Closed
sgugger opened this issue Dec 23, 2022 · 3 comments
Closed

Comments

@sgugger
Copy link
Contributor

sgugger commented Dec 23, 2022

I was running a code sample sent by a user for a bug and realized that snapshot_download uses some parallelism (ncie!) but doesn't give the name of the file downloaded as a result, see screenshot:
image

This was by executing:

from huggingface_hub import snapshot_download

model_path = snapshot_download("EleutherAI/gpt-neox-20b")

cc @Wauplin

@Wauplin
Copy link
Contributor

Wauplin commented Dec 23, 2022

Yes, thanks for reporting @sgugger 👍
This happens when the file is downloaded from S3 (LFS files). I fixed it as part of #1267 (see #1267 (comment)). Fix will be available in next release :)

@Wauplin Wauplin closed this as completed Dec 23, 2022
@sgugger
Copy link
Contributor Author

sgugger commented Dec 23, 2022

Great, thanks and sorry for the dupe issue then.

@Wauplin
Copy link
Contributor

Wauplin commented Dec 23, 2022

No worries ! It was not documented anywhere :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants