Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Auto download of ETCI2021 is broken #229

Closed
calebrob6 opened this issue Nov 9, 2021 · 6 comments
Closed

Auto download of ETCI2021 is broken #229

calebrob6 opened this issue Nov 9, 2021 · 6 comments
Labels
datasets Geospatial or benchmark datasets
Milestone
0.1.1

Comments

@calebrob6
Copy link
Member

calebrob6 commented Nov 9, 2021 •
edited
Loading

It seems the download results in a corrupt zip file.

Steps to reproduce:

ETCI2021("data/", split="train", download=True, checksum=True)
@adamjstewart adamjstewart added the datasets Geospatial or benchmark datasets label Nov 9, 2021
@isaaccorley
Copy link
Collaborator

This is a known bug caused by torchvision's download_url being broken for google drive files. If I remember correctly the files aren't downloaded at all, it just creates empty files. This happens for all of our datasets which are hosted on google drive.

@calebrob6
Copy link
Member Author

Yeah I remember that issue. This time it downloads, but the download is corrupt. I manually downloaded a copy of the dataset so it isn't super urgent to look into this.

@calebrob6
Copy link
Member Author

I emailed the hosts of ETCI2021 and they said the whole dataset (included held out test labels) will be hosted on MLHub. Radiant Earth folks estimate that this will happen in early 2022.

@adamjstewart adamjstewart added this to the 0.1.1 milestone Nov 20, 2021
@calebrob6
Copy link
Member Author

calebrob6 commented Dec 14, 2021 •
edited
Loading

Just checked and this is fixed with torchvision 0.11 by pytorch/vision#4109

@alirezaomidi
Copy link

It seems the problem is back again. Check this colab notebook: https://colab.research.google.com/drive/1xbf3KlvFXQVljXZeZ73ufFsu-mPvo14W?usp=sharing

@adamjstewart adamjstewart reopened this May 25, 2022
@adamjstewart
Copy link
Collaborator

Just tried this with torchvision 0.13.0 and it works fine. Anyone experiencing issues with downloads should try to upgrade to a newer torchvision release.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
datasets Geospatial or benchmark datasets
Projects
None yet
Milestone
0.1.1
Development

No branches or pull requests
4 participants
@calebrob6 @alirezaomidi @adamjstewart @isaaccorley