Skip to content

git pull && git annex get . at forked source #125

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
renelabounek opened this issue Jul 14, 2022 · 19 comments
Closed

git pull && git annex get . at forked source #125

renelabounek opened this issue Jul 14, 2022 · 19 comments
Assignees

Comments

@renelabounek
Copy link
Contributor

renelabounek commented Jul 14, 2022

I fetched upstream spine-generic:data-multi-subject into https://github.com/renelabounek/data-multi-subject. Then I called

git pull && git annex get .

and have got following errors saying me that re-defaced T1w images were not downloaded throught the git annex:

get sub-amu01/anat/sub-amu01_T1w.nii.gz (not available) 
  No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-amu02/anat/sub-amu02_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-amu03/anat/sub-amu03_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-amu04/anat/sub-amu04_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-amu05/anat/sub-amu05_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-balgrist01/anat/sub-balgrist01_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-balgrist02/anat/sub-balgrist02_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-balgrist03/anat/sub-balgrist03_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-balgrist04/anat/sub-balgrist04_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-balgrist05/anat/sub-balgrist05_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-balgrist06/anat/sub-balgrist06_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-brnoCeitec01/anat/sub-brnoCeitec01_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-brnoCeitec02/anat/sub-brnoCeitec02_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-brnoCeitec03/anat/sub-brnoCeitec03_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-brnoCeitec04/anat/sub-brnoCeitec04_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-brnoCeitec05/anat/sub-brnoCeitec05_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-brnoCeitec06/anat/sub-brnoCeitec06_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-brnoUhb01/anat/sub-brnoUhb01_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-brnoUhb02/anat/sub-brnoUhb02_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-brnoUhb03/anat/sub-brnoUhb03_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-brnoUhb04/anat/sub-brnoUhb04_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-brnoUhb05/anat/sub-brnoUhb05_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-brnoUhb06/anat/sub-brnoUhb06_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-brnoUhb07/anat/sub-brnoUhb07_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-brnoUhb08/anat/sub-brnoUhb08_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-cmrra01/anat/sub-cmrra01_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-cmrra02/anat/sub-cmrra02_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-cmrra03/anat/sub-cmrra03_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-cmrra04/anat/sub-cmrra04_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-cmrra05/anat/sub-cmrra05_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-cmrra06/anat/sub-cmrra06_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-cmrrb01/anat/sub-cmrrb01_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-cmrrb02/anat/sub-cmrrb02_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-cmrrb03/anat/sub-cmrrb03_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-cmrrb04/anat/sub-cmrrb04_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-cmrrb05/anat/sub-cmrrb05_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-cmrrb06/anat/sub-cmrrb06_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-cmrrb07/anat/sub-cmrrb07_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-dresden01/anat/sub-dresden01_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-dresden02/anat/sub-dresden02_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-geneva01/anat/sub-geneva01_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-geneva02/anat/sub-geneva02_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-geneva03/anat/sub-geneva03_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-geneva04/anat/sub-geneva04_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-geneva05/anat/sub-geneva05_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-geneva06/anat/sub-geneva06_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-juntendo750w01/anat/sub-juntendo750w01_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-juntendo750w02/anat/sub-juntendo750w02_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-juntendo750w03/anat/sub-juntendo750w03_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-juntendo750w04/anat/sub-juntendo750w04_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-juntendo750w05/anat/sub-juntendo750w05_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-juntendo750w06/anat/sub-juntendo750w06_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-nottwil01/anat/sub-nottwil01_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-nottwil02/anat/sub-nottwil02_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-nottwil03/anat/sub-nottwil03_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-nottwil04/anat/sub-nottwil04_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-nottwil05/anat/sub-nottwil05_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-nottwil06/anat/sub-nottwil06_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-nwu01/anat/sub-nwu01_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-nwu02/anat/sub-nwu02_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-nwu03/anat/sub-nwu03_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-nwu04/anat/sub-nwu04_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-nwu05/anat/sub-nwu05_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-nwu06/anat/sub-nwu06_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-oxfordFmrib01/anat/sub-oxfordFmrib01_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-oxfordFmrib02/anat/sub-oxfordFmrib02_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-oxfordFmrib03/anat/sub-oxfordFmrib03_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-oxfordFmrib04/anat/sub-oxfordFmrib04_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-oxfordFmrib05/anat/sub-oxfordFmrib05_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-oxfordFmrib06/anat/sub-oxfordFmrib06_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-oxfordFmrib07/anat/sub-oxfordFmrib07_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-oxfordFmrib08/anat/sub-oxfordFmrib08_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-oxfordFmrib09/anat/sub-oxfordFmrib09_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-oxfordFmrib10/anat/sub-oxfordFmrib10_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-oxfordFmrib11/anat/sub-oxfordFmrib11_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-oxfordOhba01/anat/sub-oxfordOhba01_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-oxfordOhba02/anat/sub-oxfordOhba02_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-oxfordOhba03/anat/sub-oxfordOhba03_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-oxfordOhba04/anat/sub-oxfordOhba04_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-oxfordOhba05/anat/sub-oxfordOhba05_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-pavia01/anat/sub-pavia01_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-perform01/anat/sub-perform01_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-perform02/anat/sub-perform02_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-perform03/anat/sub-perform03_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-perform04/anat/sub-perform04_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-perform05/anat/sub-perform05_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-perform06/anat/sub-perform06_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-queensland01/anat/sub-queensland01_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-queensland02/anat/sub-queensland02_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-queensland03/anat/sub-queensland03_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-queensland04/anat/sub-queensland04_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-queensland05/anat/sub-queensland05_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-queensland06/anat/sub-queensland06_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-sherbrooke01/anat/sub-sherbrooke01_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-sherbrooke02/anat/sub-sherbrooke02_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-sherbrooke03/anat/sub-sherbrooke03_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-sherbrooke04/anat/sub-sherbrooke04_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-sherbrooke05/anat/sub-sherbrooke05_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-sherbrooke06/anat/sub-sherbrooke06_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-sherbrooke07/anat/sub-sherbrooke07_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-stanford01/anat/sub-stanford01_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-stanford02/anat/sub-stanford02_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-stanford03/anat/sub-stanford03_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-stanford04/anat/sub-stanford04_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-stanford05/anat/sub-stanford05_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-stanford06/anat/sub-stanford06_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-strasbourg01/anat/sub-strasbourg01_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-strasbourg02/anat/sub-strasbourg02_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-strasbourg03/anat/sub-strasbourg03_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-strasbourg04/anat/sub-strasbourg04_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-strasbourg05/anat/sub-strasbourg05_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-strasbourg06/anat/sub-strasbourg06_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-tokyo750w01/anat/sub-tokyo750w01_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-tokyo750w02/anat/sub-tokyo750w02_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-tokyo750w03/anat/sub-tokyo750w03_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-tokyo750w04/anat/sub-tokyo750w04_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-tokyo750w05/anat/sub-tokyo750w05_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-tokyo750w06/anat/sub-tokyo750w06_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-tokyo750w07/anat/sub-tokyo750w07_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-tokyoIngenia01/anat/sub-tokyoIngenia01_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-tokyoIngenia02/anat/sub-tokyoIngenia02_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-tokyoIngenia03/anat/sub-tokyoIngenia03_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-tokyoIngenia04/anat/sub-tokyoIngenia04_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-tokyoIngenia05/anat/sub-tokyoIngenia05_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-tokyoIngenia06/anat/sub-tokyoIngenia06_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-tokyoIngenia07/anat/sub-tokyoIngenia07_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-tokyoSkyra01/anat/sub-tokyoSkyra01_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-tokyoSkyra02/anat/sub-tokyoSkyra02_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-tokyoSkyra03/anat/sub-tokyoSkyra03_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-tokyoSkyra04/anat/sub-tokyoSkyra04_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-tokyoSkyra05/anat/sub-tokyoSkyra05_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-tokyoSkyra06/anat/sub-tokyoSkyra06_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-tokyoSkyra07/anat/sub-tokyoSkyra07_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-ubc01/anat/sub-ubc01_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-ubc02/anat/sub-ubc02_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-ubc03/anat/sub-ubc03_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-ubc04/anat/sub-ubc04_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-ubc05/anat/sub-ubc05_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-ubc06/anat/sub-ubc06_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-unf01/anat/sub-unf01_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-unf02/anat/sub-unf02_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-unf03/anat/sub-unf03_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-unf04/anat/sub-unf04_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-unf05/anat/sub-unf05_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-unf06/anat/sub-unf06_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-unf07/anat/sub-unf07_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-vallHebron01/anat/sub-vallHebron01_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-vallHebron02/anat/sub-vallHebron02_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-vallHebron03/anat/sub-vallHebron03_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-vallHebron04/anat/sub-vallHebron04_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-vallHebron05/anat/sub-vallHebron05_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-vallHebron06/anat/sub-vallHebron06_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-vallHebron07/anat/sub-vallHebron07_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-vuiisAchieva01/anat/sub-vuiisAchieva01_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-vuiisAchieva02/anat/sub-vuiisAchieva02_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-vuiisAchieva03/anat/sub-vuiisAchieva03_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-vuiisAchieva04/anat/sub-vuiisAchieva04_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-vuiisAchieva05/anat/sub-vuiisAchieva05_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-vuiisAchieva06/anat/sub-vuiisAchieva06_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-vuiisIngenia01/anat/sub-vuiisIngenia01_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-vuiisIngenia02/anat/sub-vuiisIngenia02_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-vuiisIngenia03/anat/sub-vuiisIngenia03_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-vuiisIngenia04/anat/sub-vuiisIngenia04_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-vuiisIngenia05/anat/sub-vuiisIngenia05_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed
get sub-vuiisIngenia06/anat/sub-vuiisIngenia06_T1w.nii.gz (not available)
No other repository is known to contain the file.

(Note that these git remotes have annex-ignore set: origin upstream)
failed

@mguaypaq
Copy link
Member

Hi @renelabounek, thanks for reporting this issue. There are (at least) two things happening here:

  1. We recently changed how the access permissions work on Amazon S3, where these files are stored, so currently they're not able to be downloaded. We'll get this fixed quickly, and we'll let you know as soon as things are back to normal.
  2. But that's not the error message you're getting. Instead, it seems that git-annex has decided to ignore the origin and upstream repositories, so it's not even trying to download the files from Amazon S3. (git-annex tends to start ignoring a remote whenever it encounters problems with it.) You can confirm this by looking at the output of the following command (run inside the repository):
    git config --list | grep '^remote'
    
    If it contains lines with annex-ignore, those remotes are currently ignored by git-annex. You can undo this with commands like:
    git config --unset remote.origin.annex-ignore
    git config --unset remote.upstream.annex-ignore
    

You don't need to try this right now though; we'll let you know once the Amazon S3 permissions issue is fixed.

@renelabounek
Copy link
Contributor Author

Hi @renelabounek, thanks for reporting this issue. There are (at least) two things happening here:

  1. We recently changed how the access permissions work on Amazon S3, where these files are stored, so currently they're not able to be downloaded. We'll get this fixed quickly, and we'll let you know as soon as things are back to normal.

  2. But that's not the error message you're getting. Instead, it seems that git-annex has decided to ignore the origin and upstream repositories, so it's not even trying to download the files from Amazon S3. (git-annex tends to start ignoring a remote whenever it encounters problems with it.) You can confirm this by looking at the output of the following command (run inside the repository):

    git config --list | grep '^remote'
    

    If it contains lines with annex-ignore, those remotes are currently ignored by git-annex. You can undo this with commands like:

    git config --unset remote.origin.annex-ignore
    git config --unset remote.upstream.annex-ignore
    

You don't need to try this right now though; we'll let you know once the Amazon S3 permissions issue is fixed.

Ok I will do step 2, when you let me know that the issue 1 is fixed. Thanks, Rene

@mguaypaq
Copy link
Member

Ok, I think we don't need the origin and upstream remotes, at least for now, so please ignore step 2 from my previous comment. Can you try these commands:

git annex enableremote amazon public=yes
git annex get sub-amu01/anat/sub-amu01_T1w.nii.gz

If that works, then you should be able to retry downloading everything:

git annex get .

Otherwise, could you post the results of these commands please?

git config --list | grep '^remote'
git annex whereis sub-amu01/anat/sub-amu01_T1w.nii.gz

@mguaypaq mguaypaq self-assigned this Jul 15, 2022
@renelabounek
Copy link
Contributor Author

It di not pass. STDOUTs are below. I have not done the step 2 (i.e. the git config --unset commands), as you said not to do.

(base) [labounek@porto data-multi-subject]$ git annex enableremote amazon public=yes
enableremote amazon ok
(recording state in git...)
(base) [labounek@porto data-multi-subject]$ git annex get sub-amu01/anat/sub-amu01_T1w.nii.gz
get sub-amu01/anat/sub-amu01_T1w.nii.gz (not available) 
  No other repository is known to contain the file.

  (Note that these git remotes have annex-ignore set: origin upstream)
failed
get: 1 failed
(base) [labounek@porto data-multi-subject]$
(base) [labounek@porto data-multi-subject]$ git config --list | grep '^remote'
remote.origin.url=https://github.com/renelabounek/data-multi-subject.git
remote.origin.fetch=+refs/heads/*:refs/remotes/origin/*
remote.origin.annex-ignore=true
remote.amazon.annex-s3=true
remote.amazon.annex-uuid=5a5447a8-a9b8-49bc-8276-01a62632b502
remote.amazon.annex-ignore=false
remote.amazon.skipfetchall=true
remote.upstream.url=https://github.com/spine-generic/data-multi-subject
remote.upstream.fetch=+refs/heads/*:refs/remotes/upstream/*
remote.upstream.annex-ignore=true
remote.upstream.annex-readonly=true
(base) [labounek@porto data-multi-subject]$
(base) [labounek@porto data-multi-subject]$ git annex whereis sub-amu01/anat/sub-amu01_T1w.nii.gz
whereis sub-amu01/anat/sub-amu01_T1w.nii.gz (0 copies) failed
whereis: 1 failed
(base) [labounek@porto data-multi-subject]$

@mguaypaq
Copy link
Member

Ok, I can reproduce this problem, and I have some idea why it's happening, and a potential way to fix it (though not 100%).

The problem:

  • git-annex stores a lot of metadata in a git branch called git-annex (including, where to find contents of files).
  • By default, I think git pull only gets data from remotes for the master branch, not for the git-annex branch.
  • Your fork, which is under github.com/renelabounek, and which is called origin on your computer, only contains metadata updates until November 2021, in its git-annex branch.
  • The original, which is under github.com/spine-generic, and which is called upstream on your computer, contains a lot more metadata updates, in its git-annex branch. This includes information about where to find the file sub-amu01/anat/sub-amu01_T1w.nii.gz, for example.
  • Unfortunately, I'm not sure (yet) how to bring the origin/git-annex branch up to date with the upstream/git-annex branch. Normally I would use this link to do a Github pull request from our repository to your fork, but there's a "Can’t automatically merge." error message. I'll have to look into this more later.
  • Thankfully, it looks like maybe you can still get the files without fixing this. The following command should tell your computer to get the current metadata from upstream/git-annex:
    git fetch upstream git-annex
    
  • After running that, do the following commands work?
    git annex whereis sub-amu01/anat/sub-amu01_T1w.nii.gz
    git annex get sub-amu01/anat/sub-amu01_T1w.nii.gz
    

@renelabounek
Copy link
Contributor Author

Nope, I am still not able to get the files.

(base) [labounek@porto data-multi-subject]$ git fetch upstream git-annex
remote: Enumerating objects: 57723, done.
remote: Counting objects: 100% (7627/7627), done.
remote: Compressing objects: 100% (6890/6890), done.
remote: Total 57723 (delta 41), reused 7624 (delta 39), pack-reused 50096
Receiving objects: 100% (57723/57723), 8.92 MiB | 1.80 MiB/s, done.
Resolving deltas: 100% (19046/19046), completed with 4 local objects.
From https://github.com/spine-generic/data-multi-subject
 * branch            git-annex  -> FETCH_HEAD
(base) [labounek@porto data-multi-subject]$
(base) [labounek@porto data-multi-subject]$ git annex whereis sub-amu01/anat/sub-amu01_T1w.nii.gz
whereis sub-amu01/anat/sub-amu01_T1w.nii.gz (0 copies) failed
whereis: 1 failed
(base) [labounek@porto data-multi-subject]$
(base) [labounek@porto data-multi-subject]$ git annex get sub-amu01/anat/sub-amu01_T1w.nii.gz
get sub-amu01/anat/sub-amu01_T1w.nii.gz (not available) 
  No other repository is known to contain the file.

  (Note that these git remotes have annex-ignore set: origin upstream)
failed
get: 1 failed
(base) [labounek@porto data-multi-subject]$

@mguaypaq
Copy link
Member

I'm having trouble reproducing this problem on my computer. Could you tell me the output of the following commands, so that I have a better idea what's happening?

git log -n 5 git-annex
git log -n 5 origin/git-annex
git log -n 5 upstream/git-annex

Thanks.

@renelabounek
Copy link
Contributor Author

Thanks for your help. Here are the STDOUTs:

(base) [labounek@porto data-multi-subject]$ git log -n 5 git-annex
commit 01932205d298edd55d2857b5473293af9e59b1bd
Author: Rene Labounek <[email protected]>
Date:   Wed Jul 20 15:05:35 2022 -0500

    update

commit 7b2f84d2a3694bcb28d677f656bf401c053d6c5e
Author: Rene Labounek <[email protected]>
Date:   Mon Nov 29 13:06:08 2021 -0600

    update

commit 0a9c9e3a199a28e7cd0ebe8ca4513fbc6114d6eb
Merge: 5c768aa e40f90c
Author: Rene Labounek <[email protected]>
Date:   Mon Nov 29 13:04:44 2021 -0600

    merging upstream/git-annex into git-annex

commit 5c768aa91f43569eb78bedc9cd21bf09247927c5
Author: Rene Labounek <[email protected]>
Date:   Tue Nov 23 13:44:52 2021 -0600

    update

commit 5339869181c1bba10dc29a3cbbc1666f4039982f
Author: Rene Labounek <[email protected]>
Date:   Tue Nov 23 12:43:51 2021 -0600

    update
(base) [labounek@porto data-multi-subject]$
(base) [labounek@porto data-multi-subject]$ git log -n 5 origin/git-annex
commit 7b2f84d2a3694bcb28d677f656bf401c053d6c5e
Author: Rene Labounek <[email protected]>
Date:   Mon Nov 29 13:06:08 2021 -0600

    update

commit 0a9c9e3a199a28e7cd0ebe8ca4513fbc6114d6eb
Merge: 5c768aa e40f90c
Author: Rene Labounek <[email protected]>
Date:   Mon Nov 29 13:04:44 2021 -0600

    merging upstream/git-annex into git-annex

commit 5c768aa91f43569eb78bedc9cd21bf09247927c5
Author: Rene Labounek <[email protected]>
Date:   Tue Nov 23 13:44:52 2021 -0600

    update

commit 5339869181c1bba10dc29a3cbbc1666f4039982f
Author: Rene Labounek <[email protected]>
Date:   Tue Nov 23 12:43:51 2021 -0600

    update

commit e40f90cfd6e2fcf3cef82fd3a684a4337149511b
Author: Julien Cohen-Adad <[email protected]>
Date:   Fri Jun 25 20:59:18 2021 -0400

    update
(base) [labounek@porto data-multi-subject]$
(base) [labounek@porto data-multi-subject]$ git log -n 5 upstream/git-annex
commit e40f90cfd6e2fcf3cef82fd3a684a4337149511b
Author: Julien Cohen-Adad <[email protected]>
Date:   Fri Jun 25 20:59:18 2021 -0400

    update

commit 322c62ee978dcf199d3a7c1133f877341ccdb321
Author: Alexandru Foias <[email protected]>
Date:   Fri Apr 16 11:54:35 2021 -0400

    update

commit 7eb7b8ed51a66743310637ba316ddd099577875a
Author: Alexandru Foias <[email protected]>
Date:   Fri Apr 16 11:53:33 2021 -0400

    update

commit 81864bf6121eeee7ce565f23203eda0651ce8850
Author: Alexandru Foias <[email protected]>
Date:   Fri Apr 16 11:53:33 2021 -0400

    update

commit c88d1bb7e45cea1bab6701410f79415d757df3f4
Author: Alexandru Foias <[email protected]>
Date:   Tue Apr 13 15:15:06 2021 -0400

    update
(base) [labounek@porto data-multi-subject]$

@mguaypaq
Copy link
Member

Thanks for your patience. After trying to reproduce the problem on my computer, I think we can try to merge the information from the upstream/git-annex branch into the local git-annex branch with the following commands:

  • Start the automatic merging process, which we expect to fail (we'll fix this with the following commands).
    git checkout git-annex
    git merge --no-edit --allow-unrelated-histories upstream/git-annex
    
    We expect this to produce lots of output, ending with:
    ...
    Automatic merge failed; fix conflicts and then commit the result.
    
  • Fix the conflicts like this:
    git -c 'mergetool.custom.cmd=(echo "$MERGED" | grep -Eq [.]log$) && cat "$LOCAL" "$REMOTE" | sort -nu > "$MERGED"' \
        -c mergetool.custom.trustExitCode \
        -c mergetool.keepBackup=false \
        mergetool --tool=custom
    
    This will probably take several minutes, and produce lots of output like this:
    Normal merge conflict for 'ffd/627/SHA256E-s2732168--10acedb4cccb4804dd8b34d4a3ca6fb846528e291a045cb4140eccb2d4e305eb.nii.gz.log':
      {local}: modified file
      {remote}: modified file
    
    Normal merge conflict for 'ffd/736/SHA256E-s1897274--090e2c5f0d417e6e858297cbf92ba6e2ecd8c2b80e86a21d88f9f06bb053e332.nii.gz.log':
      {local}: modified file
      {remote}: modified file
    
    Normal merge conflict for 'ffd/c3d/SHA256E-s1592114--0202f1d6b6a8e937730f21641398ee338fe071f3d1866837f189fd7beb9f31f3.nii.gz.log':
      {local}: modified file
      {remote}: modified file
    
  • Save the results:
    git -c core.editor=/bin/true merge --continue
    
    This should produce a single line of output, like:
    [git-annex 693c29b0e] Merge remote-tracking branch 'upstream/git-annex' into git-annex
    
  • Get back to the master branch, and check if git-annex now knows that files exist on amazon:
    git checkout master
    git annex whereis sub-amu01/anat/sub-amu01_T1w.nii.gz
    
  • If this succeeds, you may want to save the results to your fork on github, with the following command:
    git push origin git-annex:git-annex
    

If it still doesn't work I would need to know exactly which version of git-annex you have, which is in the output of the following command:

git annex version

@renelabounek
Copy link
Contributor Author

  • Start the automatic merging process, which we expect to fail (we'll fix this with the following commands).

    git checkout git-annex
    git merge --no-edit --allow-unrelated-histories upstream/git-annex
    

    We expect this to produce lots of output, ending with:

    ...
    Automatic merge failed; fix conflicts and then commit the result.
    

My expected outputs started to appear different within the first set of commands. My git does not know allow-unrelated-histories. Should I continue? Or do we need to fix this first?

(base) [labounek@porto data-multi-subject]$ git checkout git-annex
Switched to branch 'git-annex'
Your branch is ahead of 'upstream/git-annex' by 5 commits.
  (use "git push" to publish your local commits)
(base) [labounek@porto data-multi-subject]$ 
(base) [labounek@porto data-multi-subject]$ git merge --no-edit --allow-unrelated-histories upstream/git-annex
error: unknown option `allow-unrelated-histories'
usage: git merge [options] [<commit>...]
   or: git merge [options] <msg> HEAD <commit>
   or: git merge --abort

    -n                    do not show a diffstat at the end of the merge
    --stat                show a diffstat at the end of the merge
    --summary             (synonym to --stat)
    --log[=<n>]           add (at most <n>) entries from shortlog to merge commit message
    --squash              create a single commit instead of doing a merge
    --commit              perform a commit if the merge succeeds (default)
    -e, --edit            edit message before committing
    --ff                  allow fast-forward (default)
    --ff-only             abort if fast-forward is not possible
    --rerere-autoupdate   update the index with reused conflict resolution if possible
    --verify-signatures   Verify that the named commit has a valid GPG signature
    -s, --strategy <strategy>
                          merge strategy to use
    -X, --strategy-option <option=value>
                          option for selected merge strategy
    -m, --message <message>
                          merge commit message (for a non-fast-forward merge)
    -v, --verbose         be more verbose
    -q, --quiet           be more quiet
    --abort               abort the current in-progress merge
    --progress            force progress reporting
    -S, --gpg-sign[=<key id>]
                          GPG sign commit
    --overwrite-ignore    update ignored files (default)

(base) [labounek@porto data-multi-subject]$

I assume it is a git version issue. Unfortunatelly, I am not admin at the server where the database is stored. So update git can be tricky or even impossible for me. Any other possibility before I will write to server admins the update request?

(base) [labounek@porto data-multi-subject]$ git --version
git version 1.8.3.1
(base) [labounek@porto data-multi-subject]$

@mguaypaq
Copy link
Member

mguaypaq commented Jul 21, 2022 via email

@renelabounek
Copy link
Contributor Author

First two commands appears that everythin is up to date. The third command does not know flag --continue. Possibly, again, version issue.

(base) [labounek@porto data-multi-subject]$ git merge --no-edit upstream/git-annex
Already up-to-date.
(base) [labounek@porto data-multi-subject]$
(base) [labounek@porto data-multi-subject]$ git -c 'mergetool.custom.cmd=(echo "$MERGED" | grep -Eq [.]log$) && cat "$LOCAL" "$REMOTE" | sort -nu > "$MERGED"' \
>     -c mergetool.custom.trustExitCode \
>     -c mergetool.keepBackup=false \
>     mergetool --tool=custom
No files need merging
(base) [labounek@porto data-multi-subject]$
(base) [labounek@porto data-multi-subject]$ git -c core.editor=/bin/true merge --continue
error: unknown option `continue'
usage: git merge [options] [<commit>...]
   or: git merge [options] <msg> HEAD <commit>
   or: git merge --abort

    -n                    do not show a diffstat at the end of the merge
    --stat                show a diffstat at the end of the merge
    --summary             (synonym to --stat)
    --log[=<n>]           add (at most <n>) entries from shortlog to merge commit message
    --squash              create a single commit instead of doing a merge
    --commit              perform a commit if the merge succeeds (default)
    -e, --edit            edit message before committing
    --ff                  allow fast-forward (default)
    --ff-only             abort if fast-forward is not possible
    --rerere-autoupdate   update the index with reused conflict resolution if possible
    --verify-signatures   Verify that the named commit has a valid GPG signature
    -s, --strategy <strategy>
                          merge strategy to use
    -X, --strategy-option <option=value>
                          option for selected merge strategy
    -m, --message <message>
                          merge commit message (for a non-fast-forward merge)
    -v, --verbose         be more verbose
    -q, --quiet           be more quiet
    --abort               abort the current in-progress merge
    --progress            force progress reporting
    -S, --gpg-sign[=<key id>]
                          GPG sign commit
    --overwrite-ignore    update ignored files (default)

(base) [labounek@porto data-multi-subject]$

@mguaypaq
Copy link
Member

mguaypaq commented Jul 21, 2022 via email

@renelabounek
Copy link
Contributor Author

@mguaypaq, sorry for ym delay. I was not around computer much through the weekend. File download failed again. Bellow are the outputs.
Thanks, Rene

(base) [labounek@porto data-multi-subject]$ git checkout master
Checking out files: 100% (7613/7613), done.
Switched to branch 'master'
(base) [labounek@porto data-multi-subject]$
(base) [labounek@porto data-multi-subject]$ git annex whereis sub-amu01/anat/sub-amu01_T1w.nii.gz
whereis sub-amu01/anat/sub-amu01_T1w.nii.gz (0 copies) failed
whereis: 1 failed
(base) [labounek@porto data-multi-subject]$
(base) [labounek@porto data-multi-subject]$ git annex version
git-annex version: 8.20211012-geb95ed486
build flags: Assistant Webapp Pairing Inotify DBus DesktopNotify TorrentParser MagicMime Feeds Testsuite S3 WebDAV
dependency versions: aws-0.22 bloomfilter-2.0.1.0 cryptonite-0.26 DAV-1.3.4 feed-1.3.0.1 ghc-8.8.4 http-client-0.6.4.1 persistent-sqlite-2.10.6.2 torrent-10000.1.1 uuid-1.3.13 yesod-1.6.1.0
key/value backends: SHA256E SHA256 SHA512E SHA512 SHA224E SHA224 SHA384E SHA384 SHA3_256E SHA3_256 SHA3_512E SHA3_512 SHA3_224E SHA3_224 SHA3_384E SHA3_384 SKEIN256E SKEIN256 SKEIN512E SKEIN512 BLAKE2B256E BLAKE2B256 BLAKE2B512E BLAKE2B512 BLAKE2B160E BLAKE2B160 BLAKE2B224E BLAKE2B224 BLAKE2B384E BLAKE2B384 BLAKE2BP512E BLAKE2BP512 BLAKE2S256E BLAKE2S256 BLAKE2S160E BLAKE2S160 BLAKE2S224E BLAKE2S224 BLAKE2SP256E BLAKE2SP256 BLAKE2SP224E BLAKE2SP224 SHA1E SHA1 MD5E MD5 WORM URL X*
remote types: git gcrypt p2p S3 bup directory rsync web bittorrent webdav adb tahoe glacier ddar git-lfs httpalso borg hook external
operating system: linux x86_64
supported repository versions: 8
upgrade supported from repository versions: 0 1 2 3 4 5 6 7
local repository version: 8
(base) [labounek@porto data-multi-subject]$

@mguaypaq
Copy link
Member

Ah, examining the previous output you gave me more carefully, I see that git fetch upstream git-annex did not do exactly what I expected, probably because of the older git version. I'm sorry. Can you try the following command:

git fetch upstream

After that, I would be curious if the following command now works (and the output):

git annex whereis sub-amu01/anat/sub-amu01_T1w.nii.gz

If it fails, the output of the following commands could help me figure out what's going on:

git status
git show master:sub-amu01/anat/sub-amu01_T1w.nii.gz
git show git-annex:8db/012/SHA256E-s15565632--20fa8ec26515317c0871c129300c3ca6a44a20b8c48275e07ba46a0b9d22210a.nii.gz.log
git show origin/git-annex:8db/012/SHA256E-s15565632--20fa8ec26515317c0871c129300c3ca6a44a20b8c48275e07ba46a0b9d22210a.nii.gz.log
git show upstream/git-annex:8db/012/SHA256E-s15565632--20fa8ec26515317c0871c129300c3ca6a44a20b8c48275e07ba46a0b9d22210a.nii.gz.log

@renelabounek
Copy link
Contributor Author

This really helped. See outputs bellow. Sorry for the hessle. But in summary, what was generally different for the forked database when compared to the README.md method? Just to start with the git fetch upstream before git pull && git annex get .. Or was there something else needed to be done?
@mguaypaq, thank you very much for your time and help.
Rene

(base) [labounek@porto data-multi-subject]$ git fetch upstream
remote: Enumerating objects: 63657, done.
remote: Counting objects: 100% (13269/13269), done.
remote: Compressing objects: 100% (11272/11272), done.
remote: Total 63657 (delta 1165), reused 13254 (delta 1159), pack-reused 50388
Receiving objects: 100% (63657/63657), 9.57 MiB | 2.91 MiB/s, done.
Resolving deltas: 100% (20171/20171), completed with 271 local objects.
From https://github.com/spine-generic/data-multi-subject
 * [new branch]      af/fix_images -> upstream/af/fix_images
 * [new branch]      af/update_participants_tsv -> upstream/af/update_participants_tsv
 * [new branch]      af/update_sub-ucl06_GH_direct -> upstream/af/update_sub-ucl06_GH_direct
 + e40f90c...15efe2d git-annex  -> upstream/git-annex  (forced update)
 * [new branch]      master     -> upstream/master
 * [new branch]      mt-entity  -> upstream/mt-entity
 * [new branch]      ng/ci-cache -> upstream/ng/ci-cache
 * [new branch]      renelabounek-master -> upstream/renelabounek-master
 * [new branch]      rl/height-weight -> upstream/rl/height-weight
 * [new branch]      sb/121-move-derivatives -> upstream/sb/121-move-derivatives
 * [new branch]      synced/af/csfseg_json -> upstream/synced/af/csfseg_json
 * [new branch]      synced/jca/17-defacing -> upstream/synced/jca/17-defacing
 * [new branch]      synced/jca/21-travis -> upstream/synced/jca/21-travis
 * [new branch]      synced/jca/7-check-data-consistency -> upstream/synced/jca/7-check-data-consistency
 * [new branch]      synced/jca/derivatives-r20200830-mts -> upstream/synced/jca/derivatives-r20200830-mts
 * [new branch]      synced/jca/participants -> upstream/synced/jca/participants
 * [new branch]      synced/jca/readme -> upstream/synced/jca/readme
 * [new branch]      synced/jca/reupload-disc-labels -> upstream/synced/jca/reupload-disc-labels
 * [new branch]      synced/jca/update-derivatives -> upstream/synced/jca/update-derivatives
 * [new tag]         r20201001  -> r20201001
 * [new tag]         r20201130  -> r20201130
 * [new tag]         r20211125  -> r20211125
 * [new tag]         r20220125  -> r20220125
(base) [labounek@porto data-multi-subject]$
(base) [labounek@porto data-multi-subject]$ git annex whereis sub-amu01/anat/sub-amu01_T1w.nii.gz
(merging upstream/git-annex into git-annex...)
(recording state in git...)
whereis sub-amu01/anat/sub-amu01_T1w.nii.gz (3 copies) 
  	5a5447a8-a9b8-49bc-8276-01a62632b502 -- [amazon]
   	e405e14e-33b2-4a35-b7a7-3eeec054f0d4 -- [email protected]:/mnt/nvme/sebeda/data-multi-subject
   	fc75435d-eb11-4c5a-9b68-debf6e68df2a -- [email protected]:~/data/data-multi-subject

  amazon: https://data-multi-subject---spine-generic---neuropoly.s3.ca-central-1.amazonaws.com/SHA256E-s15565632--20fa8ec26515317c0871c129300c3ca6a44a20b8c48275e07ba46a0b9d22210a.nii.gz
ok
(base) [labounek@porto data-multi-subject]$
(base) [labounek@porto data-multi-subject]$ git annex get sub-amu01/anat/sub-amu01_T1w.nii.gz
get sub-amu01/anat/sub-amu01_T1w.nii.gz (from amazon...) 

ok                                  
(recording state in git...)
(base) [labounek@porto data-multi-subject]$

@mguaypaq
Copy link
Member

Great! I'm so glad it works now 🎉

But in summary, what was generally different for the forked database when compared to the README.md method? Just to start with the git fetch upstream before git pull && git annex get .. Or was there something else needed to be done?

I think that's the main thing, yes, just doing git fetch upstream along with git pull before doing git annex get. The reason is:

  • git pull gets the contents of small files and hashes of the contents of big files into your local master branch (on your computer) from the origin/master branch (on your github fork). Possibly, depending on your settings, it also gets this from the upstream/master branch (on the original github repo), but typically your fork's origin/master is kept up to date with upstream/master so it doesn't matter.
  • git fetch upstream gets the locations of the contents of big files (for example, "the file contents that hashes to 12FA32 is available on amazon") into your local git-annex branch, from the upstream/git-annex branch. This was the missing part in your case. Github makes it easy to synchronize your fork's origin/master branch with upstream/master, but it doesn't do this by default for other branches, like origin/git-annex and upstream/git-annex. In fact, your fork's origin/git-annex branch is very much older than upstream/git-annex, so it doesn't have information about the location of newer file contents.
  • Once you have all this, git annex get looks at the hash of a file contents in master, uses this to look up a location in git-annex, and contacts this location (amazon, in this case) to get the actual contents.

Hopefully that explains this a bit!

@renelabounek
Copy link
Contributor Author

A bit, yes... :-D I have the data updated, so we can close this issue. Only question remain, if my case was just too specific or if it would be worth to add the potential neccesity of the git fetch upstream command into README.md

@mguaypaq
Copy link
Member

Indeed! I'll open a separate issue for that. Thanks again for your patience!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants