ls --schema: Calculate digest for local assets

[jwodder]

Fixes #665.

[codecov]

Codecov Report

Merging #666 (fa1fc9b) into master (02ee314) will increase coverage by 0.50%.
The diff coverage is 95.00%.

@@            Coverage Diff             @@
##           master     #666      +/-   ##
==========================================
+ Coverage   83.62%   84.12%   +0.50%     
==========================================
  Files          59       59              
  Lines        5379     5606     +227     
==========================================
+ Hits         4498     4716     +218     
- Misses        881      890       +9     

Flag	Coverage Δ
unittests	84.12% <95.00%> (+0.50%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
dandi/cli/cmd_ls.py	69.76% <90.00%> (+2.89%)	⬆️
dandi/cli/tests/test_ls.py	100.00% <100.00%> (ø)
dandi/tests/test_metadata.py	100.00% <0.00%> (ø)
dandi/metadata.py	80.38% <0.00%> (+10.38%)	⬆️

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 02ee314...fa1fc9b. Read the comment docs.

[satra]

this works for me. two potential enhancements:

1. add a test
2. add a --use_fake_digest option that sticks an appropriate value 32 characters + "-1" for dandi_etag, but doesn't actually compute it.

[jwodder]

@satra Done.

[yarikoptic]

Do you think @satra users should be given this opportunity? I would prefer not to... Dear @jwodder , pleae make it a devel option which otherwise would not be visible. Seems to be the first one for ls but we have them for upload etc.

[satra]

i'm fine with it being a DEVEL option.

[satra]

but then some kind of output should say "computing checksum" - the pyout output on drogon is not super helpful for me (number of rows displayed, etc.,.). so perhaps a status field could be added that gives such info in a column.

[yarikoptic]

displaying some message is orthogonal to having digest fake or not (that is what the option is about).

why are you interested to get that displayed BTW? I guess we could add some lgr.debug into get_digest for that purpose. We have "mothballed for now" #465 to display digest computing progress during upload. May be after/during Python API refactoring we could come up with some consistent interface across commands to display progress of long going operations.

[jwodder]

I've made the option devel-only and added an INFO-level log message just before calculating a digest.

[satra]

it's just that you have no idea as a user what the program is doing when showing ls. just like upload says validating, uploading, complete, it would be nice at least in the pyout display to know that something is going on.

[yarikoptic]

ok, let's merge this and release a fresh release of the dandi-cli