Add delete_patterns option to upload_folder

[Wauplin]

Step 1 for #1352: add a delete_patterns parameter to upload_folder. It makes sense in a lot of cases to delete remote files before uploading new ones.

The workflow is:

1. if delete_patterns is provided, list remote files (can be optimized once https://github.com/huggingface/moon-landing/pull/5580 is deployed)
2. apply the pattern filter => create a list of CommitOperationDelete (never delete ".gitattributes")
3. if a file is both deleted and overwritten in the same commit, drop the deletion operation
4. (not done) we could optimize this in case the user deletes an entire folder. At the moment it's 1 file = 1 delete operation. Seems error-prone to try to decode the patterns manually so let's do it later if we see it's a limitation.

Included in PR:

• refactored _prepare_upload_folder_additions (fixed a bug) + implement _prepare_upload_folder_deletions
• add mocked tests for upload_folder to check the CommitOperation list is correct
• adapted ModelHubMixin + keras/pytorch/fastai integrations
• adapted upload docs + some docstrings

Step 2 for #1352 will be adding the possibility for automatic "chained commits" in create_commit using a PR if the list of operations is too big (see description there).

[HuggingFaceDocBuilderDev]

The documentation is not available anymore as the PR was closed or merged.

[codecov]

Codecov Report

Patch coverage: 100.00% and project coverage change: +0.04 🎉

Comparison is base (3a051bd) 84.49% compared to head (526f28c) 84.54%.

❗ Current head 526f28c differs from pull request most recent head 546cc31. Consider uploading reports for the commit 546cc31 to get more accurate results

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #1370      +/-   ##
==========================================
+ Coverage   84.49%   84.54%   +0.04%     
==========================================
  Files          48       48              
  Lines        4812     4814       +2     
==========================================
+ Hits         4066     4070       +4     
+ Misses        746      744       -2     

Impacted Files	Coverage Δ
src/huggingface_hub/fastai_utils.py	80.61% <100.00%> (ø)
src/huggingface_hub/hf_api.py	90.10% <100.00%> (+0.09%)	⬆️
src/huggingface_hub/hub_mixin.py	94.18% <100.00%> (+0.13%)	⬆️
src/huggingface_hub/keras_mixin.py	93.84% <100.00%> (-0.32%)	⬇️
src/huggingface_hub/commands/user.py	0.00% <0.00%> (ø)

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

☔ View full report at Codecov.
📢 Do you have feedback about the report comment? Let us know in this issue.

[LysandreJik]

Looks great to me!

[LysandreJik]

(nit) Depending on how you test this (or if you use doctests at all, which I don't think is the case), you may need to still redeclare the previous if you want to isolate each statement. Still clean this way so no need to change.

[Wauplin]

We are not using doctests for now. I tend to prefer not redefining similar lines just to be more "straight to the point". At least when it's obvious what is api like here.
No strong opinion though. Might use doctests at some point but I have not seeing a big need for now.

[Wauplin]

Thanks for the careful review 👍
I have addressed the comments and will now merge it :)

[HuggingFaceDocBuilderDev]

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint.