-
Notifications
You must be signed in to change notification settings - Fork 176
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Upload the model with push_to_hub in examples #297
Conversation
716cd33
to
5c0ca8c
Compare
5c0ca8c
to
f037ea6
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Everything appears to be in order.
NB: ignore the codecov message below, it's a lie.
Let's test this in one of the internal runs (we could take an existing run and add an auxiliary uploader @ QYP, then see if it can upload 2 consecutive checkpoints)
Codecov Report
@@ Coverage Diff @@
## master #297 +/- ##
==========================================
+ Coverage 81.86% 82.03% +0.16%
==========================================
Files 63 65 +2
Lines 5813 5856 +43
==========================================
+ Hits 4759 4804 +45
+ Misses 1054 1052 -2
|
- Removed hivemind.utils.threading.run_in_background and HIVEMIND_THREADS - Refactored MPFuture to be a single object instead of a linked pair of objects - MPFuture now uses a single process-wide pipe and thread, instead of spawning new pipe/thread for each future - MPFuture.result/exception can now only be awaited from the process that created it - MPFuture now returns the same exception types as regular future (and as asyncio.Future in __await__) - Added more thorough tests for MPFuture Co-authored-by: Alexander Borzunov <[email protected]> Co-authored-by: Max Ryabinin <[email protected]> Co-authored-by: Michael Diskin <[email protected]>
* Split hivemind.client into hivemind.averaging and hivemind.moe * Reduce the number of wildcard imports, update docs
Co-authored-by: justheuristic <[email protected]>
Co-authored-by: Max Ryabinin <[email protected]>
Co-authored-by: Max Ryabinin <[email protected]>
Co-authored-by: Max Ryabinin <[email protected]>
Co-authored-by: Max Ryabinin <[email protected]>
Co-authored-by: Max Ryabinin <[email protected]>
Co-authored-by: Max Ryabinin <[email protected]>
Pushing model and optimizer checkpoints to HuggingFace Hub using their API