Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Streamline/better documentation for torchtune -> transformers workflow #1388

Open
SalmanMohammadi opened this issue Aug 21, 2024 · 0 comments
Labels
discussion Start a discussion documentation Improvements or additions to documentation enhancement New feature or request

Comments

@SalmanMohammadi
Copy link
Collaborator

SalmanMohammadi commented Aug 21, 2024

We should make it easier for people to load models trained from torchtune into transformers (we could also document using huggingface-cli for upload too?). This could be better documentation i.e. highlighting the necessary steps to load a torchtune-hf checkpoint into a transformers model (just a case of renaming the final checkpoint?), or doing some plumbing ourselves, like saving final model checkpoints with filenames that are readily consumable by from_pretrained

ref #1381 #832 #878 #1122

@SalmanMohammadi SalmanMohammadi added documentation Improvements or additions to documentation enhancement New feature or request discussion Start a discussion best practice Things we should be doing but aren't and removed best practice Things we should be doing but aren't labels Aug 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
discussion Start a discussion documentation Improvements or additions to documentation enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant