Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Activation Offloading for Lora DPO #2083

Closed
Tracked by #2008
Vattikondadheeraj opened this issue Nov 27, 2024 · 2 comments · Fixed by #2087
Closed
Tracked by #2008

Activation Offloading for Lora DPO #2083

Vattikondadheeraj opened this issue Nov 27, 2024 · 2 comments · Fixed by #2087
Assignees
@SalmanMohammadi

Comments

@Vattikondadheeraj
Copy link

Hey, I am wondering, if activation offloading is present in the lora distributed DPO or not? because I cannot find any terms related to activation offloading. If not, are there plans to release it?
@SalmanMohammadi
Copy link
Collaborator

Hey @Vattikondadheeraj. This should be possible - I'll take a look.

@SalmanMohammadi SalmanMohammadi self-assigned this Nov 27, 2024
This was referenced Nov 27, 2024
Closed
Merged
@SalmanMohammadi
Copy link
Collaborator

This feature should be included in our next nightly build, and our upcoming 0.5 stable release @Vattikondadheeraj! Give it a try : )

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@SalmanMohammadi SalmanMohammadi

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

DPO Activation Offloading SalmanMohammadi/torchtune
2 participants
@SalmanMohammadi @Vattikondadheeraj