Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Take cache mode activations off the GPU #355

Merged
merged 1 commit into from
Mar 11, 2024

Conversation

stefan-apollo
Copy link
Collaborator

@stefan-apollo stefan-apollo commented Mar 5, 2024

Take cache mode activations off the GPU

Description

In _append_to_hooked_list (which is used only by analysis hooks) we now move the data to CPU to save VRAM.

Related Issue

Fixes #278

How Has This Been Tested?

Using this hook in feature viz code worked fine.

Does this PR introduce a breaking change?

No.

@nix-apollo nix-apollo merged commit a3f4003 into main Mar 11, 2024
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Set tensors to cpu in _append_to_hooked_list
2 participants