Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add ability to run models via __call__(), and not just using generate() #18

Closed
jalammar opened this issue Jan 6, 2021 · 0 comments · Fixed by #33
Closed

Add ability to run models via __call__(), and not just using generate() #18

jalammar opened this issue Jan 6, 2021 · 0 comments · Fixed by #33
Assignees
Labels
enhancement New feature or request

Comments

@jalammar
Copy link
Owner

jalammar commented Jan 6, 2021

Ecco currently only runs models using the generate() method. This makes it more geared towards GPT-like models. adding support to running models via call(), and collecting activations/saliency of that run would make it much useful. It opens the door towards supporting MLMs #6.

I am currently working on this in https://github.com/jalammar/ecco/tree/batch-input-activations

@jalammar jalammar added the enhancement New feature or request label Jan 6, 2021
@jalammar jalammar self-assigned this Jan 6, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant