Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[tuning] add lambo ehrlich example, tune params #51

Conversation

samuelstanton
Copy link
Contributor

This PR is mainly for visibility, we can talk about which (if any) of these changes we want to keep

Changes:

  • Add LaMBO-2/Ehrlich example script
  • Add genetic algorithm presolver to example
  • Add constraint task, modify guidance signal config to include the constraint classifier
  • Add more random restarts to initial solution
  • Add ranked FFT from beignet to help prevent generative head collapse
  • Increase training duration
  • Increase number of ensemble components
  • Train discriminators on corrupted inputs
  • Switch trainer to mixed-precision on GPU

Note: requires updates from this cortex PR to run

@miguelgondu
Copy link
Collaborator

I'll merge these changes in #55.

@miguelgondu
Copy link
Collaborator

Changes merged in #55.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants