Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Accuracy Benchmarking #11

Open
etrommer opened this issue Dec 5, 2022 · 1 comment
Open

Accuracy Benchmarking #11

etrommer opened this issue Dec 5, 2022 · 1 comment
Assignees
Labels
research Experiments and Evaluations

Comments

@etrommer
Copy link
Owner

etrommer commented Dec 5, 2022

Benchmarking of model accuracy when retrained using several modes is required.

Likely candidates for comparison:

  • Baseline (retraining with accurate multiplication but same hyperparamters)
  • Gaussian Noise of same stdev as multiplier
  • Behavioral Simulation (LUT)
  • Regression Models
@etrommer etrommer added the documentation Improvements or additions to documentation label Dec 5, 2022
@etrommer etrommer self-assigned this Dec 5, 2022
@etrommer
Copy link
Owner Author

Corresponding issue in agn-approx repository

etrommer/agn-approx#3

agn-approx is used to host high-level implementations of datamodules, network models, experiments, etc.

@etrommer etrommer added research Experiments and Evaluations and removed documentation Improvements or additions to documentation labels Dec 14, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
research Experiments and Evaluations
Projects
None yet
Development

When branches are created from issues, their pull requests are automatically linked.

1 participant