Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Need to Modify Config Files to Reproduce Results from the Paper? #12

Open
MyFirstKindom opened this issue Jul 19, 2024 · 3 comments
Open

Comments

@MyFirstKindom
Copy link

Hello,

I am attempting to reproduce the results presented in the paper [Title of the Paper]. Could you please clarify whether it is necessary to modify the config files provided in the repository? If so, could you provide guidance on which specific parameters or sections need to be adjusted to achieve the same experimental setup as described in the paper?

Thank you for your assistance.

@MyFirstKindom
Copy link
Author

df4ca89ea184035472f6af947ffdf0b2
This is the result of my run, and it seems to be slightly different from the one in the paper.

@MyFirstKindom
Copy link
Author

This is the instruction I use for evaluation:
python evaluation.py --lr_dir=../logged_files/CIFAR10/10/ConvNet/my_run_name/Normal/lr_best.pt --data_dir=../logged_files/CIFAR10/10/ConvNet/my_run_name/Normal/images_best.pt --label_dir=../logged_files/CIFAR10/10/ConvNet/my_run_name/Normal/labels_best.pt --zca

@GzyAftermath
Copy link
Collaborator

Sorry for the late response.
Maybe it's because you didn't change the parameters used in training the expert models. (As we reported in the paper, we generate expert trajectories in the same way as FTD without modifying the involved hyperparameters.)
So please refer to the FTD paper to get the hyper-parameters used in buffer.py

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants