Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DPOTrainer] Add multiprocessing for the eval_dataset map #1307

Merged
merged 1 commit into from
Feb 1, 2024

Conversation

esceptico
Copy link
Contributor

Added the num_proc parameter to the eval_dataset processing (similar to train_dataset)

cc @kashif

@kashif kashif self-requested a review February 1, 2024 15:28
@kashif
Copy link
Collaborator

kashif commented Feb 1, 2024

thanks! having a look

@kashif kashif merged commit 8149303 into huggingface:main Feb 1, 2024
@esceptico esceptico deleted the patch-1 branch February 1, 2024 23:30
lapp0 pushed a commit to lapp0/trl that referenced this pull request May 10, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants