Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

tokenizer is deprecated in the latest transformers and replaced with processing_class. Will llama-factory make the same change? #5892

Closed
techkang opened this issue Nov 1, 2024 · 1 comment
Closed

tokenizer is deprecated in the latest transformers and replaced with processing_class. Will llama-factory make the same change? #5892

techkang opened this issue Nov 1, 2024 · 1 comment
Labels
wontfix This will not be worked on

Comments

@techkang
Copy link

techkang commented Nov 1, 2024

Ref: huggingface/transformers#32385
@github-actions github-actions bot added the pending This problem is yet to be addressed label Nov 1, 2024
@hiyouga
Copy link
Owner

hiyouga commented Nov 1, 2024

for backward compatibility, we do not make any change for now

@hiyouga hiyouga added wontfix This will not be worked on and removed pending This problem is yet to be addressed labels Nov 1, 2024
@hiyouga hiyouga closed this as not planned Won't fix, can't repro, duplicate, stale Nov 1, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
wontfix This will not be worked on
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@hiyouga @techkang