Skip to content

🚨🚨 🚨🚨 [Tokenizer] attemp to fix add_token issues🚨🚨 🚨🚨 #23909

Merged
ArthurZucker merged 268 commits intohuggingface:mainfrom ArthurZucker:fix-add-tokensSep 18, 2023

Commits

This pull request is big! We're only showing the most recent 250 commits

Commits on Jun 2, 2023

Commits on Jun 3, 2023

Commits on Jun 14, 2023

Commits on Jun 16, 2023

Commits on Jun 19, 2023

Commits on Jun 20, 2023

Commits on Jun 24, 2023

Commits on Jun 25, 2023

Commits on Jun 26, 2023

Commits on Jul 26, 2023

Commits on Jul 27, 2023

Commits on Jul 28, 2023

Commits on Jul 31, 2023

Commits on Aug 3, 2023

Commits on Aug 4, 2023

Commits on Aug 7, 2023

Commits on Aug 8, 2023

Commits on Aug 9, 2023

Commits on Aug 10, 2023

Commits on Aug 11, 2023

Commits on Aug 16, 2023

Commits on Aug 21, 2023

Commits on Aug 31, 2023

Commits on Sep 1, 2023

Commits on Sep 5, 2023

Commits on Sep 6, 2023

Commits on Sep 7, 2023

Commits on Sep 11, 2023

Commits on Sep 12, 2023

Commits on Sep 13, 2023