Enable option for subword regularization in more tokenizers.#11417
Merged
LysandreJik merged 56 commits intohuggingface:masterfrom German-NLP-Group:subword_reg_in_more_sentencep_tokMay 13, 2021
+578-181
Commits
Commits on May 10, 2021
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
Commits on May 11, 2021
Commits on May 12, 2021
- committed
- committed
- committed
- committed
- committed
- committed
- committed