Pass kwargs to tokenizer when creating preprocessor#1632

Merged

mattdangerw merged 1 commit intokeras-team:masterfrom SamanehSaadat:master

May 17, 2024

+8-1

Commits on May 17, 2024

Pass kwargs to tokenizer when creating preprocessor from a tokenizer.json
SamanehSaadat
committed