Code

Partial local tokenizer load#9807

Code

Merged

LysandreJik merged 4 commits intomasterhuggingface/transformers:masterfrom partial-local-tokenizer-loadhuggingface/transformers:partial-local-tokenizer-loadCopy head branch name to clipboardJan 28, 2021

+27-10

Commits

Commits on Jan 27, 2021

• Allow partial loading of a cached tokenizer

  LysandreJik

  committed
  a38c345

  Copy full SHA for a38c345

• Warning > Info

  LysandreJik

  committed
  87897ab

  Copy full SHA for 87897ab

• Update src/transformers/tokenization_utils_base.py

  Show description for 6e5cd74
  

  LysandreJik

  and

  sgugger

  committed
  6e5cd74

  Copy full SHA for 6e5cd74

• Raise error if not local_files_only

  LysandreJik

  committed
  a9669e5

  Copy full SHA for a9669e5