Skip to content

Commit

Permalink
updated readme
Browse files Browse the repository at this point in the history
  • Loading branch information
@jessechancy
jessechancy committed Aug 27, 2022
1 parent 0433bec commit 415b3ba
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions scripts/tokenizers/README.md
View file
Original file line number Diff line number Diff line change
@@ -1,6 +1,7 @@
# Training WordPiece Vocabularies on Wikipedia

This is unmaintained helper code for training the vocabularies on Wikipedia.
It is advised to run these scripts on GCS.

### Screens
Use screens to continue the download even when the terminal is not open!
Expand Down

0 comments on commit 415b3ba

Please sign in to comment.