BPE: fixed typo

[d-kleine]

• fixed minor typo for decode() method in BPE tokenizer

[review-notebook-app]

Check out this pull request on 

See visual diffs & provide feedback on Jupyter Notebooks.

---

Powered by ReviewNB

[rasbt]

Good catch as always!

[d-kleine]

BTW the the-verdict.txt file will be downloaded again. My suggestion would be to use the file from the main chapter code folder (and if not existing, download it to same folder), but I would leave this decision to you:

import os
import urllib.request

if not os.path.exists("../01_main-chapter-code/the-verdict.txt"): # added ../01_main-chapter-code/
    url = ("https://raw.githubusercontent.com/rasbt/"
           "LLMs-from-scratch/main/ch02/01_main-chapter-code/"
           "the-verdict.txt")
    file_path = "../01_main-chapter-code/the-verdict.txt" # added ../01_main-chapter-code/
    urllib.request.urlretrieve(url, file_path)

with open("../01_main-chapter-code/the-verdict.txt", "r", encoding="utf-8") as f: # added ../01_main-chapter-code/
    text = f.read()

[rasbt]

import os
import urllib.request

if not os.path.exists("../01_main-chapter-code/the-verdict.txt"): # added ../01_main-chapter-code/
    url = ("https://raw.githubusercontent.com/rasbt/"
           "LLMs-from-scratch/main/ch02/01_main-chapter-code/"
           "the-verdict.txt")
    file_path = "../01_main-chapter-code/the-verdict.txt" # added ../01_main-chapter-code/
    urllib.request.urlretrieve(url, file_path)

with open("../01_main-chapter-code/the-verdict.txt", "r", encoding="utf-8") as f: # added ../01_main-chapter-code/
    text = f.read()

Thanks, that's a good idea!