fix forward batching for seq2seq and right padding models.#139

Merged

lvwerra merged 10 commits intomainfrom forward_batching

Feb 9, 2023

+131-38

Commits on Feb 8, 2023

add batching tests
leandro
committed

Commits on Feb 9, 2023

fix t5 test
leandro
committed
update tests to include bs=1 case
leandro
committed
update fwd batching
leandro
committed
move model init to setUpClass to avoid repeated loading
leandro
committed
Merge branch 'main' into forward_batching
leandro
committed
fix tests which require a fresh model
leandro
committed
update default fwd bs
leandro
committed
clarifying comment
leandro
committed
fix style
leandro
committed