Update checkpointing directory -> using vLLM and from_pretrained#2074

Merged

felipemello1 merged 39 commits intopytorch:mainfrom felipemello1:checkpointer

Dec 6, 2024

+869-256

Commits on Nov 22, 2024

comments
Felipe Mello
committed

Commits on Nov 25, 2024

save ckpt compatible with hf

Felipe Mello
and
vancoykendall
committed
checking differences
Felipe Mello
committed

Commits on Nov 26, 2024

add better ckpt paths
Felipe Mello
committed
add base_model_name_or_path
Felipe Mello
committed

Commits on Nov 27, 2024

better support for adapter / recipe state defaults
Felipe Mello
committed
copy files from ckpt dir to output dir
Felipe Mello
committed
mkdir + dont copy cache
Felipe Mello
committed

Commits on Dec 2, 2024

minor updates
Felipe Mello
committed
modularization + better logic
Felipe Mello
committed

Commits on Dec 3, 2024

comment
Felipe Mello
committed
fix ckpt file
Felipe Mello
committed
remove contants from init
Felipe Mello
committed
update hardcoded dirname
Felipe Mello
committed
update docs
Felipe Mello
committed
fix tests
Felipe Mello
committed

Commits on Dec 4, 2024

checkpointer tests pass
Felipe Mello
committed
dowloads tests pass
Felipe Mello
committed
update recipe tests
Felipe Mello
committed
and another one
Felipe Mello
committed

Commits on Dec 5, 2024

update more tests
Felipe Mello
committed
and another one
Felipe Mello
committed
add suffix variable based on ckpter type
Felipe Mello
committed
and another one
Felipe Mello
committed
ooops
Felipe Mello
committed
YOU SHALL PASS
Felipe Mello
committed

Commits on Dec 6, 2024

is this it?
Felipe Mello
committed
modularize + tests + back to .pt
Felipe Mello
committed
docstrings
Felipe Mello
committed
hardcod to look for recipe_state.pt if its not provided
Felipe Mello
committed
update input_dir
Felipe Mello
committed
input dir != output dir
Felipe Mello
committed
replace todo
Felipe Mello
committed
add todo
Felipe Mello
committed
Merge branch 'main' into checkpointer
Felipe Mello
committed
merge conflict
Felipe Mello
committed
fix paths
Felipe Mello
committed
...
Felipe Mello
committed
typo
Felipe Mello
committed