XLA optimized Implementation of StaticCache with `Tensor Indexing API`#31129

Closed

huzama wants to merge 14 commits intohuggingface:mainfrom huzama:cache_utils_xla

+17-3

Commits on May 29, 2024

Use the Index_copy method to update static cache inplace and avoid recompilation during each iteration in XLA
huzama
committed

Commits on May 30, 2024

Use Index_copy method to update static cache inplace and avoid recompilation during each iteration in XLA
huzama
committed

Commits on Jun 5, 2024

Revert "Use Index_copy method to update static cache inplace and avoid recompilation during each iteration in XLA"
huzama
committed

Commits on Jun 15, 2024

Merge branch 'huggingface:main' into cache_utils_xla
huzama
authored