Skip to content

Commit

Permalink
Merge pull request #318 from robertknight/cross-attention-kv-cache
Browse files Browse the repository at this point in the history 
Support cross-attention key-value caches in rten-generate
  • Loading branch information
@robertknight
robertknight authored Aug 23, 2024
2 parents 36a1444 + 0f82720 commit 2f4e3ee
Showing 1 changed file with 251 additions and 75 deletions.
Loading

0 comments on commit 2f4e3ee

Please sign in to comment.