Skip to content

Geting LoRA working with RWKV (v5 Eagle, probably, rather than v6 Finch). Large Language Model stuff. Get GPT performance from RNN-like LLM.

License

Notifications You must be signed in to change notification settings

bballdave025/rwkv-lora

Repository files navigation

rwkv-lora

Geting LoRA working with RWKV (v5 Eagle, probably, rather than v6 Finch).

Start with an already-done LoRA on FLAN-T5

Learn the LoRA adapter in a way that's been known to work.

About

Geting LoRA working with RWKV (v5 Eagle, probably, rather than v6 Finch). Large Language Model stuff. Get GPT performance from RNN-like LLM.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published