New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feature request: support 4D attention masks #1250

Open

poedator opened this issue Dec 23, 2023 · 0 comments

Assignees

Labels

poedator commented Dec 23, 2023

this is a Feature Request to implement custom 4D mask for Llama (and possibly any other model) similar to huggingface/transformers#27539

poedator changed the title ~~support 4D masks~~ feature request: support 4D attention masks

jiazhihao added this to FlexFlow Serve

jiazhihao added the enhancement label

jiazhihao moved this to 🏗 In progress in FlexFlow Serve

jiazhihao self-assigned this

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment