New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feature request: support 4d attention masks #1594

Open

poedator opened this issue Dec 23, 2023 · 0 comments

poedator commented Dec 23, 2023

this is a Feature Request to implement custom 4D mask for Llama (and possibly any other model) similar to huggingface/transformers#27539

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment