Pre-trained models for the Merged Attention Model?

[TheShadow29]

Thanks for the amazing repository. The code is really clean. If I understand correctly, the current implementation is co-attention model, and same for pre-trained weights. I wanted to know if you had plans to release the merge attention model weights as well! Thanks in advance!

[zdou0830]

Thanks! Right now we don't have plans for releasing the merged attention model weights, but we may release the code in the future.

[DreamCatcher-cai]

Thanks! Right now we don't have plans for releasing the merged attention model weights, but we may release the code in the future.

Hi, may I ask when are you going to release the code for merged attention implementation?