Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
[SW-209062] Disable default sdpa in Albert (#22)
Transformers v4.45 introduced sdpa as the default implementation in Albet. This caused performance drop. Adding Albert to the list of models which don't yet have sdpa implementation in Gaudi and use thus eager attention.
- Loading branch information