Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

一些关于代码att部分的问题 #6

Open
WeiYu021 opened this issue Sep 11, 2022 · 1 comment
Open

一些关于代码att部分的问题 #6

WeiYu021 opened this issue Sep 11, 2022 · 1 comment

Comments

@WeiYu021
Copy link

你好，感谢你杰出的工作，但是有些地方，我无法理解论文公式在代码中的体现。在论文中，在输入softmax前除以根号C，但在代码中，为何在softmax后，需要对其除以sum，这样做是为了什么，希望得到指点，谢谢！
论文
CASD
@SHULJJ
Copy link

SHULJJ commented Sep 20, 2022

同学你好，你也上大的吗，我也在研究这个方向，可否加个好友交流？

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@SHULJJ @WeiYu021