-
Notifications
You must be signed in to change notification settings - Fork 27
Issues: MrYxJ/calculate-flops.pytorch
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
The FLOPS of scalar dot products in Attention has not been considered?
#46
opened Dec 23, 2024 by
XIronMan0220
RuntimeError: A view was created in no_grad mode and is being modified inplace with grad mode enabled. Given that this use case is ambiguous and error-prone, it is forbidden. You can clarify your code by moving both the view and the inplace either both inside the no_grad block (if you don't want the inplace to be tracked) or both outside (if you want the inplace to be tracked).
#44
opened Dec 5, 2024 by
JokeQ666
AttributeError: 'list' object has no attribute 'shape' in function _einsum_flops_compute()
#40
opened Oct 14, 2024 by
Necolizer
How to calculate the FLOPs when the model has some freezed variables, or using LoRA?
#30
opened Jun 23, 2024 by
Ledzy
你好,比如llama这些LLM模型,我看统计的结果好像没有包括attention矩阵的[email protected]那部分计算量。
#26
opened Jun 7, 2024 by
ywh187
What is the difference between the 'forward' mode and the 'generate' mode?
#20
opened Apr 7, 2024 by
AboveParadise
Previous Next
ProTip!
Type g p on any issue or pull request to go back to the pull request listing page.