We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
The node torch.ops.aten._assert_tensor_metadata.default occurred when using torch 2.7.0.dev, which was the culprit causing graph breaks.
torch.ops.aten._assert_tensor_metadata.default
from __future__ import annotations import os import torch import torch_tensorrt os.environ["CI_BUILD"] = "1" class MyModule(torch.nn.Module): def __init__(self) -> None: super().__init__() def forward(self, x: torch.Tensor) -> torch.Tensor: x = x + x x = x.float() x = x * x x = x.half() x = x - x return x with torch.inference_mode(): model = MyModule().eval().cuda().half() inputs = [torch.randn(1, 3, 5, 7, dtype=torch.half, device="cuda")] trt_model = torch_tensorrt.compile(model, "dynamo", inputs, debug=True, min_block_size=1, use_explicit_typing=True) torch.testing.assert_close(trt_model(*inputs), model(*inputs), rtol=5e-3, atol=5e-3) print("assert_close passed")
Log diff: https://www.diffchecker.com/qe8cYJAS/
The text was updated successfully, but these errors were encountered:
@peri044 has a fix
Sorry, something went wrong.
This is fixed in #3395
peri044
No branches or pull requests
Bug Description
The node
torch.ops.aten._assert_tensor_metadata.default
occurred when using torch 2.7.0.dev, which was the culprit causing graph breaks.To Reproduce
Log diff: https://www.diffchecker.com/qe8cYJAS/
The text was updated successfully, but these errors were encountered: