-
Notifications
You must be signed in to change notification settings - Fork 1.5k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
ci: Enable TF-TRT tests #7399
ci: Enable TF-TRT tests #7399
Conversation
Don't merge just yet. Once the r24.07 branch is ready, then merge these changes into that branch. |
|
…erver into spolisetty_tf_trt_tests
can we change target branch to |
@mc-nv I have no strong objections to change it to target |
What does the PR do?
This PR re-enables the L0_tftrt_optimization and L0_warmup TF-TRT tests that have been disabled since 24.05.
Checklist
<commit_type>: <Title>
Commit Type:
Check the conventional commit type
box here and add the label to the github PR.
Related PRs:
Where should the reviewer start?
Test plan:
Caveats:
Background
In the 24.05 release, implicit batch support was removed as part of the TRT v10 upgrade. As a result, the TF backend was unable to build TF-TRT engines for implicit batch TF models because it was using implicit batching by default. In the upcoming TF release, the TF backend will use dynamic batching by default, enabling it to successfully build TF-TRT models.
Related Issues: (use one of the action keywords Closes / Fixes / Resolves / Relates to)