Skip to content

Commit

Permalink
[Misc] remove duplicate definition of seq_lens_tensor in model_runn…
Browse files Browse the repository at this point in the history
  • Loading branch information
ita9naiwa authored and blinkbear committed May 31, 2024
1 parent dcfc9b2 commit 830a74b
Showing 1 changed file with 0 additions and 3 deletions.
3 changes: 0 additions & 3 deletions vllm/worker/model_runner.py
Original file line number Diff line number Diff line change
Expand Up @@ -518,9 +518,6 @@ def _prepare_model_input(
else:
multi_modal_input = None

seq_lens_tensor = torch.tensor(seq_lens,
dtype=torch.int,
device=self.device)
query_lens_tensor = torch.tensor(query_lens,
dtype=torch.long,
device=self.device)
Expand Down

0 comments on commit 830a74b

Please sign in to comment.