Skip to content

Commit

Permalink
fixed format
Browse files Browse the repository at this point in the history
Signed-off-by: Amit Garg <[email protected]>
  • Loading branch information
garg-amit committed Oct 28, 2024
1 parent 525c7e8 commit b608555
Showing 1 changed file with 2 additions and 1 deletion.
3 changes: 2 additions & 1 deletion vllm/worker/cpu_model_runner.py
Original file line number Diff line number Diff line change
Expand Up @@ -325,7 +325,8 @@ def _prepare_decode(
input_mrope_positions[idx].extend(next_pos[idx])
else:
input_positions.append(position)
num_orig_input_tokens_list.append(seq_data.get_prompt_len())
num_orig_input_tokens_list.append(
seq_data.get_prompt_len())

seq_len = seq_len if self.sliding_window is None else min(
seq_len, self.sliding_window)
Expand Down

0 comments on commit b608555

Please sign in to comment.