Skip to content

Commit

Permalink
format
Browse files Browse the repository at this point in the history
  • Loading branch information
Robert Shaw committed Jun 27, 2024
1 parent 7d8e9cd commit 2803761
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion vllm/model_executor/layers/linear.py
Original file line number Diff line number Diff line change
Expand Up @@ -277,7 +277,7 @@ def weight_loader(self, param: Parameter, loaded_weight: torch.Tensor):
start_idx = tp_rank * shard_size
loaded_weight = loaded_weight.narrow(output_dim, start_idx,
shard_size)

# Special case for loading scales off disk, which often
# do not have a shape.
if len(loaded_weight.shape) == 0:
Expand Down

0 comments on commit 2803761

Please sign in to comment.