Skip to content

Commit

Permalink
Fix TP>1 in encoder-decoder models (#607)
Browse files Browse the repository at this point in the history
  • Loading branch information
jkaniecki authored Dec 10, 2024
1 parent 15774c4 commit def7ac2
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions vllm/worker/hpu_enc_dec_model_runner.py
Original file line number Diff line number Diff line change
Expand Up @@ -168,6 +168,7 @@ def as_broadcastable_tensor_dict(self) -> Dict[str, Any]:
tensor_dict = {
"input_tokens": self.input_tokens,
"input_positions": self.input_positions,
"multi_modal_kwargs": self.multi_modal_kwargs,
"encoder_input_tokens": self.encoder_input_tokens,
"encoder_input_positions": self.encoder_input_positions,
}
Expand Down

0 comments on commit def7ac2

Please sign in to comment.