Code

Fix long contexts in LoRA#624

Code

Merged

vivekgoe merged 2 commits intohabana_mainHabanaAI/vllm-fork:habana_mainfrom fix-lora-long-contextsHabanaAI/vllm-fork:fix-lora-long-contextsCopy head branch name to clipboardJan 2, 2025

+24-6

Commits

Commits on Dec 30, 2024

• Fix _prepare_cos_sin flow in RoPE for LoRA + long-contexts

  SanjuCSudhakaran

  committed
  99c89da

  Copy full SHA for 99c89da

Commits on Jan 2, 2025

• Handle cos-sin cache in every forward in case of long-context + LoRA

  SanjuCSudhakaran

  committed
  c52c37e

  Copy full SHA for c52c37e