Code

Limit decode block size#532

Code

Merged

michalkuligowski merged 15 commits intohabana_mainHabanaAI/vllm-fork:habana_mainfrom dev/mfylcek/limit_cpa_bucket_sizeHabanaAI/vllm-fork:dev/mfylcek/limit_cpa_bucket_sizeCopy head branch name to clipboardNov 25, 2024

+6-4

Commits

Commits on Nov 21, 2024

• Limit bucket size

  mfylcek

  committed
  300db1c

  Copy full SHA for 300db1c

• Limit bucket size for flat PA

  mfylcek

  committed
  90a963c

  Copy full SHA for 90a963c

• Limit in find_bucket

  mfylcek

  committed
  7f61b91

  Copy full SHA for 7f61b91

Commits on Nov 22, 2024

• Update decode block limit in hpu_worker

  mfylcek

  committed
  e6ef1bf

  Copy full SHA for e6ef1bf

• Merge branch 'habana_main' into dev/mfylcek/limit_cpa_bucket_size

  mfylcek

  authored
  1c8f4ca

  Copy full SHA for 1c8f4ca

• mypy

  mfylcek

  committed
  2bbe059

  Copy full SHA for 2bbe059

• Merge with HPUBucketingContext

  mfylcek

  committed
  b6cc6c2

  Copy full SHA for b6cc6c2

• Fix assert

  mfylcek

  committed
  1384519

  Copy full SHA for 1384519

• Set limit for bucketing context inside _prepare_decode

  mfylcek

  committed
  beecb2f

  Copy full SHA for beecb2f

• Remove the line from hpu_worker

  mfylcek

  committed
  ada5ee9

  Copy full SHA for ada5ee9

• Remove unnecessary

  mfylcek

  committed
  b0c60b6

  Copy full SHA for b0c60b6

• Set it in hpu_worker

  mfylcek

  committed
  34f3c1f

  Copy full SHA for 34f3c1f

• Update requirements

  mfylcek

  committed
  5fc2d25

  Copy full SHA for 5fc2d25

• Merge branch 'habana_main' into dev/mfylcek/limit_cpa_bucket_size

  mfylcek

  authored
  17a561b

  Copy full SHA for 17a561b

Commits on Nov 25, 2024

• Update reqs

  mfylcek

  committed
  18b6dac

  Copy full SHA for 18b6dac