Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Dec 06 rebase #571

Merged
merged 232 commits into from
Dec 9, 2024
Merged

Dec 06 rebase #571

merged 232 commits into from
Dec 9, 2024

Conversation

kzawora-intel
Copy link

No description provided.

B-201 and others added 30 commits November 18, 2024 12:57
@B-201
[Model][LoRA]LoRA support added for glm-4v (vllm-project#10418)
5be4e52 
Signed-off-by: B-201 <[email protected]>
@Isotr0py
[Model] Remove transformers attention porting in VITs (vllm-project#1…
e7ebb66 
…0414)

Signed-off-by: Isotr0py <[email protected]>
@B-201
[Doc] Update doc for LoRA support in GLM-4V (vllm-project#10425)
4186be8 
Signed-off-by: B-201 <[email protected]>
@youkaichao
[5/N][torch.compile] torch.jit.script --> torch.compile (vllm-project…
7851b45 
…#10406)

Signed-off-by: youkaichao <[email protected]>
@ismael-dm
[Doc] Add documentation for Structured Outputs (vllm-project#9943)
31894a2 
Signed-off-by: ismael-dm <[email protected]>
@andrew
Fix open_collective value in FUNDING.yml (vllm-project#10426)
4f686d1 
Signed-off-by: Andrew Nesbitt <[email protected]>
@mgoin
[Model][Bugfix] Support TP for PixtralHF ViT (vllm-project#10405)
281cc4b 
Signed-off-by: mgoin <[email protected]>
@yma11
[Hardware][XPU] AWQ/GPTQ support for xpu backend (vllm-project#10107)
6b2d25e 
Signed-off-by: yan ma <[email protected]>
@angusYuhao
[Kernel] Explicitly specify other value in tl.load calls (vllm-projec…
c2170a5 
…t#9014)

Signed-off-by: Angus Wang <[email protected]>
@LucasWilkinson
[Kernel] Initial Machete W4A8 support + Refactors (vllm-project#9855)
96d999f 
Signed-off-by: Lucas Wilkinson <[email protected]>
@youkaichao
[3/N][torch.compile] consolidate custom op logging (vllm-project#10399)
a03ea40 
Signed-off-by: youkaichao <[email protected]>
@youkaichao
[ci][bugfix] fix kernel tests (vllm-project#10431)
2298e69 
Signed-off-by: youkaichao <[email protected]>
@rickyyx
[misc] partial prefix & random input generation benchmark (vllm-proje…
90a6c75 
…ct#9929)

Signed-off-by: rickyx <[email protected]>
@khluu
[ci/build] Have dependabot ignore all patch update (vllm-project#10436)
284203f 
We have too many dependencies and all patch updates can be a little noisy. This is to have dependabot ignore all patch version updates.
@jeejeelee
[Bugfix]Fix Phi-3 BNB online quantization (vllm-project#10417)
7eb719d 
Signed-off-by: Jee Jee Li <[email protected]>
@MengqingCao
[Platform][Refactor] Extract func get_default_attn_backend to `Plat…
8c1fb50 
…form` (vllm-project#10358)

Signed-off-by: Mengqing Cao <[email protected]>
@mgoin
Add openai.beta.chat.completions.parse example to structured_outputs.…
74f8c2c 
…rst (vllm-project#10433)
@tjohnson31415
[Bugfix] Guard for negative counter metrics to prevent crash (vllm-pr…
272e31c 
…oject#10430)

Signed-off-by: Travis Johnson <[email protected]>
@jeejeelee
[Misc] Avoid misleading warning messages (vllm-project#10438)
382b6a4 
Signed-off-by: Jee Jee Li <[email protected]>
@russellb
[Doc] Add the start of an arch overview page (vllm-project#10368)
5390d66
@youkaichao
[misc][plugin] improve plugin loading (vllm-project#10443)
25f9c78 
Signed-off-by: youkaichao <[email protected]>
@zhouyuan
[CI][CPU] adding numa node number as container name suffix (vllm-proj…
b461465 
…ect#10441)

Signed-off-by: Yuan Zhou <[email protected]>
@xiyuan-lee
[BugFix] Fix hermes tool parser output error stream arguments in some…
f028dff 
… cases (vllm-project#10395) (vllm-project#10398)

Signed-off-by: xiyuan lee <[email protected]>
@patrickvonplaten
[Pixtral-Large] Pixtral actually has no bias in vision-lang adapter (v…
11fd7ea 
…llm-project#10449)
@mikejuliet13 @B-201
@Isotr0py @youkaichao @ismael-dm @andrew @mgoin @yma11 @angusYuhao @LucasWilkinson @rickyyx @khluu @jeejeelee @MengqingCao @tjohnson31415 @russellb
Fix: Build error seen on Power Architecture (vllm-project#10421)
1ea291a 
Signed-off-by: Manjul Mohan <[email protected]>
Signed-off-by: B-201 <[email protected]>
Signed-off-by: Isotr0py <[email protected]>
Signed-off-by: youkaichao <[email protected]>
Signed-off-by: ismael-dm <[email protected]>
Signed-off-by: Andrew Nesbitt <[email protected]>
Signed-off-by: mgoin <[email protected]>
Signed-off-by: yan ma <[email protected]>
Signed-off-by: Angus Wang <[email protected]>
Signed-off-by: Lucas Wilkinson <[email protected]>
Signed-off-by: rickyx <[email protected]>
Signed-off-by: Jee Jee Li <[email protected]>
Signed-off-by: Mengqing Cao <[email protected]>
Signed-off-by: Travis Johnson <[email protected]>
Co-authored-by: Manjul Mohan [email protected] <[email protected]>
Co-authored-by: B-201 <[email protected]>
Co-authored-by: Isotr0py <[email protected]>
Co-authored-by: youkaichao <[email protected]>
Co-authored-by: ismael-dm <[email protected]>
Co-authored-by: Andrew Nesbitt <[email protected]>
Co-authored-by: Michael Goin <[email protected]>
Co-authored-by: Yan Ma <[email protected]>
Co-authored-by: Angus Wang <[email protected]>
Co-authored-by: Lucas Wilkinson <[email protected]>
Co-authored-by: Ricky Xu <[email protected]>
Co-authored-by: Kevin H. Luu <[email protected]>
Co-authored-by: Jee Jee Li <[email protected]>
Co-authored-by: Mengqing Cao <[email protected]>
Co-authored-by: Travis Johnson <[email protected]>
Co-authored-by: Russell Bryant <[email protected]>
@russellb
[Doc] fix link for page that was renamed (vllm-project#10455)
fd9f124 
Signed-off-by: Russell Bryant <[email protected]>
@youkaichao
[6/N] torch.compile rollout to users (vllm-project#10437)
803f37e 
Signed-off-by: youkaichao <[email protected]>
@russellb
[Core] Avoid metrics log noise when idle (vllm-project#8868)
efa9084 
Signed-off-by: Russell Bryant <[email protected]>
@ElizaWszola
[Model][Quantization] HQQ support through Marlin kernel expansion (vl…
b00b33d 
…lm-project#9766)

Signed-off-by: ElizaWszola <[email protected]>
@maxdebayser
Change granite chat template to keep json list formatting for tool ca…
a324d3a 
…lls (vllm-project#10452)

Signed-off-by: Max de Bayser <[email protected]>
khluu and others added 25 commits December 4, 2024 15:02
@khluu
[ci/build] Change queue name for Release jobs (vllm-project#10875)
fa2dea6
@khluu
[ci/build] Job to build and push release image (vllm-project#10877)
c9ca4fc
@o2363286
[bugfix] fixed parameter “n” when set parameter “bestof” > 1 (vllm-pr…
8db957e 
…oject#10854)

Signed-off-by: jianzheng <[email protected]>
@khluu
[ci/build] Update vLLM postmerge ECR repo (vllm-project#10887)
c92acb9
@xyang16
[LoRA] Change lora_tokenizers capacity (vllm-project#10796)
01d079f 
Signed-off-by: Xin Yang <[email protected]>
@Isotr0py
[Model] Consolidate ViTs attention implementation without mask (vllm-…
10398b4 
…project#10893)

Signed-off-by: Isotr0py <[email protected]>
@xuechendi @mgoin
Benchmark serving structured output (vllm-project#10880)
82eb5ea 
Signed-off-by: Chendi Xue <[email protected]>
Co-authored-by: Michael Goin <[email protected]>
@dtrifiro @youkaichao
[CI/Build] improve python-only dev setup (vllm-project#9621)
e4c34c2 
Signed-off-by: Daniele Trifirò <[email protected]>
Signed-off-by: youkaichao <[email protected]>
Co-authored-by: youkaichao <[email protected]>
@WoosukKwon
[V1] Fix when max_model_len is not divisible by block_size (vllm-proj…
2a56e12 
…ect#10903)

Signed-off-by: Woosuk Kwon <[email protected]>
@khluu
[benchmark] Make H100 benchmark optional (vllm-project#10908)
7883c2b
@mgoin
[Bugfix] Fallback to outlines for complex json schemas (vllm-project#…
8d370e9 
…10899)

Signed-off-by: mgoin <[email protected]>
@DarkLight1337
[Doc] Create a new "Usage" section (vllm-project#10827)
aa39a8e 
Signed-off-by: DarkLight1337 <[email protected]>
@jeejeelee
[Bugfix] Fix BNB loader target_modules (vllm-project#10720)
1f958a7 
Signed-off-by: Jee Jee Li <[email protected]>
@tjohnson31415
[Misc] Update llama 3.2 template to support system prompt with images (…
39c89e7 
…vllm-project#10901)

Signed-off-by: Travis Johnson <[email protected]>
@jeejeelee
[Misc][LoRA] Clean up the function interface of Punica (vllm-project#…
571da8f 
…10917)

Signed-off-by: Jee Jee Li <[email protected]>
@Isotr0py @DarkLight1337
[CI/Build] Bump test transformers version (vllm-project#10106)
998eeaf 
Signed-off-by: Isotr0py <[email protected]>
Signed-off-by: DarkLight1337 <[email protected]>
Co-authored-by: DarkLight1337 <[email protected]>
@kzawora-intel
[Misc][Gaudi] Avoid torch.compile and enable lazy collectives (vllm-p…
a430652 
…roject#10897)

Signed-off-by: Konrad Zawora <[email protected]>
@youkaichao
[ci][build] add tests for python only compilation (vllm-project#10915)
9743d64 
Signed-off-by: youkaichao <[email protected]>
@youkaichao
[torch.compile] use size tuning for specific sizes (vllm-project#10933)
db87eb6 
Signed-off-by: youkaichao <[email protected]>
@youkaichao @WoosukKwon
[torch.compile] add logging for compilation time (vllm-project#10941)
b031a45 
Signed-off-by: youkaichao <[email protected]>
Co-authored-by: Woosuk Kwon <[email protected]>
@DarkLight1337
[CI/Build] Fix broken multimodal test (vllm-project#10950)
222f5b0
@youkaichao
[torch.compile] fix deprecated code (vllm-project#10948)
a1887f2 
Signed-off-by: youkaichao <[email protected]>
@xuechendi
fix WorkerWrapperBase and spec_decode rebase (#582)
858e0a0 
Need to test with TORCH_COMPILE_DISABLE=true

Signed-off-by: Chendi.Xue <[email protected]>
@kzawora-intel
Merge remote-tracking branch 'origin/habana_main' into HEAD
21323ed
@kzawora-intel
Merge remote-tracking branch 'upstream/main' into HEAD
d8f395e
@kzawora-intel kzawora-intel changed the title Dec 02 rebase Dec 06 rebase Dec 6, 2024
@kzawora-intel kzawora-intel merged commit ad8d5b7 into habana_main Dec 9, 2024
10 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@michalkuligowski michalkuligowski michalkuligowski approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.