Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Nov 18 rebase #485

Merged
merged 187 commits into from
Nov 18, 2024
Merged

Nov 18 rebase #485

merged 187 commits into from
Nov 18, 2024

Conversation

kzawora-intel
Copy link

No description provided.

jeejeelee and others added 30 commits November 6, 2024 09:49
@jeejeelee
[Model][LoRA]LoRA support added for LlamaEmbeddingModel (vllm-project…
2003cc3 
…#10071)

Signed-off-by: Jee Jee Li <[email protected]>
@jeejeelee @B-201
[Model] Add Idefics3 support (vllm-project#9767)
a5bba7d 
Signed-off-by: Jee Jee Li <[email protected]>
Signed-off-by: B-201 <[email protected]>
Co-authored-by: B-201 <[email protected]>
@ericperfect
[Model][LoRA]LoRA support added for Qwen2VLForConditionalGeneration (v…
406d4cc 
…llm-project#10022)

Signed-off-by: ericperfect <[email protected]>
@mgoin
Remove ScaledActivation for AWQ (vllm-project#10057)
399c798 
Signed-off-by: mgoin <[email protected]>
@russellb @DarkLight1337
[CI/Build] Drop Python 3.8 support (vllm-project#10038)
098f94d 
Signed-off-by: Russell Bryant <[email protected]>
Signed-off-by: DarkLight1337 <[email protected]>
Co-authored-by: DarkLight1337 <[email protected]>
@russellb
[CI/Build] change conflict PR comment from mergify (vllm-project#10080)
87bd7e0 
Signed-off-by: Russell Bryant <[email protected]>
@joerunde
[V1] Make v1 more testable (vllm-project#9888)
d58268c 
Signed-off-by: Joe Runde <[email protected]>
@russellb
[CI/Build] Always run the ruff workflow (vllm-project#10092)
74f2f8a 
Signed-off-by: Russell Bryant <[email protected]>
@youkaichao
[core][distributed] add stateless_init_process_group (vllm-project#10072
719c1ca 
)

Signed-off-by: youkaichao <[email protected]>
@mgoin
[Bugfix] Fix FP8 torch._scaled_mm fallback for torch>2.5 with CUDA<12…
4ab3256 
….4 (vllm-project#10095)

Signed-off-by: mgoin <[email protected]>
@yma11 @jikunshang
[Misc][XPU] Upgrade to Pytorch 2.5 for xpu backend (vllm-project#9823)
d3859f1 
Signed-off-by: Kunshang Ji <[email protected]>
Signed-off-by: yan ma <[email protected]>
Co-authored-by: Kunshang Ji <[email protected]>
@njhill
[Frontend] Adjust try/except blocks in API impl (vllm-project#10056)
29862b8 
Signed-off-by: Nick Hill <[email protected]>
@bigPYJ1151
[Hardware][CPU] Update torch 2.5 (vllm-project#9911)
a4b3e0c 
Signed-off-by: jiang1.li <[email protected]>
@youkaichao
[doc] add back Python 3.8 ABI (vllm-project#10100)
e7b84c3 
Signed-off-by: youkaichao <[email protected]>
@njhill
[V1][BugFix] Fix Generator construction in greedy + seed case (vllm-p…
1fa020c 
…roject#10097)

Signed-off-by: Nick Hill <[email protected]>
@DarkLight1337
[Misc] Consolidate ModelConfig code related to HF config (vllm-projec…
db7db4a 
…t#10104)

Signed-off-by: DarkLight1337 <[email protected]>
@russellb
[CI/Build] re-add codespell to CI (vllm-project#10083)
104d729 
Signed-off-by: Russell Bryant <[email protected]>
@rafvasq
Doc: Improve benchmark documentation (vllm-project#9927)
d7263a1 
Signed-off-by: Rafael Vasquez <[email protected]>
@hanzhi713
[Core][Distributed] Refactor ipc buffer init in CustomAllreduce (vllm…
6192e9b 
…-project#10030)

Signed-off-by: Hanzhi Zhou <[email protected]>
@russellb
[CI/Build] Improve mypy + python version matrix (vllm-project#10041)
e036e52 
Signed-off-by: Russell Bryant <[email protected]>
@flaviabeo @maxdebayser
Adds method to read the pooling types from model's files (vllm-projec…
aa9078f 
…t#9506)

Signed-off-by: Flavia Beo <[email protected]>
Signed-off-by: Max de Bayser <[email protected]>
Co-authored-by: Max de Bayser <[email protected]>
@DIYer22
[Frontend] Fix multiple values for keyword argument error (vllm-proje…
0dfba97 
…ct#10075) (vllm-project#10076)

Signed-off-by: Lei <[email protected]>
@bigPYJ1151
[Hardware][CPU][bugfix] Fix half dtype support on AVX2-only target (v…
a6f332d 
…llm-project#10108)

Signed-off-by: jiang1.li <[email protected]>
@li-plus
[Bugfix] Make image processor respect mm_processor_kwargs for Qwen2…
999df95 
…-VL (vllm-project#10112)

Signed-off-by: Jiahao Li <[email protected]>
@spliii @ywang96
[Misc] Add Gamma-Distribution Request Generation Support for Serving …
a62bc01 
…Benchmark. (vllm-project#10105)

Signed-off-by: Mozhou <[email protected]>
Co-authored-by: Roger Wang <[email protected]>
@maxdebayser
[Frontend] Tool calling parser for Granite 3.0 models (vllm-project#9027
ae62fd1 
)

Signed-off-by: Max de Bayser <[email protected]>
@NickLucche
[Feature] [Spec decode]: Combine chunked prefill with speculative dec…
9d43afc 
…oding (vllm-project#9291)

Signed-off-by: NickLucche <[email protected]>
@russellb
[CI/Build] Always run mypy (vllm-project#10122)
de0e61a 
Signed-off-by: Russell Bryant <[email protected]>
@russellb
[CI/Build] Add shell script linting using shellcheck (vllm-project#7925)
3be5b26 
Signed-off-by: Russell Bryant <[email protected]>
@russellb
[CI/Build] Automate PR body text cleanup (vllm-project#10082)
a2f1f3b 
Signed-off-by: Russell Bryant <[email protected]>
russellb and others added 27 commits November 15, 2024 13:20
@russellb
[Doc] Move PR template content to docs (vllm-project#10159)
3e8d14d 
Signed-off-by: Russell Bryant <[email protected]>
@mikegre-google
[Docs] Misc updates to TPU installation instructions (vllm-project#10165
4f168f6 
)
@DarkLight1337
[Frontend] Automatic detection of chat content format from AST (vllm-…
32e46e0 
…project#9919)

Signed-off-by: DarkLight1337 <[email protected]>
@youkaichao
[doc] add doc for the plugin system (vllm-project#10372)
755b853 
Signed-off-by: youkaichao <[email protected]>
@youkaichao
[misc][plugin] improve log messages (vllm-project#10386)
2f427c2 
Signed-off-by: youkaichao <[email protected]>
@rasmith
[BugFix] [Kernel] Fix GPU SEGV occuring in fused_moe kernel (vllm-pro…
1d75472 
…ject#10385)

Signed-off-by: Randall Smith <[email protected]>
@kakao-steve-ai
[Misc] Update benchmark to support image_url file or http (vllm-proje…
8b6725b 
…ct#10287)

Signed-off-by: rbbang <[email protected]>
@skylee-01
[Misc] Medusa supports custom bias (vllm-project#10361)
b98d89e
@imkero
[Bugfix] Fix M-RoPE position calculation when chunked prefill is enab…
361c29e 
…led (vllm-project#10388)

Signed-off-by: imkero <[email protected]>
@WoosukKwon
[V1] Add code owners for V1 (vllm-project#10397)
661a34f 
Signed-off-by: Woosuk Kwon <[email protected]>
@youkaichao
[2/N][torch.compile] make compilation cfg part of vllm cfg (vllm-proj…
4fd9375 
…ect#10383)

Signed-off-by: youkaichao <[email protected]>
@ywang96
[V1] Refactor model executable interface for all text-only language m…
643ecf7 
…odels (vllm-project#10374)

Signed-off-by: Roger Wang <[email protected]>
@xuechendi
[CI/Build] Fix IDC hpu [Device not found] issue (vllm-project#10384)
905d0f0 
Signed-off-by: Chendi Xue <[email protected]>
@Isotr0py
[Bugfix][CPU] Fix CPU embedding runner with tensor parallel (vllm-pro…
cf349c4 
…ject#10394)

Signed-off-by: Isotr0py <[email protected]>
@youkaichao
[platforms] refactor cpu code (vllm-project#10402)
8d74b5a 
Signed-off-by: youkaichao <[email protected]>
@jikunshang
[Hardware] [HPU]add mark_step for hpu (vllm-project#10239)
76aab90 
Signed-off-by: Kunshang Ji <[email protected]>
@imkero
[Bugfix] Fix mrope_position_delta in non-last prefill chunk (vllm-pro…
80d85c5 
…ject#10403)

Signed-off-by: imkero <[email protected]>
@wchen61
[Misc] Enhance offline_inference to support user-configurable paramet… (
d1557e6 
vllm-project#10392)

Signed-off-by: wchen61 <[email protected]>
@Isotr0py
[Misc] Add uninitialized params tracking for AutoWeightsLoader (vll…
c4e4643 
…m-project#10327)

Signed-off-by: Isotr0py <[email protected]>
@HollowMan6
[Bugfix] Ignore ray reinit error when current platform is ROCm or XPU (…
47826ca 
…vllm-project#10375)

Signed-off-by: Hollow Man <[email protected]>
@youkaichao
[4/N][torch.compile] clean up set_torch_compile_backend (vllm-project…
51bb12d 
…#10401)

Signed-off-by: youkaichao <[email protected]>
@lk-chen
[VLM] Report multi_modal_placeholders in output (vllm-project#10407)
c7dec92 
Signed-off-by: Linkun Chen <[email protected]>
@Maybewuss
[Model] Remove redundant softmax when using PoolingType.STEP (vllm-pr…
01aae1c 
…oject#10415)
@kzawora-intel
Merge remote-tracking branch 'origin/habana_main' into HEAD
9ebcb9b
@kzawora-intel
Merge remote-tracking branch 'upstream/main' into HEAD
295cabe
@kzawora-intel
Merge remote-tracking branch 'origin/habana_main' into HEAD
8155ba7
@kzawora-intel
format.sh
3400180
@kzawora-intel kzawora-intel changed the title Nov 12 rebase Nov 18 rebase Nov 18, 2024
@kzawora-intel kzawora-intel merged commit 6ae5229 into habana_main Nov 18, 2024
10 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@michalkuligowski michalkuligowski michalkuligowski approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.