Skip to content

Pull requests: vllm-project/vllm

New pull request New
459 Open 5,258 Closed
459 Open 5,258 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Misc] Pass attention to impl backend
#12218 opened Jan 20, 2025 by wangxiyuan Loading…
4
[V1] Remove _get_cache_block_size ready ONLY add when PR is ready to merge/full CI is needed
#12214 opened Jan 20, 2025 by heheda12345 Loading…
1
[VLM] Merged multi-modal processor for Pixtral
#12211 opened Jan 20, 2025 by Flechman • Draft
1
[bugfix] catch xgrammar unsupported array constraints
#12210 opened Jan 20, 2025 by Jason-CKY Loading…
1
1
[core][bugfix] configure env var during import vllm ready ONLY add when PR is ready to merge/full CI is needed
#12209 opened Jan 20, 2025 by youkaichao Loading…
3
[Model]: get aria to work with the lastest transfomers impl needs-rebase
#12207 opened Jan 20, 2025 by xffxff Loading…
8
[Model] Introduce CUDA Graph support for DeepSeek v3
#12204 opened Jan 20, 2025 by houseroad Loading…
3
[V1][Spec Decode] Ngram Spec Decode
#12193 opened Jan 19, 2025 by LiuXiaoxuanPKU • Draft
6 tasks
2
[Bugfix] fix race condition that leads to wrong order of token returned
#12192 opened Jan 19, 2025 by joennlae Loading…
2
[misc] add cuda runtime version to usage data
#12190 opened Jan 19, 2025 by youkaichao Loading…
2
[Misc] Add Gemma2 GGUF support
#12186 opened Jan 18, 2025 by Isotr0py • Draft
1
1
[Kernel] add triton fused moe kernel for gptq/awq
#12185 opened Jan 18, 2025 by jinzhen-lin Loading…
1
[Hardware][Gaudi][Bugfix] Fix HPU tensor parallelism, enable multiprocessing executor
#12167 opened Jan 17, 2025 by kzawora-intel Loading…
1
[Quantization/Parameter] WIP: Another Implementation of the Quantization Parameter Subclass Substitution
#12158 opened Jan 17, 2025 by cennn Loading…
3
[Core] Optimize topp/topk calculation in sampler
#12156 opened Jan 17, 2025 by afierka-intel • Draft
1
[WIP][Hardware][CPU] testing branch for mlperf ci/build documentation Improvements or additions to documentation needs-rebase
#12141 opened Jan 17, 2025 by bigPYJ1151 • Draft
2
[Hardware][Gaudi][Feature] Support Contiguous PA
#12139 opened Jan 17, 2025 by zhouyu5 • Draft
1
[WIP] Multimodal model support for V1 TPU
#12133 opened Jan 16, 2025 by mgoin • Draft
2
[Misc] Update to Transformers 4.48 ci/build ready ONLY add when PR is ready to merge/full CI is needed
#12120 opened Jan 16, 2025 by tlrmchlsmth Loading…
18
[Feature] Support VPTQ quantization ci/build
#12117 opened Jan 16, 2025 by wejoncy • Draft
1
[BUILD] Add VLLM_BUILD_EXT to control custom op build ci/build
#12116 opened Jan 16, 2025 by MengqingCao Loading…
2
[Misc]add modules_to_not_convert attribute to gptq series
#12103 opened Jan 16, 2025 by 1096125073 Loading…
1
Use CUDA 12.4 as default for release and nightly wheels ci/build documentation Improvements or additions to documentation
#12098 opened Jan 15, 2025 by mgoin Loading…
10
Add: Support for Sparse24Bitmask Compressed Models
#12097 opened Jan 15, 2025 by rahul-tuli • Draft
1 task
7
[V1][Perf] Reduce scheduling overhead in model runner after cuda sync
#12094 opened Jan 15, 2025 by youngkent Loading…
9
ProTip! Updated in the last three days: updated:>2025-01-17.