Skip to content

Pull requests: vllm-project/vllm

New pull request New
398 Open 4,431 Closed
398 Open 4,431 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Core][Bugfix] Use correct device to initialize GPU data during CUDA-graph-capture
#10608 opened Nov 24, 2024 by IdoAsraff Loading…
1
[Bug]: Authorization ignored when root_path is set frontend
#10606 opened Nov 24, 2024 by chaunceyjiang Loading…
1
1
[fix] Correct num_accepted_tokens counting
#10604 opened Nov 24, 2024 by KexinFeng Loading…
1
[Misc]Further reduce BNB static variable needs-rebase
#10597 opened Nov 24, 2024 by jeejeelee • Draft
2 tasks
2
[Interleaved ATTN] Support for Mistral-8B
#10591 opened Nov 23, 2024 by patrickvonplaten Loading…
4
[Kernel] Remove hard-dependencies of Speculative decode to CUDA workers
#10587 opened Nov 23, 2024 by xuechendi Loading…
4
【Kernel】Tuning fused moe for qwen2-57b in GTX 4090 (tp4pp2)
#10586 opened Nov 23, 2024 by BBuf Loading…
1
fix json serialization issue frontend
#10580 opened Nov 22, 2024 by maxdebayser Loading…
2
[WIP] V1 LoRA support needs-rebase
#10579 opened Nov 22, 2024 by varun-sundar-rabindranath • Draft
5
[Core] Update to outlines > 0.1.4 ci/build
#10576 opened Nov 22, 2024 by russellb • Draft
3
[ Kernels ] [ AMD ] Add Fused MoE Configs
#10574 opened Nov 22, 2024 by robertgshaw2-neuralmagic • Draft
1
[V1] Refactor model executable interface for multimodal models
#10570 opened Nov 22, 2024 by ywang96 • Draft
14 tasks done
@DarkLight1337
1
[Hardware][Intel-Gaudi] Enable LoRA support for Intel Gaudi (HPU)
#10565 opened Nov 22, 2024 by SanjuCSudhakaran Loading…
4
[Model] Added GLM-4 series hf format model support vllm==0.6.4
#10561 opened Nov 22, 2024 by sixsixcoder Loading…
4
[Benchmark] Benchmark structured output with datasets
#10557 opened Nov 22, 2024 by xuechendi Loading…
4
[Docs] Add dedicated tool calling page to docs documentation Improvements or additions to documentation
#10554 opened Nov 21, 2024 by mgoin Loading…
5
[Misc] Enable vLLM to Dynamically Load LoRA from a Remote Server frontend
#10546 opened Nov 21, 2024 by angkywilliam Loading…
7
[Distributed] Tensor Parallel RMSNorm
#10542 opened Nov 21, 2024 by tlrmchlsmth • Draft
2
Add Sageattention backend
#10532 opened Nov 21, 2024 by flozi00 Loading…
3
[Model]: Add support for Aria model documentation Improvements or additions to documentation
#10514 opened Nov 21, 2024 by xffxff Loading…
37
[core] overhaul memory profiling and fix backward compatibility needs-rebase
#10511 opened Nov 21, 2024 by youkaichao Loading…
1
8
Turn on V1 for H200 build ci/build perf-benchmarks
#10505 opened Nov 21, 2024 by simon-mo Loading…
1
[Model] Add OLMo November 2024 model documentation Improvements or additions to documentation
#10503 opened Nov 20, 2024 by 2015aroras Loading…
10
[Core] Implement disagg prefill by StatelessProcessGroup ci/build ready ONLY add when PR is ready to merge/full CI is needed
#10502 opened Nov 20, 2024 by KuntaiDu Loading…
3
Support softcap in ROCm Flash Attention
#10500 opened Nov 20, 2024 by hliuca Loading…
1
ProTip! What’s not been updated in a month: updated:<2024-10-24.