Skip to content

Pull requests: sgl-project/sglang

New pull request New
139 Open 2,426 Closed
139 Open 2,426 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Hierarchical Caching supports MLA
#4009 opened Mar 3, 2025 by zeroorhero Loading…
1 of 6 tasks
Reasoning parser
#4001 opened Mar 2, 2025 by tot0 • Draft
6 tasks
Reasoning parser
#4000 opened Mar 2, 2025 by xihuai18 Loading…
4 of 6 tasks
27
Fix links for the doc of sampling params
#3999 opened Mar 2, 2025 by Qiaolin-Yu Loading…
6 tasks
bench: add dataset param for bench_multiturn
#3990 opened Mar 2, 2025 by zeroorhero Loading…
1 of 6 tasks
3
Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts
#3988 opened Mar 2, 2025 by merrymercy Loading…
2
Refactor eagle speculative decoding high priority
#3986 opened Mar 2, 2025 by Ying1123 Loading…
1
[Bug Fix] Add partial rotary factor support for Phi-4 and upgrade to transformers v4.49.0
#3984 opened Mar 1, 2025 by adarshxs Loading…
1 task done
1
fix: fix wrong param passed to num_verify_tokens
#3981 opened Mar 1, 2025 by mickqian • Draft
6 tasks
2
Move aiohttp into public dependencies
#3980 opened Mar 1, 2025 by stevapple Loading…
1 of 6 tasks
1
FP4 weight loading and inference (2/2)
#3972 opened Feb 28, 2025 by trevor-m Loading…
6 tasks
[CI] Remove unused imports with Ruff to pre-commit config
#3969 opened Feb 28, 2025 by b8zhong Loading…
3 tasks done
1
9
Blackwell fp8 blockscale
#3968 opened Feb 28, 2025 by elfiegg • Draft
6 tasks
feat(remote_model): support variable remote backend for model loader
#3964 opened Feb 28, 2025 by DellCurry Loading…
2 of 9 tasks
Add device detection and count functions to utils.
#3962 opened Feb 28, 2025 by vshekhawat-hlab Loading…
1 of 6 tasks
5
example: add async offline inference demo
#3961 opened Feb 28, 2025 by kuizhiqing Loading…
1 of 6 tasks
Update function_call_parser.py
#3960 opened Feb 28, 2025 by Syl123Syl Loading…
3 of 6 tasks
[ROCm] add amd ocp fp8 E3M4FUZ constant
#3959 opened Feb 28, 2025 by yiakwy-xpu-ml-framework-team Loading…
6 tasks
1
[Bug fixed] fixed the crash when enable the dp-attention on the single card
#3958 opened Feb 28, 2025 by DavidChan0519 Loading…
add deepgemm into sgl-kernel
#3957 opened Feb 28, 2025 by laixinn • Draft
6 tasks
1
[XCCL] Use xccl for xpu backend since xccl is ready in latest PyTorch.
#3954 opened Feb 28, 2025 by cboss6 Loading…
1 of 6 tasks
IPv6 support
#3949 opened Feb 28, 2025 by vincent-4 Loading…
5 of 6 tasks
2
sgl-router - issues on routing and project build. (#3870)
#3948 opened Feb 28, 2025 by michaelfeil Loading…
6 tasks
2
[Feature] Devin/1740716491 Add a hash for each new releaseDevin
#3947 opened Feb 28, 2025 by niconiconi Loading…
3 of 5 tasks
test: add vlm to token in & out example
#3941 opened Feb 28, 2025 by mickqian Loading…
6 tasks
ProTip! Follow long discussions with comments:>50.