Search results

[Bug] Stuck at CUDA graph capture when serving with two A100*8 nodes

Status: Open.

#4007 In sgl-project/sglang;

· Grey4sh opened on Mar 3, 2025

[Feature] Do we have any plan to integrate FLashMLA

Status: Open.

#4006 In sgl-project/sglang;

· liuxuefeng727 opened on Mar 3, 2025

[Bug] The ncu command blocks when collecting data.

Status: Open.

#4005 In sgl-project/sglang;

· nevgiu opened on Mar 3, 2025

[Feature] i can not use function call of deepseek-v3、R1 with sglang==0.4.3.post2.

Status: Open.

#4004 In sgl-project/sglang;

· hwaking opened on Mar 3, 2025

[Bug] HiCacheController Stuck when testing using multi long text documents

Status: Open.

#3998 In sgl-project/sglang;

· rzwei opened on Mar 2, 2025

Performance issue comparing on MI210x4

Status: Open.

#3996 In sgl-project/sglang;

· VincentXWD opened on Mar 2, 2025

[Bug] [DeepSeek-R1/V3] The description of --kv-cache-dtype in the documentation and the code is inconsistent.

Status: Open.

#3995 In sgl-project/sglang;

· VegetaPn opened on Mar 2, 2025

[Bug] Distributed Initialization of SGLang with accelerate launch

Status: Open.

#3974 In sgl-project/sglang;

· jhinpan opened on Mar 1, 2025

[Feature] Support model unsloth/DeepSeek-R1-GGUF

deepseek

Status: Open.

#3973 In sgl-project/sglang;

· Qiaolin-Yu opened on Mar 1, 2025

[Feature] Prefill assistant response

feature

good first issueGood for newcomersGood for newcomers

help wantedExtra attention is neededExtra attention is needed

Status: Open.

Feature

#3971 In sgl-project/sglang;

· RealWorga opened on Feb 28, 2025

[Bug] Sg-kernel and sglang build from source

Status: Open.

#3970 In sgl-project/sglang;

· johnnynunez opened on Feb 28, 2025

Question sgl_kernel on amd paltforms

amd

Status: Open.

#3965 In sgl-project/sglang;

· etiennemlb opened on Feb 28, 2025