Commits

Breadcrumbs

History for

onmain

User selector

All users

All time

Commit History

Commits on Dec 1, 2024

• Fix logprob for completions (#2301)

  merrymercy

  authored
  5c18a03

  Copy full SHA for 5c18a03

• Add a simple torch native attention backend (#2241)

  YangQun1

  authored
  62c516a

  Copy full SHA for 62c516a

• minor: support flashinfer nightly (#2295)

  zhyncs

  authored
  fc78640

  Copy full SHA for fc78640

• Feat: upgrade outlines & support compatibility with the old version (#2292)

  gobraves

  authored
  906d795

  Copy full SHA for 906d795

• feat: add should_use_tensor_core (#2179)

  zhyncs

  authored
  118b6af

  Copy full SHA for 118b6af

• Fix chunked prefill when ignore eos (#2290)

  hnyls2002

  authored
  5f12f0e

  Copy full SHA for 5f12f0e

• adapt vllm distributed module to sglang (#2244)

  Show description for d5b95cb
  

  yizhang2077

  and

  zhyncs

  authored
  d5b95cb

  Copy full SHA for d5b95cb

• Revert "Revert "[FEAT] Support GGUF format"" (#2287)

  merrymercy

  authored
  4936be8

  Copy full SHA for 4936be8

• Revert "[Fix] fix assertion error for chunked prefill when disabling cache" (#2286)

  merrymercy

  authored
  f5b5f2b

  Copy full SHA for f5b5f2b

• Revert "[FEAT] Support GGUF format" (#2285)

  merrymercy

  authored
  7e4c6dd

  Copy full SHA for 7e4c6dd

• [Fix] fix assertion error for chunked prefill when disabling cache (#2282)

  wangraying

  authored
  d622851

  Copy full SHA for d622851

Commits on Nov 30, 2024

• [FEAT] Support GGUF format (#2215)

  Show description for 883c955
  

  zhengy001

  and

  Yang Zheng(SW)(Alex)

  authored
  883c955

  Copy full SHA for 883c955

• [CI] Print summary on github actions (#2274)

  merrymercy

  authored
  ccaf1f9

  Copy full SHA for ccaf1f9

• Add get weights by parameter name for llama (#2266)

  zhaochenyang20

  authored
  7d1485d

  Copy full SHA for 7d1485d

• udate weights from disk (#2265)

  zhaochenyang20

  authored
  7d5d1d3

  Copy full SHA for 7d5d1d3

• Support LoRA in Completion API (#2243)

  Show description for 01017d4
  

  bjmsong

  and

  root

  authored
  01017d4

  Copy full SHA for 01017d4

• Fix the default chunked prefill size (#2268)

  merrymercy

  authored
  94e167e

  Copy full SHA for 94e167e

Commits on Nov 29, 2024

• [benchmark] Add fused_moe_triton benchmark and tuning tools (#2225)

  Show description for 262e370
  

  3 peopleauthored
  262e370

  Copy full SHA for 262e370

• chore: bump v0.3.6.post3 (#2259)

  zhyncs

  authored
  fae4e5e

  Copy full SHA for fae4e5e

• [Minor] fix the style for multimodal models (#2257)

  merrymercy

  authored
  afe1e46

  Copy full SHA for afe1e46

• Fix hash collision for multi modal models (#2256)

  merrymercy

  authored
  f50a6cf

  Copy full SHA for f50a6cf

• Simplify tokenizer manager (#2254)

  merrymercy

  authored
  fe97a2d

  Copy full SHA for fe97a2d

• Revert "Revert "Add simple CPU offloading support"" (#2253)

  Show description for 8b48496
  

  3 peopleauthored
  8b48496

  Copy full SHA for 8b48496

• Revert "Add simple CPU offloading support" (#2252)

  Show description for 4057ea8
  Ying1123

  authored
  4057ea8

  Copy full SHA for 4057ea8

Commits on Nov 28, 2024

• [fix] Fix prefix caching for multi-image/video (#2239)

  Ying1123

  authored
  b7038fe

  Copy full SHA for b7038fe

• fix missing launch server import (#2242)

  qeternity

  authored
  65fdb28

  Copy full SHA for 65fdb28

• Fix memory leak during abort (#2238)

  merrymercy

  authored
  b2ccf36

  Copy full SHA for b2ccf36

• Crash the server correctly during error (#2231)

  merrymercy

  authored
  d4fc1a7

  Copy full SHA for d4fc1a7

• Add OLMo2 model. (#2233)

  janimo

  authored
  db674e3

  Copy full SHA for db674e3

• Disable overlap scheduler for multimodal models (#2235)

  merrymercy

  authored
  fb915bd

  Copy full SHA for fb915bd

• Fix chunked prefill size for bench_offline_throughput (#2234)

  merrymercy

  authored
  09798b3

  Copy full SHA for 09798b3

• Rename tuned MI300X config files for fused_moe_triton (#2228)

  HaiShaw

  authored
  cd51758

  Copy full SHA for cd51758

Commits on Nov 27, 2024

• add profile in offline benchmark & update doc (#2123)

  Show description for 91e5dbf
  

  bjmsong

  and

  root

  authored
  91e5dbf

  Copy full SHA for 91e5dbf

• Remove fused_moe_grok (#2223)

  merrymercy

  authored
  dd5eba4

  Copy full SHA for dd5eba4

• fix typo prompts (#2224)

  qibaoyuan

  authored
  a4fd2f9

  Copy full SHA for a4fd2f9