Change the repository type filter
All
Repositories list
19 repositories
HGCDR
PublicFPARec
Publicgrps
Public【深度学习模型部署框架】支持tf/torch/trt/trtllm/vllm以及更多nn框架,支持dynamic batching、streaming模式,支持python/c++双语言,可限制,可拓展,高性能。帮助用户快速地将模型部署到线上,并通过http/rpc接口方式提供服务。grps_trtllm
Public【grps接入trtllm】通过GPRS+TensorRT-LLM+Tokenizers.cpp实现纯C++版高性能OpenAI LLM服务,支持chat和function call模式,支持ai agent,支持分布式多卡推理,支持多模态,支持gradio聊天界面。ControlTalk
Publicgrps_examples
Publicgrps_vllm
Publicnn-infer-opt
Publiceasy-ngo
Publiceasy-ngo-website
Publiceasy-ngo-doc
Public archiveCSCE-Net
Publiceasy-ngo-examples
Publiceasy-ngo-layout
Publiceasy-ngo-tools
Publicngo
Public archivengo-demo
Public archivenetease-media.github.io
PublicPAMM-HiA-T5
Public