Stars
【深度学习模型部署框架】支持tf/torch/trt/trtllm/vllm以及更多nn框架,支持dynamic batching、streaming模式,支持python/c++双语言,可限制,可拓展,高性能。帮助用户快速地将模型部署到线上,并通过http/rpc接口方式提供服务。
A high-throughput and memory-efficient inference and serving engine for LLMs
An ultra-lightweight(ROM<1.6K, RAM<0.3k), high-performance C/C++ log library. | 一款超轻量级(ROM<1.6K, RAM<0.3k)、高性能的 C/C++ 日志库
Tencent Cloud API 3.0 SDK for C++
Tencent Cloud API 3.0 SDK for C++
WCDB is a cross-platform database framework developed by WeChat.
Modern C++ Apache Kafka client library (wrapper for librdkafka)
Mongoose OS - an IoT Firmware Development Framework. Supported microcontrollers: ESP32, ESP8266, CC3220, CC3200, STM32F4, STM32L4, STM32F7. Amazon AWS IoT, Microsoft Azure, Google IoT Core integrat…
SQLCipher is a standalone fork of SQLite that adds 256 bit AES encryption of database files and other security features.
Non-Metric Space Library (NMSLIB): An efficient similarity search library and a toolkit for evaluation of k-NN methods for generic non-metric spaces.
CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image
👑 Easy-to-use and powerful NLP and LLM library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search…
PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice (『飞桨』核心框架,深度学习&机器学习高性能单机、分布式训练和跨平台部署)
Official implementations for various pre-training models of ERNIE-family, covering topics of Language Understanding & Generation, Multimodal Understanding & Generation, and beyond.
Eigen is a C++ template library for linear algebra: matrices, vectors, numerical solvers, and related algorithms.
The CImg Library is a small and open-source C++ toolkit for image processing
THIS MIRROR IS DEPRECATED -- New url: https://gitlab.com/libeigen/eigen
The POCO C++ Libraries are powerful cross-platform C++ libraries for building network- and internet-based applications that run on desktop, server, mobile, IoT, and embedded systems.
A toolkit for making real world machine learning and data analysis applications in C++
Skia is a complete 2D graphic library for drawing Text, Geometries, and Images.
🤖 The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transf…