Run any local LLM engine, auto-tuned to your GPU — polished web UI + OpenAI/Anthropic-compatible API. Point Claude Code at your own machine in one command. No Electron, no Python, offline-first.
Unified management and routing for llama.cpp, MLX and vLLM models with web dashboard.
Self-hosted AI workspace where chat becomes visual workflows, multi-agent operations, and reviewable automations. Local memory; local or cloud models
1-Click LLM Server on Your Phone — no Termux needed! 无需Termux，一键让你的手机变成LLM服务器！
Lightweight proxy for LLM
A lightweight chat terminal-interface for llama.cpp server written in C++ with many features and windows/linux support.
Run Pi coding agent isolated in a Docker Sandbox microVM with a local llama-server as the inference backend
Local LLM proxy, DevOps friendly
CLI wrapper for llama.cpp providing an ollama-like experience
BoxedLLaMA is a specialized software toolkit designed for developers to integrate local artificial intelligence into Windows applications. It functions as a comprehensive wrapper for llama.cpp, automating complex tasks such as server installation, version updates, and model management from Hugging Face.
A robust, production-ready Python toolkit to automate the synchronization between a directory of .gguf model files and a llama-swap config.yaml
FastAPI proxy that strips volatile fields from OpenClaw requests to dramatically improve llama-server KV cache hit rates (~22× faster prompt eval)
One place to store and manage all your recipe for Llama Server
llama.cpp fleet manager with orchestration routing — cut AI coding tool costs by routing tool-loop turns to local GPU models and frontier APIs (Copilot, OpenRouter). GPU pinning, heterogeneous pools, browser dashboard, OpenAI-compatible API.
llama-server model endpoint manager with JiT swapping with human UI, MCP and pi extension support.
A production-grade Python SDK for llama-server that streamlines authentication, token rotation, observability, and PII masking—helping AI architects ship secure, traceable LLM systems with enterprise-ready guardrails.
Benchmark Gemma 4 E2B on Apple Silicon: MLX (mlx-lm) vs GGUF (llama-server), with TTFT, tokens/sec, and memory.
LlamaOrch is simple Bash-based CLI Orchestrator for llama.cpp server.
Add a description, image, and links to the llama-server topic page so that developers can more easily learn about it.
To associate your repository with the llama-server topic, visit your repo's landing page and select "manage topics."