Dockerized FastAPI wrapper for Kokoro-82M text-to-speech model w/CPU ONNX and NVIDIA GPU PyTorch support, handling, and auto-stitching

LM inference server implementation based on *.cpp.

GitHub Copilot API wrapper to make it OpenAI compatible

ThunderAI is a Thunderbird Addon that uses the capabilities of ChatGPT, Gemini or Ollama to enhance email management.

A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.

Visual inference exploration & experimentation playground

A user-friendly Command-line/SDK tool that makes it quickly and easier to deploy open-source LLMs on AWS

A high-performance API server that provides OpenAI-compatible endpoints for MLX models. Developed using Python and powered by the FastAPI framework, it provides an efficient, scalable, and user-friendly solution for running MLX-based vision and language models locally with an OpenAI-compatible interface.

An OpenAI Compatible API which integrates LLM, Embedding and Reranker. 一个集成 LLM、Embedding 和 Reranker 的 OpenAI 兼容 API

Spark-TTS Text-to-Speech with an OpenAI-compatible API, supporting seamless, unlimited-length generations. Includes a CLI interface.

Demonstrates that Spring AI can be configured to work with OpenRouter so that you can work with multiple LLMs through a single Open AI compatible interface. Potentially helpful when evaluating the performance and quality of model responses.

A FastAPI-powered REST API offering a comprehensive suite of natural language processing services using machine learning models with PyTorch and Transformers, packaged in a Docker container to run efficiently.

Config files for my GitHub profile.

An adapter to add OpenAI compatibility to your Hono app using the Vercel AI SDK

Config files for my GitHub profile.

LLM based assistant running as a Telegram Bot.

Tool-based LLM integration with Zenodo via the Model Context Protocol (MCP)

A Discordjs bot that uses OpenAI compatible endpoints for chatting.