A LLM semantic caching system aiming to enhance user experience by reducing response time via cached query-result pairs.
-
Updated
Jun 30, 2025 - Python
#
semantic-cache
Here are 22 public repositories matching this topic...
Redis Vector Library (RedisVL) -- the AI-native Python client for Redis.
python redis openai embedding vector-search vector-database large-language-models llm semantic-cache retrieval-augmented-generation llmcache
-
Updated
Jan 2, 2026 - Python
mimir is a drop-in proxy that caches LLM API responses using semantic similarity, reducing costs and latency for repeated or similar queries.
-
Updated
Dec 24, 2025 - Go
Reliable and Efficient Semantic Prompt Caching with vCache
machine-learning consistency cache chatbot openai llama gpt verified memcache correctness semantic-search similarity-search rag vector-search guarantees vector-database llm vllm semantic-cache llm-memory
-
Updated
Dec 17, 2025 - Python
Redis Vector Library (RedisVL) -- the AI-native Java client for Redis.
java redis ai embeddings vectors rag vector-search vector-database llm generative-ai semantic-cache llm-cache rag-chatbot semantic-routing agentic-ai
-
Updated
Dec 19, 2025 - Java
This is a RAG based chatbot in which semantic cache and guardrails have been incorporated.
-
Updated
Nov 11, 2024 - HTML
This repository contains sample code demonstrating how to implement a verified semantic cache using Amazon Bedrock Knowledge Bases to prevent hallucinations in Large Language Model (LLM) responses while improving latency and reducing costs.
agent aws demo bedrock rag aws-blog llm semantic-cache llm-agent amazon-bedrock amazon-bedrock-agents amazon-bedrock-knowledge-bases
-
Updated
Apr 3, 2025 - Jupyter Notebook
High-performance LLM query cache with semantic search. Reduce API costs 80% and latency from 8.5s to 1ms using Redis + Qdrant vector DB. Multi-provider support (OpenAI, Anthropic).
redis embeddings openai cost-optimization rag fastapi vector-database qdrant semantic-cache llm-caching
-
Updated
Dec 2, 2025 - Python
Enhance LLM retrieval performance with Azure Cosmos DB Semantic Cache. Learn how to integrate and optimize caching strategies in real-world web applications.
-
Updated
Mar 22, 2024 - Python
Redis Vector Similarity Search, Semantic Caching, Recommendation Systems and RAG
redis vector vector-search llm semantic-cache redis-vector-search retrieval-augmented-generation dalle-3
-
Updated
Apr 3, 2024 - Python
A ChatBot using Redis Vector Similarity Search, which can recommend blogs based on user prompt
python redis chatbot vector-search vector-database sentence-transformers huggingface-transformers large-language-models llm generative-ai semantic-cache redis-vector-search llmcache
-
Updated
Sep 30, 2023 - Python
Ultra-fast Semantic Cache Proxy written in pure C
-
Updated
Dec 15, 2025 - C
Optimized RAG Retrieval with Indexing, Quantization, Hybrid Search and Caching
quantization hnsw huggingface hybrid-search large-language-models splade qdrant-vector-database semantic-cache retrieval-augmented-generation
-
Updated
Nov 6, 2024 - Python
cli oauth terminal ai cache gemini claude cost-optimization openai-api ai-chat llm chatgpt semantic-cache free-ai
-
Updated
Jan 2, 2026 - TypeScript
Redis Database offers unique capability to keep your data fresh while serving through LLM chatbot
redis openai text-to-sql vector-search vector-database langchain semantic-cache langchain-python langsmith redisvl
-
Updated
Jul 16, 2024 - Python
🚀 Optimize LLM usage with PromptCache, a smart middleware that cuts costs and speeds up responses by caching repetitive queries.
shell machine-learning terminal cache chatbot openai decorator memcache correctness semantic-search similarity-search cost-optimization badgerdb stable-diffusion semantic-cache comfyui-workflow comfyui-nodes rag-ai
-
Updated
Jan 6, 2026 - Go
Backend for NexaBudget, a personal finance management app. This Spring Boot application provides a RESTful API for managing finances, including accounts, transactions, and budgets.
personal-finance spring-security springboot redis-cache mongodb-atlas graalvm-native-image semantic-cache gemini-ai java-25
-
Updated
Dec 26, 2025 - Java
Semantic cache for your LLM apps in Go!
-
Updated
May 17, 2024 - Go
Episodic memory and semantic cache proxy for LLM APIs with ~40% token savings
knowledge-graph developer-tools ai-agents context-graph semantic-cache llm-proxy agent-orchestration token-optimization
-
Updated
Dec 29, 2025 - Rust
Improve this page
Add a description, image, and links to the semantic-cache topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the semantic-cache topic, visit your repo's landing page and select "manage topics."