Apache Lucene.NET

⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡

MTEB: Massive Text Embedding Benchmark

Study guides for MIT's 15.003 Data Science Tools

A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.

Fast, Accurate, Lightweight Python library to make State of the Art Embedding

The official implementation of RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval

A realtime serving engine for Data-Intensive Generative AI Applications

Fast lexical search implementing BM25 in Python using Numpy, Numba and Scipy

Epsilla is a high performance Vector Database Management System. Try out hosted Epsilla at https://cloud.epsilla.com/

An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"

Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch

SGPT: GPT Sentence Embeddings for Semantic Search

Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.

A compute framework for building Search, RAG, Recommendations and Analytics over complex structured & unstructured data.

Grounded search engine (i.e. with source reference) based on LLM / ChatGPT / OpenAI API. It supports web search, file content search etc.

Use late-interaction multi-modal models such as ColPali in just a few lines of code.

My personal note about local and global descriptor

Implementation of Memorizing Transformers (ICLR 2022), attention net augmented with indexing and retrieval of memories using approximate nearest neighbors, in Pytorch

Generative Representational Instruction Tuning