📚 Parameterize, execute, and analyze notebooks

[EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.

Get your documents ready for gen AI

Quantized Attention that achieves speedups of 2.1x and 2.7x compared to FlashAttention2 and xformers, respectively, without lossing end-to-end metrics across various models.

ExtractThinker is a Document Intelligence library for LLMs, offering ORM-style interaction for flexible and powerful document workflows.

Perplexica is an AI-powered search engine. It is an Open source alternative to Perplexity AI

Quadratic | Spreadsheet with Python, SQL, and AI

Fast, accurate and scalable probabilistic data linkage using your choice of SQL backend

The Open Cookbook for Top-Tier Code Large Language Model

LLM-powered multiagent persona simulation for imagination enhancement and business insights.

🤗 AutoTrain Advanced

A curated list of Large Language Model resources, covering model training, serving, fine-tuning, and building LLM applications.

SuperPrompt is an attempt to engineer prompts that might help us understand AI agents.

code for training & evaluating Contextual Document Embedding models

AdalFlow: The library to build & auto-optimize LLM applications.

Local AI API Platform

MTEB: Massive Text Embedding Benchmark

Dynamiq is an orchestration framework for agentic AI and LLM applications

Lightweight Python framework that provides a high-level API for creating and rendering scenes with Blender.

🔥🔥🔥AI-driven database tool and SQL client, The hottest GUI client, supporting MySQL, Oracle, PostgreSQL, DB2, SQL Server, DB2, SQLite, H2, ClickHouse, and more.

Scripts for fine-tuning Meta Llama with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting…

The framework for building scalable agentic applications.

LLM-powered Markdown editor

Official inference framework for 1-bit LLMs

This repository will contain all the presentations, content, hands-on notebooks for a full day Generative AI workshop on Training, Fine-tuning Large Language Models for the DataHack Summit 2024 con…

Serverless Modal + FastAPI + React + ColPali + Qdrant + GPT4o Vision RAG (V-RAG) Demo

🍻 A CLI workflow for the administration of macOS applications distributed as binaries

The LLM's practical guide: From the fundamentals to deploying advanced LLM and RAG apps to AWS using LLMOps best practices