Large Language Model Text Generation Inference
-
Updated
Dec 11, 2024 - Python
#
falcon
Here are 360 public repositories matching this topic...
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
nlp bloom distributed-systems machine-learning deep-learning chatbot pytorch falcon transformer neural-networks llama gpt pretrained-models language-models volunteer-computing pipeline-parallelism guanaco tensor-parallelism large-language-models mixtral
-
Updated
Sep 7, 2024 - Python
High-speed Large Language Model Serving on PCs with Consumer-grade GPUs
-
Updated
Sep 6, 2024 - C++
An open-source and enterprise-level monitoring system.
-
Updated
Apr 24, 2024 - Go
Embrace the APIs of the future. Hug aims to make developing APIs as simple as possible, but no simpler.
-
Updated
Jul 4, 2024 - Python
Free, open-source SQL client for Windows and Mac 🦅
-
Updated
Apr 17, 2023 - JavaScript
A familiar HTTP Service Framework for Python.
-
Updated
Nov 17, 2024 - Python
A high-performance web server for Ruby, supporting HTTP/1, HTTP/2 and TLS.
-
Updated
Nov 2, 2024 - Ruby
LLM Finetuning with peft
-
Updated
Jul 8, 2024 - Jupyter Notebook
A friendly library for parsing HTTP request arguments, with built-in support for popular web frameworks, including Flask, Django, Bottle, Tornado, Pyramid, webapp2, Falcon, and aiohttp.
python flask django validation bottlepy aiohttp falcon marshmallow pyramid hacktoberfest request-validation
-
Updated
Dec 2, 2024 - Python
🩹Editing large language models within 10 seconds⚡
-
Updated
Aug 13, 2023 - Python
🦙 Integrating LLMs into structured NLP pipelines
nlp machine-learning natural-language-processing text-classification spacy falcon named-entity-recognition openai llama claude dolly cohere gpt-3 gpt-4 large-language-models llm prompt-engineering anthropic
-
Updated
Aug 4, 2024 - Python
The simplest way to serve AI/ML models in production
open-source machine-learning packaging artificial-intelligence falcon easy-to-use whisper inference-server model-serving inference-api stable-diffusion wizardlm
-
Updated
Dec 11, 2024 - Python
🤖 A PyTorch library of curated Transformer models and their composable components
nlp transformers pytorch falcon transformer llama albert bert roberta camembert xlm-roberta llm llms dolly2 gptneox
-
Updated
Apr 17, 2024 - Python
Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.
nlp unit-testing falcon classification summarization lora nlp-machine-learning zephyr fine-tuning finetuning ablation-study large-language-models flan-t5 redpajama qlora llm-test llama2 mistral-7b
-
Updated
Oct 25, 2024 - Python
Take Android screenshots with Falcons bright eye!
-
Updated
Jan 31, 2022 - Java
Improve this page
Add a description, image, and links to the falcon topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the falcon topic, visit your repo's landing page and select "manage topics."