🍶 llm-distillery ⇢ use LLMs to run map-reduce summarization tasks on large documents until a target token size is met.
text-summarization
text-processing
tokenization
text-compression
token-management
openai-api
llm
large-language-model
semantic-chunking
text-distillation
ai-text-reduction
-
Updated
Oct 28, 2024 - JavaScript