Skip to content

📖 Utility for processing text using AI. Summarize, analyze, extract, translate, format, and more!

License

Notifications You must be signed in to change notification settings

justinmahar/ai-text-processor

Repository files navigation

📖 AI Text Processor

Utility for processing text using AI.

Summarize, analyze, extract, translate, format, and more! ✨

npm Version  View project on GitHub  Deploy Status

Buy me a coffee Sponsor

Screenshot of AI Text Processor extracting an apple pie recipe

Overview

This utility allows you to quickly and easily process text using any of OpenAI's chat models.

You can configure and save presets for easy reuse of prompts, and the utility will chunk long input text into multiple requests.

The utility is highly configurable, so you can dial in the settings that work best for you.

Happy text processing!

Click here to open the utility.

Features include:

  • 📖 Process Text With AI
    • Quickly and easily process text using any of OpenAI's chat models.
  • 📒 Presets
    • Speed up your workflow by saving presets that let you reuse your prompts. Includes support for prompt variables.
  • ✂️ Chunking
    • Automatically split long inputs into chunks that leave token headroom for your desired output.
  • ⚙️ Configurable
    • Lots of control! Configure AI models, prompts, token length, and chunking logic.
  • 🧑‍💻 Supports Many Use Cases
    • Supports summarization, analysis, data extraction, translation, formatting—the possibilities are endless!

Donate

If this project helped you, please consider buying me a coffee or sponsoring me. Your support is much appreciated!

Buy me a coffee Sponsor

Table of Contents

Quick Start

This utility is a static webapp hosted on GitHub Pages.

Click here to open the utility.

Use Cases

This utility supports variety of use cases, including (but certainly not limited to) the following:

  • Summarization - Summarize large amounts of text.
  • Analysis - Analyze text using specified criteria. Possibilities are endless, from sentiment analysis to finding bugs in software.
  • Data Extraction - Extract key data from large amounts of text.
  • Language Translation - Translate text from one language to another.
  • Text Formatting - Format output text using specified criteria.

One of the main features of this utility is the ability to save and reuse presets. This can significantly speed up your workflow.

npm Package

This package is available on npm, should you want to use its text processing utilities in your own app.

npm i ai-text-processor
import { TextUtils } from `ai-text-processor`

Utility Functions:

  • TextUtils.shrinkText - Condense whitespace and remove timestamps (#:#)
  • TextUtils.getEstimatedTokenCount - Estimate the number of tokens in text
  • TextUtils.getChunks - Split text into chunks based on token limits

TypeScript

Type definitions have been included for TypeScript support.

Icon Attribution

Favicon by Twemoji.

Contributing

Open source software is awesome and so are you. 😎

Feel free to submit a pull request for bugs or additions, and make sure to update tests as appropriate. If you find a mistake in the docs, send a PR! Even the smallest changes help.

For major changes, open an issue first to discuss what you'd like to change.

⭐ Found It Helpful? Star It!

If you found this project helpful, let the community know by giving it a star: 👉⭐

License

See LICENSE.md.

About

📖 Utility for processing text using AI. Summarize, analyze, extract, translate, format, and more!

Resources

License

Code of conduct

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages