Skip to content

Ability to use Python LLM package plugins #51

Open
@castedo

Description

@castedo

This is a feature idea which I might add to copyaid.it. Might be something manubot-ai-editor wants to do too.

The llm Python package has a large number of plugins that can be used to easily (I assume) switch between different LLM APIs and local LLM models:

https://llm.datasette.io/en/stable/plugins/directory.html#plugin-directory

I imagine this plugin API interface is simple enough that it's a quick way to expand out into many different LLM implementations.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions