Skip to content

Add a xxhash based cache #325

Closed
Closed
@creatorrr

Description

@creatorrr

Use xxhash for hashing, create a cozo table for saving these. lookup before every call to openai

xxhash(json.dumps({ chatml, parameters })) => cache lookup => openai

the hash is the key, save the response as the value

Metadata

Metadata

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions