expand support to Claude, Cohere, Llama2 and Azure #142
+112
−14
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
Happy to make any relevant changes if required |
|
@krrishdholakia did you tested this out? can you report on any experiments conducted with it? |
|
Hey @vmayoral tested it with Anthropic (claude-instant-1). |
|
The PR checks for environment keys for anthropic/cohere/replicate in addition to the openai keys. Depending on which model is passed in by the user it routes to the correct spec. |
|
@vmayoral any updates on this PR ? Are you exploring building a hosted version of Pentestgpt ? |
This comment was marked as abuse.
This comment was marked as abuse.
Sorry, something went wrong.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Hi @GreyDGL,
Saw you expanded support to LocalLLMs - and wanted to see how to add support for other LLM providers. I'm working on
litellm(simple library to standardize LLM API Calls - https://github.com/BerriAI/litellm) and was wondering if we could be helpful.Added support for Anthropic, Llama2, and Cohere by replacing the raw
openai.chatCompletion.createfunction withcompletion. The code is pretty similar to the OpenAI class - as litellm follows the same pattern as the openai-python sdk.Would love to know if this helps.