Hey thanks for the response, its working okay, but the issue is that i have a very large query(the value for the "content" key). And also, the chatbot responds with something like "...\nFor the content length reason, it stopped, continue?" for a query which is 4-5 lines too.

Any suggestions would help.

Hey thanks for the response, its working okay, but the issue is that i have a very large query(the value for the "content" key). And also, the chatbot responds with something like "...\nFor the content length reason, it stopped, continue?" for a query which is 4-5 lines too.

Any suggestions would help.

You can set max_tokens for the dialog that the conversation belongs to.