Replies: 1 comment
-
|
What is strange is that why the system limit of segment length is 1000 tokens, but the default in the 1.3 interface is still 1024 tokens? |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment

Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
Self Checks
1. Is this request related to a challenge you're experiencing? Tell me about your story.
When I upload a word document in the knowledge base
an error pops up saying: the maximum length of a segment cannot be greater than 1000
I have currently replaced all the soft returns ^l in the file with hard returns ^p, but the error still exists.
2. Additional context or comments
This knowledge base was built on the old v0.12 version. At that time, the segmentation settings used parent-child segmentation, and the maximum length of the paragraph segmentation of the parent block context was set to the default value of 1024.
However, when this dify instance was upgraded to v1.3, the maximum segmentation length was required to be set to 1000 when uploading the file again. However, after I reduced the maximum length of the paragraph segmentation of the parent block context to 1000, an error was reported.
Beta Was this translation helpful? Give feedback.
All reactions