Replies: 1 comment
-
hey there, I have searched the keyword "segmentation["max_tokens"]" within the entire project and found that the previously hard-coded 1000 limit has been updated to a configurable |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
dify/api/core/rag/index_processor/index_processor_base.py
dify/api/core/indexing_runner.py
when i modify the files above
if segmentation["max_tokens"] < 50 or segmentation["max_tokens"] > 1000:
raise ValueError("Custom segment length should be between 50 and 1000.")”
1000-->2000,nothing changes
so,how can i custom the maxtokens of segments to 2000?
Beta Was this translation helpful? Give feedback.
All reactions