docs: correct chunk-size units (characters, default 2048) in configuration
DOCUMENT_CHUNK_SIZE/OVERLAP were documented as "words" with a 512/50 default; the implementation measures characters and defaults to 2048/200 (config.py, DocumentChunker). Update docs/configuration.md (config block, tuning guidance, examples, env-var table) and env.sample accordingly, and cross-reference DOCUMENT_CHUNK_PAGE_AWARE for the PDF path. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
This commit is contained in:
co-authored by
Claude Opus 4.8
parent
2f2a7f9659
commit
4977216b62
+3
-3
@@ -203,9 +203,9 @@ NEXTCLOUD_PASSWORD=
|
||||
# Uses basic in-memory embeddings if no provider configured
|
||||
#
|
||||
# Document Chunking:
|
||||
# Configure how documents are split before embedding
|
||||
#DOCUMENT_CHUNK_SIZE=512
|
||||
#DOCUMENT_CHUNK_OVERLAP=50
|
||||
# Configure how documents are split before embedding (units are characters)
|
||||
#DOCUMENT_CHUNK_SIZE=2048
|
||||
#DOCUMENT_CHUNK_OVERLAP=200
|
||||
# Page-aware chunking for PDFs: split on page boundaries first so no chunk spans
|
||||
# a page (exact page numbers, clean snippets, ~1 chunk/page when chunk size >=
|
||||
# the largest page). Set false to use the legacy char-based path. Default: true
|
||||
|
||||
Reference in New Issue
Block a user