Skip to main content

Goal

Pick a chunking setup that matches how your users ask questions and how reviewers validate answers.

Sample Documents

Use Attention Is All You Need for academic RAG, Legal Filing for page-grounded legal review, or 10-K Annual Report for section routing.

Decision Table

Request

Checks

  • Test chunking on three representative documents before locking the config.
  • Store chunk type and chunk index with every embedding.
  • Keep page references if any answer needs a citation or reviewer jump link.
  • Avoid tiny chunks for tables; they often lose headers and context.
  • Use Split before Schema when the document has multiple sections that need different extraction logic.

Chunking Parameters

Full chunking parameter guide.

Vector Metadata Contract

Persist chunk provenance.

LangChain RAG Ingestion

Build a local vector index.