Basic GenAI concepts · Question 10 of 12
What typically happens when chunks for RAG are chosen very large?
1 answer is correct. Medium
Show answer
Answer
- D Hits bring along a lot of irrelevant text
Explanation
Large chunks provide a lot of context but dilute the embedding and bring unnecessary text into the context window, which raises costs and distracts the model. Chunks that are too small lose context. A medium size with some overlap or hierarchical chunking is common.