What is Chain-of-Density (CoD) prompting?
hardAnswer
- Iterative summarization technique (Adams 2023): the model produces a first sparse summary, then in successive rounds is asked to add more 'entities' from the source while keeping the total length constant.
- Each round adds ~2 missing entities and rewrites for cohesion.
- Result: progressively denser, information-rich summaries at fixed length.
- Beats plain 'summarize this' on entity coverage and coherence.
- Underlying pattern (iterative rewriting) applies broadly to constrained-length generation.
Check yourself — multiple choice
- One-shot summary
- Iteratively add entities while keeping length fixed → progressively denser summaries with better entity coverage
- Only classification
- Same as ToT
Chain-of-Density: iterative entity-adding rewrites at fixed length → denser summaries.
#prompting
Practise LLMs & GenAI
214 interview questions in this topic.