How do content moderation filters complement alignment?
mediumAnswer
- Pre / post-processing classifiers separate from the main LLM: (1) input moderation flags harmful queries before they hit the model; (2) output moderation flags unsafe generations before they reach the user; (3) log-only classifiers for offline analysis.
- Examples: OpenAI Moderation API, Perspective API, Llama Guard.
- Necessary because alignment training alone is imperfect — belt + suspenders.
- Trade-off: false positives cause frustration, false negatives cause harm.
Check yourself — multiple choice
- Alignment removes the need for filters
- Separate input/output moderation classifiers (Llama Guard, Moderation API) provide belt-and-suspenders coverage
- Filters replace alignment
- Only regex
Content filters: independent classifiers around the LLM — necessary safety layer beyond alignment.
#safety#guardrails
Practise LLMs & GenAI
214 interview questions in this topic.