What is weak supervision (e.g., Snorkel)?
hardAnswer
- Generate noisy labels programmatically from labeling functions (LFs): heuristics, keyword patterns, existing model outputs, distant supervision from KBs.
- Snorkel + Data Programming: LFs vote → generative model estimates LF accuracies + correlations → produces probabilistic labels → train final model on those.
- Trades label quality for volume — good when clean labels expensive but coverage matters (weak > few strong).
- Modern extension: prompting LLMs as an LF.
Check yourself — multiple choice
- Random
- Noisy labels from LFs (heuristics/keywords/models/distant supervision); Snorkel: LFs vote → generative model estimates accuracies → probabilistic labels; trade quality for volume
- Only human labels
- Not real
Weak supervision: LFs + generative model; trade quality for volume.
#data-quality
Practise MLOps & Data Quality
215 interview questions in this topic.
Related questions
- What is data drift and how do you detect it?
- How is concept drift different from data drift?
- What does 'data imbalance' mean and why is it a problem?
- What are common sources of data leakage in an ML pipeline?
- How do you validate data quality in an ML pipeline?
- What is schema drift and how do you detect it?