Your customer segments change completely when you re-run the pipeline monthly. Is that acceptable?
hardAnswer
- No, because a segmentation the business acts on has to be stable enough to plan around, and instability means you are describing sampling noise rather than structure.
- First check whether the instability is algorithmic: k-means with random initialization on data with no strong separation gives different partitions every run, which a fixed seed hides without fixing.
- Measure it properly with the adjusted Rand index between consecutive runs, and if agreement is low the structure is weak.
- Options are to reduce k until the solution is stable, initialize from the previous month's centroids so segments evolve rather than being reinvented, or move to a model with an explicit assignment probability so you can see which customers are genuinely borderline.
- Report the stability number alongside the segments.
Check yourself — multiple choice
- Yes, clusterings always differ
- No — measure agreement with the adjusted Rand index, reduce k if it is low, warm-start from last month's centroids, and report stability alongside the segments
- Fix the random seed and move on
- Re-run until you like the result
Instability signals weak structure; measure it, reduce complexity, and warm-start so segments evolve.
#clustering#interview
Practise Unsupervised Learning
214 interview questions in this topic.
Related questions
- Interview: 'you're asked to segment 10M customers — how?'
- Interview: cluster 5M e-commerce customers for a marketing campaign.
- Interview: how would you group log messages from a large distributed system?
- Interview: business asks 'why is customer X in Cluster 3?' — how do you explain?
- Interview: 'you have to pick k for the executive team — walk me through it.'
- Interview: after segmentation, one segment has 60% women but each region shows 40%. Why?