What is the manifold hypothesis?
mediumAnswer
- Real high-dimensional data (images, audio, text) lies on a low-dimensional manifold embedded in the high-dim space — e.g. natural images inhabit ~O(hundreds)-dim manifold within millions of pixels.
- Motivates non-linear DR (Isomap, UMAP, autoencoders): find that low-dim coordinate system.
- Foundation of modern representation learning: features are more useful in manifold coordinates than raw pixels.
Check yourself — multiple choice
- Random
- Real high-dim data lives on a low-dim manifold; motivates non-linear DR (Isomap/UMAP/AE) that finds this manifold's coordinates
- Same as PCA
- Not real
Manifold hypothesis: real data lies on low-dim manifold in high-dim space.
#dimensionality-reduction#theory
Practise Unsupervised Learning
214 interview questions in this topic.