Clustering
Grouping things that resemble each other — and the fact that the algorithm always returns groups, whether or not any exist.
When not to use it
- When you already know the categories. That's classification, and it's more accurate and measurable.
- On high-dimensional data without reduction. Distances concentrate and "similar" stops meaning anything.
- To justify a decision on its own. A cluster is a hypothesis. Someone has to look at it and vouch for it.
Reach for something else instead
- Classification when the groups are known and you have labels.
- Manual segmentation on business rules — often the right answer, and it has the advantage of being explicable.
- Dimensionality reduction plus looking — sometimes you just want to see the shape of the data, not commit to groups.
Read more on the blog
- Who said that? Why diarization is harder than transcriptionTranscription answers what was said. Diarization answers who said it, and on real-world audio the error rate is still around forty percent. Here is why, and why the number you were quoted is probably flattered.
- Supervised vs unsupervised learning: the four typesMachine learning is usually taught as three types: supervised, unsupervised, and reinforcement learning. That map is still useful, but it no longer covers the paradigm that trains almost every modern AI system. Understanding what the fourth type is, and why it broke the old split, explains how AI actually got here.
Clustering groups points by closeness, with no labels given.
Unsupervised by definition, clustering finds structure in unlabeled data by grouping points that are near each other. Nobody tells it what the groups mean — it discovers that similar things belong together. The catch is that 'similar' depends entirely on your distance measure and the number of clusters you ask for, both of which quietly shape what it finds.
Further reading
- Arthur & Vassilvitskii (2007), k-means++: The Advantages of Careful Seeding — why initialisation matters, and the fix.
- Ester et al. (1996), A Density-Based Algorithm for Discovering Clusters — DBSCAN, and clusters that aren't blobs.
- von Luxburg, Williamson & Guyon (2012), Clustering: Science or Art? — the stability and evaluation problem.
Primary sources, listed so you can check the claims on this page rather than take them on trust.
Where people go wrong
- Trusting k from the elbow method. It's a hint. The right k is the one a domain expert can name.
- Running k-means once. It converges to local optima; different seeds give different answers, and that variation is information.
- Clustering unscaled data, then discovering the groups are entirely about revenue because revenue had the biggest numbers.
At a glance
Often compared with
Where this sits
2 concepts come first. Understanding it opens up 1 more.
Computed from the prerequisite graph, not assigned. How this works