Perceptron
The first trainable neural network, from 1958 — and the story of how a book killed it is the most repeated wrong story in AI.
When not to use it
- (Nobody uses a perceptron. The question is what the story teaches.)*
- As evidence that critics kill fields. They identified a real unsolved problem and it took seventeen years to solve.
- On non-separable data. It cycles forever. No graceful degradation.
- As a model of a modern neuron without the caveat. The hard threshold is exactly what blocked gradients.
- Citing "the XOR thing" without reading them. The order/diameter results are the real content.
Reach for something else instead
- Logistic regression — a perceptron with a sigmoid and a probabilistic interpretation. Strictly better.
- SVM — maximises the margin the convergence theorem depends on.
- Multilayer networks — what Minsky and Papert said would work if you could train it. You can now.
Read more on the blog
- Who invented deep learning, and why it took so longBackpropagation was invented at least four times before it stuck. The ideas behind deep learning were mostly in place by 1990. What was missing was not insight.
- What actually caused the AI wintersThe book that supposedly killed neural networks proved a true theorem and attached a false conjecture. The field remembered the conjecture. Three myths about the AI winters, and what the record shows instead.
The full account
The story everyone tells
It goes like this. In 1969 Marvin Minsky and Seymour Papert published Perceptrons, proved that a perceptron cannot compute XOR, and the field died. Funding collapsed, researchers scattered, and neural networks lay dormant for a decade or more until backpropagation revived them in 1986. Two men with a book killed a field.
It is a wonderful story. It has villains, a martyr, a tragic delay measured in decades, and a redemption arc. It appears in textbooks, courses, and essentially every popular history of AI. It is also, in most of its load-bearing parts, wrong — and the ways it's wrong are more interesting than the story.
What the book actually proved
The mathematics is correct and nobody disputes it. Minsky and Papert showed that a single-layer perceptron — more precisely, perceptrons of bounded order — cannot compute certain predicates. XOR is the famous one because it's small enough to fit on a slide, but their deeper results concern predicates like parity and connectedness, and those are the mathematically substantial part that almost nobody mentions.
Two things about this are routinely dropped.
Rosenblatt already knew. The linear separability limitation was not a revelation delivered to an unsuspecting field. Rosenblatt had acknowledged it in his own writing, and Principles of Neurodynamics (1962) discusses multi-layer systems years before the book that supposedly destroyed him. The book did not tell him something he didn't know. It told everyone else, rigorously, with MIT's institutional weight behind it.
Minsky and Papert knew about multilayer networks. They discussed them. What they lacked — what everybody lacked — was a learning algorithm for them. That is the actual gap, and it is not a gap in imagination: nobody knew how to train a multi-layer network in 1969, and it is worth noticing that the same authors could not have solved that by being more optimistic.
Whether they dismissed multilayer networks as a dead end is where the argument lives, and the honest answer is that the book's tone is more discouraging than its mathematics warrants, that this has been read maximally uncharitably by later partisans, and that reasonable people who have read the actual text still disagree about it.
The chronology that breaks the story
Here is the detail that does most of the damage, and it is a matter of dates rather than interpretation.
By 1969, most researchers had already left. The connectionist school had been losing people for years — not to a book, but to the ordinary attrition of a research programme that wasn't progressing. There was no backpropagation, no compute, and no path to scale. The symbolic school was ascendant and had been for some time.
Minsky and Papert's campaign started around 1965, four years before publication, conducted through conference talks and circulated manuscripts. So if you want to attribute influence to them, the book is the wrong artefact and the wrong date — it's the published version of an argument that had already done its work.
Which produces the actual mechanism: the book arrived just as the symbolic school achieved dominance, into a field that was nearly empty of opponents. It met little objection because there was almost nobody left to object. And that silence was read, afterwards, as the sound of a field being killed rather than the sound of a room that had already emptied. The last significant holdout, Frank Rosenblatt, died in 1971.
The book's reputation as the neural network killer is a story about timing, not causation.
| The story | What happened |
|---|---|
| The book killed the field in 1969 | The field was already leaving; the campaign ran from ~1965 |
| It proved neural networks can't work | It proved single-layer perceptrons can't compute certain predicates |
| Rosenblatt was blindsided | He'd acknowledged the limitation himself; discussed multilayer in 1962 |
| Nobody knew multilayer would fix it | Everyone did — nobody had a training algorithm, which is a different problem |
| It caused the AI winter | The funding collapse followed Lighthill (1973) and was about AI broadly |
The winter had different authors
The first AI winter is real. Its causes were not this book. The sharp funding decreases in the UK and US followed the Lighthill report in 1973 and the Department of Defense's American Study Group report — both commissioned assessments, both broadly negative, and both concerned with the whole field's failure to deliver on its promises rather than with the linear separability of a specific architecture. Symbolic AI, the supposed victor, got its own winter a decade later when expert systems failed to scale.
Attributing that to Perceptrons requires believing a monograph in computational geometry drove national science policy in two countries four years later. The winter came from AI over-promising and under-delivering, which is a pattern with more than one instance and no need of villains.
Why the myth is so durable
Because it is a much better story than the truth, and because it is useful. It gives connectionism a martyrdom narrative and a reason its ideas were right all along and merely suppressed — which is a considerably more flattering account than "we had the right idea, no algorithm, no data, no compute, and it took thirty years to get them."
Olazaran's 1996 study in Social Studies of Science is the scholarly treatment, and its subject is precisely this: not what happened, but how the official history came to be written, and whose interests it served. The perceptron controversy was reopened in the 1980s by the winning side, and the version that stuck was written by the winners about their own suppression.
There is a human coda that the myth omits. Minsky and Rosenblatt had known each other since adolescence — the same high school, a year apart — before taking opposite sides of the field's founding argument. When the expanded edition of Perceptrons appeared in 1987, it carried a dedication to Frank Rosenblatt, who had been dead for sixteen years.
What to take from it
The transferable lesson is not about perceptrons. It is that a field's account of its own history is written afterwards, by whoever won, and optimised for narrative rather than accuracy. This one has a precise proof at its centre, an identifiable villain, a dead martyr, and a satisfying arc — and it is repeated, unchecked, by people who would never accept that standard of evidence in their own work.
If you want to know whether a story in AI is true, the useful question is who benefits from it being told. That question is not cynical. It is the one Olazaran asked, and it produced a better answer than three decades of textbooks.
Further reading
- Rosenblatt (1958), The Perceptron: A Probabilistic Model for Information Storage and Organization in the Brain — the machine that learned.
- Minsky & Papert (1969), Perceptrons: An Introduction to Computational Geometry — read what they actually claimed; the order/diameter results are the substance.
- Rumelhart, Hinton & Williams (1986), Learning representations by back-propagating errors — the answer to the real objection, seventeen years later.
- Olazaran (1996), A Sociological Study of the Official History of the Perceptrons Controversy — Social Studies of Science; the scholarly account of how the story got fixed, and by whom.
- Rosenblatt (1962), Principles of Neurodynamics — where Rosenblatt discusses multi-layer systems himself, years before the book that supposedly ended him.
Primary sources, listed so you can check the claims on this page rather than take them on trust.
Where people go wrong
- Repeating the myth that Perceptrons killed neural networks out of dogma. They named a real problem: nobody could train multilayer nets.
- Thinking XOR was the book's main result. The scaling limitations are the mathematics.
- Missing that the hard threshold was the actual obstacle. Swapping it for a sigmoid is what unlocked backprop.
- Reading the 1958 press coverage as a quaint historical oddity. The overclaiming pattern is unchanged.
At a glance
Often compared with
Where this sits
2 concepts come first. Understanding it opens up 157 more.
Computed from the prerequisite graph, not assigned. How this works