The Fine

In January 2016, the United States Federal Trade Commission announced that the company behind the world’s most popular brain-training program would pay two million dollars to settle charges of deceptive advertising. The program had tens of millions of registered users. Its ads had promised that a few minutes of daily games could make people sharper at work and school and could hold off the cognitive decline of age. The commission’s complaint was short and cold: the company did not have the evidence.

Here is what makes the story worth a book rather than a paragraph. The people who built that program were not, by any account, frauds. They had neuroscientists on staff. They had data, oceans of it: millions of users whose scores visibly, undeniably, went up. The improvement was on the dashboards. Users felt it. Investors saw it. And essentially none of it meant what everyone in the building believed it meant.

The scores rose for reasons that required no mind to get better, and the reasons are not exotic. They are three or four pieces of nineteenth- and twentieth-century statistics, each simple enough to explain to a child, each capable of manufacturing a miracle out of noise, and each invisible to smart people under exactly one condition: when the miracle is theirs.

Two years earlier, dozens of the field’s senior scientists had signed a public consensus statement warning that the marketing had outrun the evidence, and in 2016 a major review combed through every study the industry cited. The pattern was consistent: people got better at the games they practiced, and the improvement thinned drastically at the game’s edge, near neighbors sometimes moved, but the broad, durable gains everyone was paying for were never convincingly shown. Train the task, improve the task; the rest largely stays home. A billion-dollar industry had been, in large part, a measurement error with a marketing department.

This book is about why that outcome was inevitable, and what it costs to do the thing honestly. Not brain training specifically; that is only the opening corpse. The subject is bigger and closer: what it takes to attach an honest number to a mind. Any mind. A user’s, a patient’s, an employee’s, a student’s. And then, because the tools will not let us stop where it is comfortable, your own: the mind doing the measuring, which turns out to be an instrument too, with an error term nobody calibrates.

You will meet a boy on a bell tower, a reverend with a ledger, a fortress that cannot certify itself, and a machine that reads its own tape. By the end you will be able to look at any number that claims to describe a mind, a benchmark, a test score, a metric, a dashboard, a gut feeling, and ask it the four or five questions that separate measurement from theater. Most numbers fail the questions. The ones that survive are worth more than almost anything else we make.