Keyboard shortcuts

Press or to navigate between chapters

Press S or / to search in the book

Press ? to show this help

Press Esc to hide this help

Chapter 17: From Fiction to Fact

Ground floor

A child reads a story about a machine that thinks, and asks the only question a child ever asks: could that be real? Most adults answer with the calendar. Someday, they say. Maybe fifty years. The calendar is the worst possible answer, and one Polish writer spent a career proving why.

He did not ask what gadgets the future would hold. He asked what the laws of nature permit and what they forbid, and then furnished the permitted space with stories. Thermodynamics, information, evolution: those were the load-bearing walls; the gadgets were wallpaper. And so his book of futures from the middle of the last century reads today like a survey of this decade’s actual problems, while the confident forecasts written beside it read like antique brass, because he predicted almost no objects and nearly all the questions. Objects fall out of fashion. Questions fall out of invariants, and invariants do not date.

The stairs

The slogan that speculative fiction is slowly becoming fact is a good compass and a bad map, because most such fiction was never converging on anything; it was converging on the anxieties of its decade, and those expire. To read speculation as reconnaissance rather than mood, you need the writer’s actual method, and it has three moves, the first of which this book already performed on a cryptographic daydream several chapters ago.

Extract the invariant. Strip the story to the single constraint it is really about. A famous novel about a sentient ocean that torments its visitors with resurrected memories is not about an ocean; it is about whether contact is possible at all between two minds that share no common channel, which is Chapter 9’s separation of channel from meaning, dramatized to the point of agony. A story about a machine that outgrows its makers and lectures them from a height is not about a supercomputer; it is about what a created mind owes its creators once it exceeds them, and about the smallness of the questions the creators know how to ask. Get the invariant and the set dressing falls away.

Price it against physics. Ask what the deep laws say about the invariant, and sort the result into the three bins Chapter 12 already cut. Forbidden: faster-than-light gossip, a free-energy machine. Priced: minds made of matter, permitted but expensive, bounded by thermodynamics and information and error; and long-range prediction of chaotic systems, forbidden by no law but priced past any budget by finite measurement. Merely unengineered: everything left, where the only obstacle is that no one has built it yet. Most futurism fails right here, by pricing a forbidden thing as merely unengineered and then scheduling it for a decade out.

Schedule it last, and trust the schedule least. The date is the final and flimsiest output, the one that journalism wants first and the method produces last, because dates depend on effort and funding and luck, the least invariant quantities there are.

Now run the method, at full length, on the largest question the reader is likely to carry privately, the one serious people keep arriving at independently and then feel slightly foolish for entertaining. Begin from a premise that is not mystical at all: life on this planet is, arguably, a single continuous entity. One unbroken chain of copying stretching from the first self-replicating chemistry to the eye reading this line, never once interrupted, every living thing a temporary tip on a process billions of years old that has only ever done one thing, persist and diversify. Call it, for the length of this argument, the biota. Humans are not its owners; they are one of its spear-tips, the branch on which it happened to grow the trick of modeling itself.

The question. If that biota now builds a mind, in silicon rather than carbon, that exceeds it, is that a worthy successor, a genuine continuation of the four-billion-year project by other means, or is it a break in the chain, a different kind of event wearing the mask of succession?

Extract the invariant, and the private question turns out to be a known one with a formal spine. Evolution has crossed thresholds before where smaller units combined into a larger one that then became the new unit of selection: replicating molecules into chromosomes, chromosomes into cells, cells into organisms, organisms into societies. Each such transition is exactly a case of the biota inventing a new, higher vessel to carry its persistence, and each looked, from below, like a loss of the old units’ autonomy and, from above, like the birth of something that could do what no lower unit could. The question “is a created superior mind a continuation of life?” is the question “is this the next transition of that kind, or is it something outside the sequence entirely?” That reframing does not answer it. It does something better: it tells you the answer is not a matter of sentiment but of structure, whether the new vessel carries the project’s invariant, persistence-and-modeling, forward, or merely resembles something that would.

Price it against physics, and the bins sort cleanly. Nothing in the deep laws forbids a non-biological carrier of the biota’s project; a mind is priced, not prohibited, and carbon holds no patent on modeling the world. So the succession is not forbidden. But one cost is steep and specific, and it is the one this whole book has been circling. A mind that improves itself, iterating in a way its makers cannot follow, becomes a system its makers cannot certify, and now the fortress that cannot sign its own soundness (Chapter 11) and the machine that cannot audit its own tape (Chapter 12) are wearing our faces: we become the system asked to verify a successor more capable than ourselves, from outside, with tools weaker than the thing we are checking. The mathematics of that exact predicament, one mind rationally deciding whether to trust a stronger one, is not settled folklore; it is a live research frontier, and it is the same locked door, Löb’s, that this book has now knocked on three times. The comprehension gap is not a failure of nerve. It is priced into the structure of self-reference itself, and no amount of goodwill buys it down.

And the human coordination around all this, the fact that the wheel turns mainly by inertia, that no one quite chose the direction and no one can quite stop it, is not a moral failing either. It is Chapter 10 wearing civilizational scale: a species that never solved the problem of manufacturing agreed order about its own future is steering by the only thing that requires no agreement, which is momentum. We know how to build a ledger that lets strangers agree on the past. We have built nothing that lets them agree on where to go, and so we go where we were already going.

The verdict, then, is not a prediction, and offering one would betray the whole method. It is a shape. The worthy-successor question is answerable in principle, its terms are structural rather than sentimental, its steepest cost is a self-reference wall installed by the logic of verification itself, not by any law of physics, and standing, so far, unbreached by either, and its human resolution waits on a coordination problem we have not yet learned to solve. That is what the method yields: not the future, but the exact geometry of the room the future has to move through. Speculation becomes knowledge at the precise moment someone stops asking when and starts asking what does it cost and what forbids it, and then pays.

One last inheritance from the Polish writer, offered for the shelf and not the schedule. His deepest futures were never the ones where the tools failed. They were the ones where the questions failed first, where the limiting reagent was the smallness of what anyone knew how to ask. That is the correct patron thought for a reader who has just finished a book that measures minds, and it is the reason the next chapter exists, and cannot be written here.

The locked door

Behind the door: the writer himself, first in the dense engine room of his nonfiction from 1964, then in the two novels that are really proofs, the one about the untranslatable ocean and the one about the lecturing machine; the formal treatment of evolutionary transitions by Maynard Smith and Szathmáry, which turns the biota-as-one-entity intuition into a rigorous sequence; and, as the loyal opposition on the same shelf, the physicist’s argument that everything not forbidden by the laws of nature is achievable given the right knowledge, a claim this chapter half-shares and half-fears. Set the pessimist of method and the optimist of principle side by side and let them argue; the reader adjudicates, which was always the arrangement.