pgstrata
The Best Essay
2

March 2024

3

Despite its title this isn't meant to be the best essay.

4

My goal here is to figure out what the best essay would be like.

5

It would be well-written, but you can write well about any topic.

6

What made it special would be what it was about.

7

Obviously some topics would be better than others.

8

It probably wouldn't be about this year's lipstick colors.

9

But it wouldn't be vaporous talk about elevated themes either.

10

A good essay has to be surprising.

11

It has to tell people something they don't already know.

12

The best essay would be on the most important topic you could tell people something surprising about.

13

That may sound obvious, but it has some unexpected consequences.

14

One is that science enters the picture like an elephant stepping into a rowboat.

15

For example, Darwin first described the idea of natural selection in an essay written in 1844.

16

Talk about an important topic you could tell people something surprising about.

17

If that's the test of a great essay, this was surely the best one written in 1844.

18

And indeed, the best possible essay at any given time would usually be one describing the most important scientific or technological discovery it was possible to make. [1]

3–11

This isn't the best essay; I want to figure out what one would be like. It would be well-written — but you can write well about anything, so what makes an essay special is its topic. Not lipstick colors, but not vaporous talk about elevated themes either. A good essay tells people something they don't already know.

12–18

So the best essay is on the most important topic you could tell people something surprising about. Science enters like an elephant stepping into a rowboat: Darwin described natural selection in an essay in 1844, surely the best one that year. The best essay at any time would usually describe the most important discovery then possible to make.

2–18

The best essay isn't just well-written; it's about the most important topic you could tell people something surprising about — which usually means describing the most important discovery it was possible to make.

20

Another unexpected consequence: I imagined when I started writing this that the best essay would be fairly timeless — that the best essay you could write in 1844 would be much the same as the best one you could write now.

21

But in fact the opposite seems to be true.

22

It might be true that the best painting would be timeless in this sense.

23

But it wouldn't be impressive to write an essay introducing natural selection now.

24

The best essay now would be one describing a great discovery we didn't yet know about.

25

If the question of how to write the best possible essay reduces to the question of how to make great discoveries, then I started with the wrong question.

26

Perhaps what this exercise shows is that we shouldn't waste our time writing essays but instead focus on making discoveries in some specific domain.

27

But I'm interested in essays and what can be done with them, so I want to see if there's some other question I could have asked.

28

There is, and on the face of it, it seems almost identical to the one I started with.

29

Instead of asking what would the best essay be? I should have asked how do you write essays well? Though these seem only phrasing apart, their answers diverge.

30

The answer to the first question, as we've seen, isn't really about essay writing.

31

The second question forces it to be.

32

Writing essays, at its best, is a way of discovering ideas.

33

How do you do that well?

34

How do you discover by writing?

20–24

I'd imagined the best essay would be timeless — the best of 1844 much the same as now. The opposite is true. A painting might be timeless that way, but it wouldn't impress anyone to introduce natural selection today. The best essay now describes a discovery we don't yet know about.

25–32

If writing the best essay reduces to making discoveries, I started with the wrong question. Instead of what would the best essay be? I should have asked how do you write essays well? Only phrasing apart, but the second forces the answer to be about writing. At its best, writing essays is a way of discovering ideas.

20–34

Asking what the best essay would be isn't really about writing — it's about making discoveries. The right question is how you write essays well: how you discover by writing.

36

An essay should ordinarily start with what I'm going to call a question, though I mean this in a very general sense: it doesn't have to be a question grammatically, just something that acts like one in the sense that it spurs some response.

37

How do you get this initial question?

38

It probably won't work to choose some important-sounding topic at random and go at it.

39

Professional traders won't even trade unless they have what they call an edge — a convincing story about why in some class of trades they'll win more than they lose.

40

Similarly, you shouldn't attack a topic unless you have a way in — some new insight about it or way of approaching it.

41

You don't need to have a complete thesis; you just need some kind of gap you can explore.

42

In fact, merely having questions about something other people take for granted can be edge enough.

43

If you come across a question that's sufficiently puzzling, it could be worth exploring even if it doesn't seem very momentous.

44

Many an important discovery has been made by pulling on a thread that seemed insignificant at first. How can they all be finches? [2]

45

Once you've got a question, then what?

46

You start thinking out loud about it.

47

Not literally out loud, but you commit to a specific string of words in response, as you would if you were talking.

48

This initial response is usually mistaken or incomplete.

49

Writing converts your ideas from vague to bad.

50

But that's a step forward, because once you can see the brokenness, you can fix it.

51

Perhaps beginning writers are alarmed at the thought of starting with something mistaken or incomplete, but you shouldn't be, because this is why essay writing works.

52

Forcing yourself to commit to some specific string of words gives you a starting point, and if it's wrong, you'll see that when you reread it.

53

At least half of essay writing is rereading what you've written and asking is this correct and complete? You have to be very strict when rereading, not just because you want to keep yourself honest, but because a gap between your response and the truth is often a sign of new ideas to be discovered.

54

The prize for being strict with what you've written is not just refinement.

55

When you take a roughly correct answer and try to make it exactly right, sometimes you find that you can't, and that the reason is that you were depending on a false assumption. And when you discard it, the answer turns out to be completely different. [3]

56

Ideally the response to a question is two things: the first step in a process that converges on the truth, and a source of additional questions (in my very general sense of the word).

57

So the process continues recursively, as response spurs response. [4]

58

Usually there are several possible responses to a question, which means you're traversing a tree.

59

But essays are linear, not tree-shaped, which means you have to choose one branch to follow at each point.

60

How do you choose?

61

Usually you should follow whichever offers the greatest combination of generality and novelty.

62

I don't consciously rank branches this way; I just follow whichever seems most exciting; but generality and novelty are what make a branch exciting. [5]

63

If you're willing to do a lot of rewriting, you don't have to guess right.

64

You can follow a branch and see how it turns out, and if it isn't good enough, cut it and backtrack.

65

I do this all the time.

66

In this essay I've already cut a 17-paragraph subtree, in addition to countless shorter ones.

67

Maybe I'll reattach it at the end, or boil it down to a footnote, or spin it off as its own essay; we'll see. [6]

68

In general you want to be quick to cut.

69

One of the most dangerous temptations in writing (and in software and painting) is to keep something that isn't right, just because it contains a few good bits or cost you a lot of effort.

70

The most surprising new question being thrown off at this point is does it really matter what the initial question is? If the space of ideas is highly connected, it shouldn't, because you should be able to get from any question to the most valuable ones in a few hops.

71

And we see evidence that it's highly connected in the way, for example, that people who are obsessed with some topic can turn any conversation toward it.

72

But that only works if you know where you want to go, and you don't in an essay.

73

That's the whole point.

74

You don't want to be the obsessive conversationalist, or all your essays will be about the same thing. [7]

75

The other reason the initial question matters is that you usually feel somewhat obliged to stick to it.

76

I don't think about this when I decide which branch to follow.

77

I just follow novelty and generality.

78

Sticking to the question is enforced later, when I notice I've wandered too far and have to backtrack.

79

But I think this is the optimal solution.

80

You don't want the hunt for novelty and generality to be constrained in the moment.

81

Go with it and see what you get. [8]

36–42

An essay starts with a question — anything that spurs a response. Traders won't trade without an edge; likewise, don't attack a topic without a way in. You don't need a thesis, just a gap to explore. Merely having questions about what others take for granted can be edge enough.

43–44

A puzzling question is worth pulling even when it seems minor. Many an important discovery began by tugging a thread that looked insignificant. How can they all be finches?

45–50

Then you think out loud — commit to a specific string of words, as if talking. The first response is usually mistaken. Writing converts your ideas from vague to bad. But that's progress: once you can see the brokenness, you can fix it.

51–55

Don't be alarmed at starting with something wrong; this is why essay writing works. At least half of it is rereading and asking is this correct and complete? Be strict — a gap between your answer and the truth often signals new ideas. Sometimes you can't make an answer exactly right because it rests on a false assumption; discard that and the answer comes out completely different.

56–62

Ideally a response does two things: steps toward truth and throws off new questions, so it continues recursively. Usually there are several, so you're traversing a tree — but essays are linear, so you choose one branch each time. Follow whichever offers the greatest combination of generality and novelty; that's just whichever seems most exciting.

63–69

If you're willing to rewrite, you don't have to guess right: follow a branch, and if it's not good enough, cut it and backtrack. In this essay I've already cut a 17-paragraph subtree. Be quick to cut. The dangerous temptation is keeping what isn't right because it has a few good bits or cost you effort.

70–74

The most surprising question thrown off: does the initial question even matter? If the space of ideas is highly connected, it shouldn't — you'd reach the valuable ones in a few hops. And it seems connected: the obsessed can steer any conversation toward their topic. But that works only if you know where you're going, which in an essay you don't.

75–81

The question matters for another reason: you feel obliged to stick to it. I don't think about that when choosing a branch — I follow novelty and generality, and enforce the question later, when I've wandered too far. Don't constrain the hunt in the moment. Go with it and see what you get.

36–81

An essay starts with a question you have edge on. You commit to a response, reread it strictly, and let each answer spur the next — traversing a tree, following novelty and generality, cutting fast whatever isn't right.

83

Since the initial question does constrain you, in the best case it sets an upper bound on the quality of essay you'll write.

84

If you do as well as you possibly can on the chain of thoughts that follow from the initial question, the initial question itself is the only place where there's room for variation.

85

It would be a mistake to let this make you too conservative though, because you can't predict where a question will lead.

86

Not if you're doing things right, because doing things right means making discoveries, and by definition you can't predict those.

87

So the way to respond to this situation is not to be cautious about which initial question you choose, but to write a lot of essays.

88

Essays are for taking risks.

89

Almost any question can get you a good essay.

90

Indeed, it took some effort to think of a sufficiently unpromising topic in the third paragraph, because any essayist's first impulse on hearing that the best essay couldn't be about x would be to try to write it.

91

But if most questions yield good essays, only some yield great ones.

92

Can we predict which questions will yield great essays?

93

Considering how long I've been writing essays, it's alarming how novel that question feels.

94

One thing I like in an initial question is outrageousness.

95

I love questions that seem naughty in some way — for example, by seeming counterintuitive or overambitious or heterodox.

96

Ideally all three.

97

This essay is an example.

98

Writing about the best essay implies there is such a thing, which pseudo-intellectuals will dismiss as reductive, though it follows necessarily from the possibility of one essay being better than another.

99

And thinking about how to do something so ambitious is close enough to doing it that it holds your attention.

100

I like to start an essay with a gleam in my eye.

101

This could be just a taste of mine, but there's one aspect of it that probably isn't: to write a really good essay on some topic, you have to be interested in it.

102

A good writer can write well about anything, but to stretch for the novel insights that are the raison d'etre of the essay, you have to care.

103

If caring about it is one of the criteria for a good initial question, then the optimal question varies from person to person.

104

It also means you're more likely to write great essays if you care about a lot of different things.

105

The more curious you are, the greater the probable overlap between the set of things you're curious about and the set of topics that yield great essays.

106

What other qualities would a great initial question have?

107

It's probably good if it has implications in a lot of different areas.

108

And I find it's a good sign if it's one that people think has already been thoroughly explored.

109

But the truth is that I've barely thought about how to choose initial questions, because I rarely do it.

110

I rarely choose what to write about; I just start thinking about something, and sometimes it turns into an essay.

111

Am I going to stop writing essays about whatever I happen to be thinking about and instead start working my way through some systematically generated list of topics?

112

That doesn't sound like much fun.

113

And yet I want to write good essays, and if the initial question matters, I should care about it.

114

Perhaps the answer is to go one step earlier: to write about whatever pops into your head, but try to ensure that what pops into your head is good.

115

Indeed, now that I think about it, this has to be the answer, because a mere list of topics wouldn't be any use if you didn't have edge with any of them.

116

To start writing an essay, you need a topic plus some initial insight about it, and you can't generate those systematically.

117

If only. [9]

118

You can probably cause yourself to have more of them, though.

119

The quality of the ideas that come out of your head depends on what goes in, and you can improve that in two dimensions, breadth and depth.

120

You can't learn everything, so getting breadth implies learning about topics that are very different from one another.

121

When I tell people about my book-buying trips to Hay and they ask what I buy books about, I usually feel a bit sheepish answering, because the topics seem like a laundry list of unrelated subjects.

122

But perhaps that's actually optimal in this business.

123

You can also get ideas by talking to people, by doing and building things, and by going places and seeing things.

124

I don't think it's important to talk to new people so much as the sort of people who make you have new ideas.

125

I get more new ideas after talking for an afternoon with Robert Morris than from talking to 20 new smart people.

126

I know because that's what a block of office hours at Y Combinator consists of.

127

While breadth comes from reading and talking and seeing, depth comes from doing.

128

The way to really learn about some domain is to have to solve problems in it.

129

Though this could take the form of writing, I suspect that to be a good essayist you also have to do, or have done, some other kind of work.

130

That may not be true for most other fields, but essay writing is different.

131

You could spend half your time working on something else and be net ahead, so long as it was hard.

132

I'm not proposing that as a recipe so much as an encouragement to those already doing it.

133

If you've spent all your life so far working on other things, you're already halfway there.

134

Though of course to be good at writing you have to like it, and if you like writing you'd probably have spent at least some time doing it.

135

Everything I've said about initial questions applies also to the questions you encounter in writing the essay.

136

They're the same thing; every subtree of an essay is usually a shorter essay, just as every subtree of a Calder mobile is a smaller mobile.

137

So any technique that gets you good initial questions also gets you good whole essays.

83–88

Since the question constrains you, it sets an upper bound on the essay — the only place left for variation. Don't let that make you conservative: you can't predict where a question leads, because doing things right means making discoveries. So don't be cautious about which you pick. Write a lot of essays; essays are for taking risks.

89–93

Almost any question yields a good essay; it took effort earlier to find an unpromising enough topic, because an essayist's first impulse on hearing the best essay couldn't be about x is to try to write it. But if most questions yield good essays, only some yield great ones. Can we predict which? Considering how long I've written essays, it's alarming how novel that question feels.

94–99

One thing I like in a question is outrageousness — counterintuitive, overambitious, or heterodox, ideally all three. This essay is an example: writing about the best essay implies there is one, which follows from one essay being better than another. Thinking about something so ambitious is close enough to doing it that it holds your attention.

100–105

One part of that isn't taste: to write a really good essay you have to care about the topic. A good writer can write well about anything, but stretching for novel insights takes caring. So the optimal question varies from person to person — and the more curious you are, the more your curiosities overlap the topics that yield great essays.

106–117

A good question reaches into many areas, and it's a good sign if people think it's already explored. But I rarely choose — I just start thinking about something, and it sometimes becomes an essay. So the answer is one step earlier: write whatever pops into your head, but ensure what pops in is good. A list of topics is useless without edge; you need a topic plus an insight, which you can't generate.

118–126

You can cause yourself to have more, though. What comes out depends on what goes in, improved in two dimensions: breadth and depth. Breadth means learning very different topics; my book-buying looks like an unrelated list, but maybe that's optimal here. You also get ideas by talking — I get more from an afternoon with Robert Morris than from twenty new smart people.

127–137

Depth comes from doing. You really learn a domain only by solving problems in it, so a good essayist probably has to have done some other hard work — you could spend half your time on it and be net ahead. Every subtree of an essay is a shorter essay, like every subtree of a Calder mobile is a smaller mobile.

83–137

The initial question sets a ceiling, but don't be cautious — write a lot; essays are for taking risks. Great ones need a topic you care about plus edge, which you can't generate systematically — but you can feed your mind breadth and depth.

139

At some point the cycle of question and response reaches what feels like a natural end.

140

Which is a little suspicious; shouldn't every answer suggest more questions?

141

I think what happens is that you start to feel sated.

142

Once you've covered enough interesting ground, you start to lose your appetite for new questions.

143

Which is just as well, because the reader is probably feeling sated too.

144

And it's not lazy to stop asking questions, because you could instead be asking the initial question of a new essay.

145

That's the ultimate source of drag on the connectedness of ideas: the discoveries you make along the way.

146

If you discover enough starting from question A, you'll never make it to question B. Though if you keep writing essays you'll gradually fix this problem by burning off such discoveries.

147

So bizarrely enough, writing lots of essays makes it as if the space of ideas were more highly connected.

148

When a subtree comes to an end, you can do one of two things.

149

You can either stop, or pull the Cubist trick of laying separate subtrees end to end by returning to a question you skipped earlier.

150

Usually it requires some sleight of hand to make the essay flow continuously at this point, but not this time.

151

This time I actually need an example of the phenomenon.

152

For example, we discovered earlier that the best possible essay wouldn't usually be timeless in the way the best painting would.

153

This seems surprising enough to be worth investigating further.

154

There are two senses in which an essay can be timeless: to be about a matter of permanent importance, and always to have the same effect on readers.

155

With art these two senses blend together.

156

Art that looked beautiful to the ancient Greeks still looks beautiful to us.

157

But with essays the two senses diverge, because essays teach, and you can't teach people something they already know.

158

Natural selection is certainly a matter of permanent importance, but an essay explaining it couldn't have the same effect on us that it would have had on Darwin's contemporaries, precisely because his ideas were so successful that everyone already knows about them. [10]

159

I imagined when I started writing this that the best possible essay would be timeless in the stricter, evergreen sense: that it would contain some deep, timeless wisdom that would appeal equally to Aristotle and Feynman.

160

That doesn't seem to be true.

161

But if the best possible essay wouldn't usually be timeless in this stricter sense, what would it take to write essays that were?

162

The answer to that turns out to be very strange: to be the evergreen kind of timeless, an essay has to be ineffective, in the sense that its discoveries aren't assimilated into our shared culture.

163

Otherwise there will be nothing new in it for the second generation of readers.

164

If you want to surprise readers not just now but in the future as well, you have to write essays that won't stick — essays that, no matter how good they are, won't become part of what people in the future learn before they read them. [11]

165

I can imagine several ways to do that.

166

One would be to write about things people never learn.

167

For example, it's a long-established pattern for ambitious people to chase after various types of prizes, and only later, perhaps too late, to realize that some of them weren't worth as much as they thought.

168

If you write about that, you can be confident of a conveyor belt of future readers to be surprised by it.

169

Ditto if you write about the tendency of the inexperienced to overdo things — of young engineers to produce overcomplicated solutions, for example.

170

There are some kinds of mistakes people never learn to avoid except by making them.

171

Any of those should be a timeless topic.

172

Sometimes when we're slow to grasp things it's not just because we're obtuse or in denial but because we've been deliberately lied to.

173

There are a lot of things adults lie [blocked] to kids about, and when you reach adulthood, they don't take you aside and hand you a list of them.

174

They don't remember which lies they told you, and most were implicit anyway.

175

So contradicting such lies will be a source of surprises for as long as adults keep telling them.

176

Sometimes it's systems that lie to you.

177

For example, the educational systems in most countries train you to win by hacking the test [blocked].

178

But that's not how you win at the most important real-world tests, and after decades of training, this is hard for new arrivals in the real world to grasp.

179

Helping them overcome such institutional lies will work as long as the institutions remain broken. [12]

180

Another recipe for timelessness is to write about things readers already know, but in much more detail than can be transmitted culturally.

181

"Everyone knows," for example, that it can be rewarding to have kids [blocked].

182

But till you have them you don't know precisely what forms that takes, and even then much of what you know you may never have put into words.

183

I've written about all these kinds of topics.

184

But I didn't do it in a deliberate attempt to write essays that were timeless in the stricter sense.

185

And indeed, the fact that this depends on one's ideas not sticking suggests that it's not worth making a deliberate attempt to.

186

You should write about topics of timeless importance, yes, but if you do such a good job that your conclusions stick and future generations find your essay obvious instead of novel, so much the better.

187

You've crossed into Darwin territory.

188

Writing about topics of timeless importance is an instance of something even more general, though: breadth of applicability.

189

And there are more kinds of breadth than chronological — applying to lots of different fields, for example.

190

So breadth is the ultimate aim.

191

I already aim for it.

192

Breadth and novelty are the two things I'm always chasing.

193

But I'm glad I understand where timelessness fits.

194

I understand better where a lot of things fit now.

195

This essay has been a kind of tour of essay writing.

196

I started out hoping to get advice about topics; if you assume good writing, the only thing left to differentiate the best essay is its topic.

197

And I did get advice about topics: discover natural selection.

198

Yeah, that would be nice.

199

But when you step back and ask what's the best you can do short of making some great discovery like that, the answer turns out to be about procedure.

200

Ultimately the quality of an essay is a function of the ideas discovered in it, and the way you get them is by casting a wide net for questions and then being very exacting with the answers.

201

The most striking feature of this map of essay writing are the alternating stripes of inspiration and effort required.

202

The questions depend on inspiration, but the answers can be got by sheer persistence.

203

You don't have to get an answer right the first time, but there's no excuse for not getting it right eventually, because you can keep rewriting till you do.

204

And this is not just a theoretical possibility.

205

It's a pretty accurate description of the way I work.

206

I'm rewriting as we speak.

207

But although I wish I could say that writing great essays depends mostly on effort, in the limit case it's inspiration that makes the difference.

208

In the limit case, the questions are the harder thing to get.

209

That pool has no bottom.

210

How to get more questions?

211

That is the most important question of all.

139–144

At some point the cycle feels finished — suspicious, since every answer should suggest more. What happens is you feel sated; once you've covered enough ground you lose your appetite, and so has the reader. It isn't lazy to stop, because you could be starting a new essay instead.

145–153

The real drag on the connectedness of ideas is the discoveries you make along the way: discover enough from question A and you never reach B. When a subtree ends you can stop, or pull the Cubist trick of returning to a question you skipped. This time I need an example: earlier we found the best essay isn't usually timeless the way the best painting is.

154–158

Timeless has two senses: permanent importance, and always having the same effect on readers. In art they blend — what looked beautiful to the Greeks still does. In essays they diverge, because essays teach, and you can't teach people what they already know. Natural selection is permanently important, but explaining it can't move us as it moved Darwin's contemporaries, because his ideas won so completely.

159–164

I'd imagined the best essay would be evergreen — deep wisdom appealing equally to Aristotle and Feynman. It isn't. To be evergreen, strangely, an essay has to be ineffective: its discoveries mustn't get absorbed into shared culture, or there's nothing new for the next generation. To surprise future readers too, write essays that won't stick.

166–175

Several ways. Write about things people never learn — ambitious people chasing prizes, realizing too late some weren't worth it; you can count on a conveyor belt of future readers to be surprised. Ditto the inexperienced overdoing things, like young engineers' overcomplicated solutions. Or contradict what adults lie [blocked] to kids about and never correct.

176–182

Systems lie too. Schools train you to win by hacking the test [blocked], which isn't how the important real-world tests work — hard to grasp after decades of training. Another recipe: write what readers already know, but in more detail than culture transmits. Everyone knows having kids [blocked] can be rewarding, but you don't know what forms that takes until you have them.

183–193

I've written all these, but not deliberately to be timeless — and since it depends on ideas not sticking, you shouldn't try. Write about topics of timeless importance, and if your conclusions stick so future generations find your essay obvious, so much the better: you've crossed into Darwin territory. Timeless importance is just one instance of breadth, of which there are more kinds than chronological. Breadth is the ultimate aim.

194–200

This essay has been a tour of essay writing. I started hoping for advice about topics, and I got it: discover natural selection. Yeah, that would be nice. But the best you can do short of a great discovery is procedure: cast a wide net for questions, then be exacting with the answers.

201–211

The striking feature of this map is the alternating stripes of inspiration and effort. The questions depend on inspiration; the answers yield to sheer persistence, since you can keep rewriting. But in the limit it's inspiration that makes the difference: the questions are harder to get, and that pool has no bottom. How to get more questions? That is the most important question of all.

139–211

Essays end when you feel sated. To be evergreen, an essay has to be ineffective — its ideas mustn't stick, or future readers find nothing new. Write about timeless importance; if your conclusions stick anyway, so much the better. Breadth is the ultimate aim.

213

[1] There might be some resistance to this conclusion on the grounds that some of these discoveries could only be understood by a small number of readers. But you get into all sorts of difficulties if you want to disqualify essays on this account. How do you decide where the cutoff should be? If a virus kills off everyone except a handful of people sequestered at Los Alamos, could an essay that had been disqualified now be eligible? Etc.

214

Darwin's 1844 essay was derived from an earlier version written in 1839.

215

Extracts from it were published in 1858.

216

[2] When you find yourself very curious about an apparently minor question, that's an exciting sign. Evolution has designed you to pay attention to things that matter. So when you're very curious about something random, that could mean you've unconsciously noticed it's less random than it seems.

217

[3] Corollary: If you're not intellectually honest, your writing won't just be biased, but also boring, because you'll miss all the ideas you'd have discovered if you pushed for the truth.

218

[4] Sometimes this process begins before you start writing. Sometimes you've already figured out the first few things you want to say. Schoolchildren are often taught they should decide everything they want to say, and write this down as an outline before they start writing the essay itself. Maybe that's a good way to get them started — or not, I don't know — but it's antithetical to the spirit of essay writing. The more detailed your outline, the less your ideas can benefit from the sort of discovery that essays are for.

219

[5] The problem with this type of "greedy" algorithm is that you can end up on a local maximum. If the most valuable question is preceded by a boring one, you'll overlook it. But I can't imagine a better strategy. There's no lookahead except by writing. So use a greedy algorithm and a lot of time.

220

[6] I ended up reattaching the first 5 of the 17 paragraphs, and discarding the rest.

221

[7] Stephen Fry confessed to making use of this phenomenon when taking exams at Oxford. He had in his head a standard essay about some general literary topic, and he would find a way to turn the exam question toward it and then just reproduce it again.

222

Strictly speaking it's the graph of ideas that would be highly connected, not the space, but that usage would confuse people who don't know graph theory, whereas people who do know it will get what I mean if I say "space".

223

[8] Too far doesn't depend just on the distance from the original topic. It's more like that distance divided by the value of whatever I've discovered in the subtree.

224

[9] Or can you? I should try writing about this. Even if the chance of succeeding is small, the expected value is huge.

225

[10] There was a vogue in the 20th century for saying that the purpose of art was also to teach. Some artists tried to justify their work by explaining that their goal was not to produce something good, but to challenge our preconceptions about art. And to be fair, art can teach somewhat. The ancient Greeks' naturalistic sculptures represented a new idea, and must have been extra exciting to contemporaries on that account. But they still look good to us.

226

[11] Bertrand Russell caused huge controversy in the early 20th century with his ideas about "trial marriage." But they make boring reading now, because they prevailed. "Trial marriage" is what we call "dating."

227

[12] If you'd asked me 10 years ago, I'd have predicted that schools would continue to teach hacking the test for centuries. But now it seems plausible that students will soon be taught individually by AIs, and that exams will be replaced by ongoing, invisible micro-assessments.

228

Thanks to Sam Altman, Trevor Blackwell, Jessica Livingston, Robert Morris, Courtenay Pipkin, and Harj Taggar for reading drafts of this.

216–218

Intense curiosity about an apparently minor question is an exciting sign: evolution designed you to attend to what matters, so curiosity about something random may mean you've unconsciously noticed it isn't. If you're not intellectually honest, your writing won't just be biased but boring, since you'll miss the ideas you'd have found by pushing for the truth.

219

The greedy algorithm can land you on a local maximum: if the most valuable question sits behind a boring one, you'll overlook it. But there's no lookahead except by writing, so use a greedy algorithm and a lot of time.

225–226

A 20th-century vogue held that art's purpose was to teach; the Greeks' naturalistic sculptures were a new idea, exciting to contemporaries — but they still look good to us. Russell's ideas about "trial marriage" caused controversy, yet read as boring now because they prevailed: it's what we call dating.

213–228

A few notes: curiosity about a minor question is a signal worth trusting; detailed outlines are antithetical to discovery; the greedy algorithm can strand you on a local maximum, but there's no better strategy than writing and time.