pgstrata
How to Be an Expert in a Changing World
2

December 2014

3

If the world were static, we could have monotonically increasing confidence in our beliefs.

4

The more (and more varied) experience a belief survived, the less likely it would be false.

5

Most people implicitly believe something like this about their opinions.

6

And they're justified in doing so with opinions about things that don't change much, like human nature.

7

But you can't trust your opinions in the same way about things that change, which could include practically everything else.

8

When experts are wrong, it's often because they're experts on an earlier version of the world.

3–7

If the world were static, our confidence in a belief could grow each time it survived more experience. That's right for things that don't change much, like human nature—but not for things that change, which is practically everything else.

8

When experts are wrong, it's often because they're experts on an earlier version of the world.

2–8

In a static world, confidence in a belief could grow as it survived experience—but that only holds for things that don't change, like human nature.

10

Is it possible to avoid that?

11

Can you protect yourself against obsolete beliefs?

12

To some extent, yes.

13

I spent almost a decade investing in early stage startups, and curiously enough protecting yourself against obsolete beliefs is exactly what you have to do to succeed as a startup investor.

14

Most really good startup ideas look like bad ideas at first, and many of those look bad specifically because some change in the world just switched them from bad to good.

15

I spent a lot of time learning to recognize such ideas, and the techniques I used may be applicable to ideas in general.

16

The first step is to have an explicit belief in change.

17

People who fall victim to a monotonically increasing confidence in their opinions are implicitly concluding the world is static.

18

If you consciously remind yourself it isn't, you start to look for change.

10–15

Can you protect yourself against obsolete beliefs? Somewhat. Investing in startups is training for exactly this: the best ideas look bad at first, often because some change just switched them from bad to good.

16–18

The first step is an explicit belief in change. People with monotonically increasing confidence implicitly conclude the world is static; remind yourself it isn't, and you start to look for change.

10–18

A decade investing in startups was training in not trusting obsolete beliefs—because the best ideas look bad until some change flips them. The first step is consciously believing the world isn't static.

20

Where should one look for it?

21

Beyond the moderately useful generalization that human nature doesn't change much, the unfortunate fact is that change is hard to predict.

22

This is largely a tautology but worth remembering all the same: change that matters usually comes from an unforeseen quarter.

23

So I don't even try to predict it.

24

When I get asked in interviews to predict the future, I always have to struggle to come up with something plausible-sounding on the fly, like a student who hasn't prepared for an exam. [1] But it's not out of laziness that I haven't prepared.

25

It seems to me that beliefs about the future are so rarely correct that they usually aren't worth the extra rigidity they impose, and that the best strategy is simply to be aggressively open-minded.

26

Instead of trying to point yourself in the right direction, admit you have no idea what the right direction is, and try instead to be super sensitive to the winds of change.

27

It's ok to have working hypotheses, even though they may constrain you a bit, because they also motivate you.

28

It's exciting to chase things and exciting to try to guess answers.

29

But you have to be disciplined about not letting your hypotheses harden into anything more. [2]

20–22

Change that matters usually comes from an unforeseen quarter—nearly a tautology, but worth remembering.

23–26

So I don't try to predict it. Beliefs about the future are so rarely correct they aren't worth the rigidity they impose. Admit you have no idea what the right direction is, and be super sensitive to the winds of change.

27–29

Working hypotheses are fine—they motivate you—but be disciplined about not letting them harden into anything more.

20–29

Change that matters comes from an unforeseen quarter, so I don't try to predict it; I stay aggressively open-minded. Working hypotheses are fine as long as you don't let them harden.

31

I believe this passive m.o. works not just for evaluating new ideas but also for having them.

32

The way to come up with new ideas is not to try explicitly to, but to try to solve problems and simply not discount weird hunches you have in the process.

33

The winds of change originate in the unconscious minds of domain experts.

34

If you're sufficiently expert in a field, any weird idea or apparently irrelevant question that occurs to you is ipso facto worth exploring. [3] Within Y Combinator, when an idea is described as crazy, it's a compliment—in fact, on average probably a higher compliment than when an idea is described as good.

31–32

This passive m.o. works for having ideas, not just judging them: solve problems and don't discount the weird hunches you get along the way.

33–34

The winds of change originate in the unconscious minds of domain experts. If you're sufficiently expert, any weird idea is ipso facto worth exploring. Within Y Combinator, calling an idea crazy is a compliment—a higher one, on average, than calling it good.

31–34

This passive method works for having ideas too: solve problems and don't discount weird hunches. If you're expert enough, any crazy idea is worth exploring.

36

Startup investors have extraordinary incentives for correcting obsolete beliefs.

37

If they can realize before other investors that some apparently unpromising startup isn't, they can make a huge amount of money.

38

But the incentives are more than just financial.

39

Investors' opinions are explicitly tested: startups come to them and they have to say yes or no, and then, fairly quickly, they learn whether they guessed right.

40

The investors who say no to a Google (and there were several) will remember it for the rest of their lives.

41

Anyone who must in some sense bet on ideas rather than merely commenting on them has similar incentives.

42

Which means anyone who wants such incentives can have them, by turning their comments into bets: if you write about a topic in some fairly durable and public form, you'll find you worry much more about getting things right than most people would in a casual conversation. [4]

36–40

Investors have extraordinary incentives here: spot the unpromising startup that isn't before others do, and you make a fortune. And it's more than money—their opinions get tested fast. The investors who said no to Google remember it for the rest of their lives.

41–42

Anyone who bets on ideas rather than just commenting has these incentives—and anyone can have them, by turning comments into bets. Write in durable, public form and you'll worry far more about getting it right.

36–42

Investors have extraordinary incentives to correct obsolete beliefs, because their opinions get tested fast. Anyone can get those incentives by turning comments into bets—writing in durable, public form.

44

Another trick I've found to protect myself against obsolete beliefs is to focus initially on people rather than ideas.

45

Though the nature of future discoveries is hard to predict, I've found I can predict quite well what sort of people will make them.

46

Good new ideas come from earnest, energetic, independent-minded people.

47

Betting on people over ideas saved me countless times as an investor.

48

We thought Airbnb was a bad idea, for example.

49

But we could tell the founders were earnest, energetic, and independent-minded. (Indeed, almost pathologically so.)

50

So we suspended disbelief and funded them.

51

This too seems a technique that should be generally applicable.

52

Surround yourself with the sort of people new ideas come from.

53

If you want to notice quickly when your beliefs become obsolete, you can't do better than to be friends with the people whose discoveries will make them so.

44–46

Another trick: focus on people, not ideas. Discoveries are hard to predict, but the people who'll make them aren't—they're earnest, energetic, and independent-minded.

47–50

We thought Airbnb was a bad idea. But the founders were earnest, energetic, and independent-minded, almost pathologically so. So we suspended disbelief and funded them.

51–53

Surround yourself with the people new ideas come from. To notice quickly when your beliefs go obsolete, be friends with the people whose discoveries will make them so.

44–53

Future discoveries are hard to predict, but the sort of people who'll make them isn't: earnest, energetic, independent-minded. We funded Airbnb on the founders despite thinking the idea was bad.

55

It's hard enough already not to become the prisoner of your own expertise, but it will only get harder, because change is accelerating.

56

That's not a recent trend; change has been accelerating since the paleolithic era.

57

Ideas beget ideas.

58

I don't expect that to change.

59

But I could be wrong.

55–59

Not becoming the prisoner of your own expertise will only get harder, because change is accelerating—and has since the paleolithic era. Ideas beget ideas. But I could be wrong.

55–59

Staying free of your own expertise will only get harder, because change keeps accelerating—and has since the paleolithic. But I could be wrong.

61

Notes

62

[1] My usual trick is to talk about aspects of the present that most people haven't noticed yet.

63

[2] Especially if they become well enough known that people start to identify them with you. You have to be extra skeptical about things you want to believe, and once a hypothesis starts to be identified with you, it will almost certainly start to be in that category.

64

[3] In practice "sufficiently expert" doesn't require one to be recognized as an expert—which is a trailing indicator in any case. In many fields a year of focused work plus caring a lot would be enough.

65

[4] Though they are public and persist indefinitely, comments on e.g. forums and places like Twitter seem empirically to work like casual conversation. The threshold may be whether what you write has a title.

62

My trick for predicting the future is to name aspects of the present most people haven't noticed yet.

63

Be extra skeptical of hypotheses you want to believe—especially once one gets identified with you.

64

"Sufficiently expert" needn't mean recognized; a year of focused work plus caring a lot would do.

65

Persistent comments on forums and Twitter still work like casual conversation; the threshold may be whether your writing has a title.

61–65

Footnotes: predict by naming the unnoticed present; stay skeptical of hypotheses identified with you; "expert" can mean a year of focused work; titled writing raises the stakes.

67

Thanks to Sam Altman, Patrick Collison, and Robert Morris for reading drafts of this.

67

Thanks to Sam Altman, Patrick Collison, and Robert Morris for reading drafts.

67

Thanks to Sam Altman, Patrick Collison, and Robert Morris for reading drafts.