pgstrata
News from the Front
2

September 2007

3

A few weeks ago I had a thought so heretical that it really surprised me.

4

It may not matter all that much where you go to college.

5

For me, as for a lot of middle class kids, getting into a good college was more or less the meaning of life when I was growing up.

6

What was I?

7

A student.

8

To do that well meant to get good grades.

9

Why did one have to get good grades?

10

To get into a good college.

11

And why did one want to do that?

12

There seemed to be several reasons: you'd learn more, get better jobs, make more money.

13

But it didn't matter exactly what the benefits would be.

14

College was a bottleneck through which all your future prospects passed; everything would be better if you went to a better college.

15

A few weeks ago I realized that somewhere along the line I had stopped believing that.

16

What first set me thinking about this was the new trend of worrying obsessively about what kindergarten your kids go to.

17

It seemed to me this couldn't possibly matter.

18

Either it won't help your kid get into Harvard, or if it does, getting into Harvard won't mean much anymore.

19

And then I thought: how much does it mean even now?

3–4

A few weeks ago I had a thought so heretical it surprised me. It may not matter all that much where you go to college.

5–14

For middle class kids like me, getting into a good college was the meaning of life: a bottleneck through which all your future prospects passed.

15

A few weeks ago I realized that somewhere along the line I had stopped believing that.

16–19

What set me thinking was the new trend of worrying about what kindergarten your kids go to. Either it won't help your kid get into Harvard, or if it does, Harvard won't mean much anymore.

2–19

A thought that surprised me: it may not matter all that much where you go to college. For middle-class kids like me it was the meaning of life, a bottleneck all your prospects passed through. But how much does it really mean?

21

It turns out I have a lot of data about that.

22

My three partners and I run a seed stage investment firm called Y Combinator.

23

We invest when the company is just a couple guys and an idea.

24

The idea doesn't matter much; it will change anyway.

25

Most of our decision is based on the founders.

26

The average founder is three years out of college.

27

Many have just graduated; a few are still in school.

28

So we're in much the same position as a graduate program, or a company hiring people right out of college.

29

Except our choices are immediately and visibly tested.

30

There are two possible outcomes for a startup: success or failure—and usually you know within a year which it will be.

31

The test applied to a startup is among the purest of real world tests.

32

A startup succeeds or fails depending almost entirely on the efforts of the founders.

33

Success is decided by the market: you only succeed if users like what you've built.

34

And users don't care where you went to college.

35

As well as having precisely measurable results, we have a lot of them.

36

Instead of doing a small number of large deals like a traditional venture capital fund, we do a large number of small ones.

37

We currently fund about 40 companies a year, selected from about 900 applications representing a total of about 2000 people. [1]

38

Between the volume of people we judge and the rapid, unequivocal test that's applied to our choices, Y Combinator has been an unprecedented opportunity for learning how to pick winners.

39

One of the most surprising things we've learned is how little it matters where people went to college.

21–30

It turns out I have a lot of data. My partners and I run Y Combinator; since the idea always changes, we're mostly judging founders three years out of college. Like a company hiring new grads—except our choices are tested fast: within a year you know whether a startup wins or dies.

31–34

That test is among the purest of real world tests. Success is decided by the market: you only win if users like what you've built. And users don't care where you went to college.

35–39

We fund about 40 companies a year from 900 applications. Between that volume and the rapid test, we've learned how little it matters where people went to college.

21–39

I have a lot of data on this. My partners and I run Y Combinator, judging founders fresh out of college whose choices get tested by the market within a year. The surprise: how little it matters where they went to school.

41

I thought I'd already been cured of caring about that.

42

There's nothing like going to grad school at Harvard to cure you of any illusions you might have about the average Harvard undergrad.

43

And yet Y Combinator showed us we were still overestimating people who'd been to elite colleges.

44

We'd interview people from MIT or Harvard or Stanford and sometimes find ourselves thinking: they must be smarter than they seem.

45

It took us a few iterations to learn to trust our senses.

46

Practically everyone thinks that someone who went to MIT or Harvard or Stanford must be smart.

47

Even people who hate you for it believe it.

48

But when you think about what it means to have gone to an elite college, how could this be true?

49

We're talking about a decision made by admissions officers—basically, HR people—based on a cursory examination of a huge pile of depressingly similar applications submitted by seventeen year olds.

50

And what do they have to go on?

51

An easily gamed standardized test; a short essay telling you what the kid thinks you want to hear; an interview with a random alum; a high school record that's largely an index of obedience.

52

Who would rely on such a test?

41–45

Grad school at Harvard dispels any illusions about the average Harvard undergrad, yet we still overestimated elite-college people—we'd interview someone from MIT or Stanford and think, they must be smarter than they seem. It took a while to trust our senses otherwise.

46–47

Practically everyone thinks someone who went to MIT or Harvard or Stanford must be smart. Even people who hate you for it believe it.

48–52

But what is an elite admission? A decision by admissions officers—basically HR people—judging seventeen year olds on a gamed test, an essay telling you what they think you want to hear, and a record that's largely an index of obedience.

41–52

Grad school cured me of illusions about Harvard undergrads, yet we still overestimated elite-college people. But think what an elite admission actually is: a decision by HR-like officers from a gamed test, a pandering essay, and a record of obedience.

54

And yet a lot of companies do.

55

A lot of companies are very much influenced by where applicants went to college.

56

How could they be?

57

I think I know the answer to that.

58

There used to be a saying in the corporate world: "No one ever got fired for buying IBM." You no longer hear this about IBM specifically, but the idea is very much alive; there is a whole category of "enterprise" software companies that exist to take advantage of it.

59

People buying technology for large organizations don't care if they pay a fortune for mediocre software.

60

It's not their money.

61

They just want to buy from a supplier who seems safe—a company with an established name, confident salesmen, impressive offices, and software that conforms to all the current fashions.

62

Not necessarily a company that will deliver so much as one that, if they do let you down, will still seem to have been a prudent choice.

63

So companies have evolved to fill that niche.

64

A recruiter at a big company is in much the same position as someone buying technology for one.

65

If someone went to Stanford and is not obviously insane, they're probably a safe bet.

66

And a safe bet is enough.

67

No one ever measures recruiters by the later performance of people they turn down. [2]

54–63

And yet a lot of companies are heavily influenced by where applicants went. Why? There used to be a saying: "No one ever got fired for buying IBM." People buying technology for large organizations don't mind paying a fortune for mediocre software—it's not their money. They want a supplier who, if it lets them down, will still have seemed a prudent choice.

64–67

A recruiter is in the same position. If someone went to Stanford and isn't obviously insane, they're a safe bet—and a safe bet is enough. No one measures recruiters by the people they turn down.

54–67

Yet a lot of companies are heavily influenced by where you went. The reason is the old "no one ever got fired for buying IBM": buyers and recruiters alike just want a choice that seems safe, since no one measures them on the candidates they turn down.

69

I'm not saying, of course, that elite colleges have evolved to prey upon the weaknesses of large organizations the way enterprise software companies have.

70

But they work as if they had.

71

In addition to the power of the brand name, graduates of elite colleges have two critical qualities that plug right into the way large organizations work.

72

They're good at doing what they're asked, since that's what it takes to please the adults who judge you at seventeen.

73

And having been to an elite college makes them more confident.

74

Back in the days when people might spend their whole career at one big company, these qualities must have been very valuable.

75

Graduates of elite colleges would have been capable, yet amenable to authority.

76

And since individual performance is so hard to measure in large organizations, their own confidence would have been the starting point for their reputation.

77

Things are very different in the new world of startups.

78

We couldn't save someone from the market's judgement even if we wanted to.

79

And being charming and confident counts for nothing with users.

80

All users care about is whether you make something they like.

81

If you don't, you're dead.

82

Knowing that test is coming makes us work a lot harder to get the right answers than anyone would if they were merely hiring people.

83

We can't afford to have any illusions about the predictors of success.

84

And what we've found is that the variation between schools is so much smaller than the variation between individuals that it's negligible by comparison.

85

We can learn more about someone in the first minute of talking to them than by knowing where they went to school.

69–73

Elite colleges work as if they'd evolved to prey on large organizations. Their graduates have two useful qualities: they're good at doing what they're asked—what pleases the adults who judge you at seventeen—and elite college makes them confident.

77–81

Startups are different. Charm counts for nothing with users. All they care about is whether you make something they like. If you don't, you're dead.

82–85

Knowing that test is coming makes us work harder than anyone merely hiring would. The variation between schools is so much smaller than between individuals that it's negligible—we learn more in the first minute of talking to someone than from their school.

69–85

Elite grads have two qualities that plug into big organizations: they're good at doing what they're asked, and they're confident—once invaluable for lifelong careers. But startups are different: charm counts for nothing with users, so the variation between schools is negligible beside that between individuals.

87

It seems obvious when you put it that way.

88

Look at the individual, not where they went to college.

89

But that's a weaker statement than the idea I began with, that it doesn't matter much where a given individual goes to college.

90

Don't you learn things at the best schools that you wouldn't learn at lesser places?

91

Apparently not.

92

Obviously you can't prove this in the case of a single individual, but you can tell from aggregate evidence: you can't, without asking them, distinguish people who went to one school from those who went to another three times as far down the US News list. [3] Try it and see.

93

How can this be?

94

Because how much you learn in college depends a lot more on you than the college.

95

A determined party animal can get through the best school without learning anything.

96

And someone with a real thirst for knowledge will be able to find a few smart people to learn from at a school that isn't prestigious at all.

97

The other students are the biggest advantage of going to an elite college; you learn more from them than the professors.

98

But you should be able to reproduce this at most colleges if you make a conscious effort to find smart friends.

99

At most colleges you can find at least a handful of other smart students, and most people have only a handful of close friends in college anyway. [4] The odds of finding smart professors are even better.

100

The curve for faculty is a lot flatter than for students, especially in math and the hard sciences; you have to go pretty far down the list of colleges before you stop finding smart professors in the math department.

101

So it's not surprising that we've found the relative prestige of different colleges useless in judging individuals.

102

There's a lot of randomness in how colleges select people, and what they learn there depends much more on them than the college.

103

Between these two sources of variation, the college someone went to doesn't mean a lot.

104

It is to some degree a predictor of ability, but so weak that we regard it mainly as a source of error and try consciously to ignore it.

87–92

But "look at the individual" is weaker than the idea I began with—that it doesn't much matter where a given individual goes. Don't you learn things at the best schools you wouldn't elsewhere? Apparently not: in aggregate you can't, without asking, tell apart people from schools three times as far apart on the US News list.

93–96

How much you learn depends far more on you than the college. A party animal gets through the best school learning nothing; someone with a real thirst for knowledge finds smart people to learn from at a school that isn't prestigious at all.

97–100

The other students are an elite college's biggest advantage—you learn more from them than the professors—but you can reproduce that anywhere by finding smart friends, since most people have only a handful anyway.

101–104

So prestige is useless in judging individuals: between the randomness of how colleges select and how much learning depends on the student, where someone went is a predictor weak enough that we treat it as error and ignore it.

87–104

"Look at the individual" is weaker than my real claim: it doesn't much matter where a given person goes. You can't tell graduates of schools far apart on the US News list. How much you learn depends more on you—and even an elite's best advantage, smart peers, is reproducible elsewhere.

106

I doubt what we've discovered is an anomaly specific to startups.

107

Probably people have always overestimated the importance of where one goes to college.

108

We're just finally able to measure it.

109

The unfortunate thing is not just that people are judged by such a superficial test, but that so many judge themselves by it.

110

A lot of people, probably the majority of people in America, have some amount of insecurity about where, or whether, they went to college.

111

The tragedy of the situation is that by far the greatest liability of not having gone to the college you'd have liked is your own feeling that you're thereby lacking something.

112

Colleges are a bit like exclusive clubs in this respect.

113

There is only one real advantage to being a member of most exclusive clubs: you know you wouldn't be missing much if you weren't.

114

When you're excluded, you can only imagine the advantages of being an insider.

115

But invariably they're larger in your imagination than in real life.

116

So it is with colleges.

117

Colleges differ, but they're nothing like the stamp of destiny so many imagine them to be.

118

People aren't what some admissions officer decides about them at seventeen.

119

They're what they make themselves.

106–108

I doubt this is specific to startups. Probably people have always overestimated college. We're just finally able to measure it.

109–113

The unfortunate thing isn't only that people are judged by such a superficial test, but that so many judge themselves by it. The real liability of not going where you wanted is your own feeling of lacking something. Colleges are like exclusive clubs: the one advantage of belonging is knowing you'd not be missing much.

114–117

When excluded you can only imagine the advantages of being an insider, but they're always larger in imagination than in life. So it is with colleges: they differ, but they're nothing like the stamp of destiny so many imagine.

118–119

People aren't what some admissions officer decides about them at seventeen. They're what they make themselves.

106–119

This probably isn't specific to startups; people have always overestimated college, we're just finally able to measure it. The real tragedy is how many judge themselves by it. Like an exclusive club, the only real advantage is knowing you wouldn't be missing much.

121

Indeed, the great advantage of not caring where people went to college is not just that you can stop judging them (and yourself) by superficial measures, but that you can focus instead on what really matters.

122

What matters is what you make of yourself.

123

I think that's what we should tell kids.

124

Their job isn't to get good grades so they can get into a good college, but to learn and do.

125

And not just because that's more rewarding than worldly success.

126

That will increasingly be the route to worldly success.

121–126

The great advantage of not caring where people went is that you can focus on what really matters: what you make of yourself. That's what we should tell kids—their job isn't to get good grades to get into a good college, but to learn and do. That will increasingly be the route to success.

121–126

The advantage of not caring where people went isn't just that you stop judging by superficial measures, but that you can focus on what matters: what you make of yourself. That's what we should tell kids—and it's increasingly the route to worldly success too.

128

Notes

129

[1] Is what we measure worth measuring? I think so. You can get rich simply by being energetic and unscrupulous, but getting rich from a technology startup takes some amount of brains. It is just the kind of work the upper middle class values; it has about the same intellectual component as being a doctor.

130

[2] Actually, someone did, once. Mitch Kapor's wife Freada was in charge of HR at Lotus in the early years. (As he is at pains to point out, they did not become romantically involved till afterward.) At one point they worried Lotus was losing its startup edge and turning into a big company. So as an experiment she sent their recruiters the resumes of the first 40 employees, with identifying details changed. These were the people who had made Lotus into the star it was. Not one got an interview.

131

[3] The US News list? Surely no one trusts that. Even if the statistics they consider are useful, how do they decide on the relative weights? The reason the US News list is meaningful is precisely because they are so intellectually dishonest in that respect. There is no external source they can use to calibrate the weighting of the statistics they use; if there were, we could just use that instead. What they must do is adjust the weights till the top schools are the usual suspects in about the right order. So in effect what the US News list tells us is what the editors think the top schools are, which is probably not far from the conventional wisdom on the matter. The amusing thing is, because some schools work hard to game the system, the editors will have to keep tweaking their algorithm to get the rankings they want.

132

[4] Possible doesn't mean easy, of course. A smart student at a party school will inevitably be something of an outcast, just as he or she would be in most high schools [blocked].

133

Thanks to Trevor Blackwell, Sarah Harlin, Jessica Livingston, Jackie McDonough, Peter Norvig, and Robert Morris for reading drafts of this.

129

Getting rich from a technology startup takes some amount of brains—about the same intellectual component as being a doctor.

130

Once, someone was measured on a rejection. Worried Lotus was losing its startup edge, Freada Kapor, who ran HR there, sent recruiters the resumes of its first 40 employees with details changed. These were the people who'd made Lotus a star. Not one got an interview.

131

The US News list is meaningful precisely because the editors are intellectually dishonest: with no external source to calibrate the weights, they adjust them till the top schools come out the usual suspects in about the right order.

133

Thanks to Trevor Blackwell, Sarah Harlin, Jessica Livingston, Jackie McDonough, Peter Norvig, and Robert Morris for reading drafts.

128–133

Notes: getting rich from a tech startup takes real brains; the Lotus recruiters who rejected their own first 40 employees; why the US News list works precisely because it's intellectually dishonest; thanks to early readers.