Leeds Business Insights Season 1, Ep. 7: Phil Fernbach Transcript

Amanda Kramer:听Welcome to the听Leeds Business听Insights podcast, featuring expert analysis to help you stand out from the herd. My name is Amanda Kramer. We are so thrilled to have Phil Fernbach here today. Phil Fernbach is a professor of marketing in the听Leeds School of听Business at the听University of Colorado Boulder. He is a cognitive scientist who studies how people think, and he applies insights from his research to improve public disclosure and help consumers and managers make better decisions. He听is听co-author, with Steven Sloman, of the 2017 book,听, which was chosen as an editor's pick by the听New York Times. The book explores why we think we know so much more than we do and the profound implications for individuals and society.听

Today, we are going to be talking about听The听Knowledge听Illusion. We are living in an age of fake news and science denialism that has polarized discussions around vaccinations, climate change, genetically modified food, on and on. Is the answer that you're right and everyone who听doesn鈥檛 agree with you is stupid? Or is it possible that you're not a molecular biologist, and you are oversimplifying highly complex studies and genetic听engineering?听

Today's guest on听Leeds Business Insights is Phil Fernbach, an expert on overconfidence and what he calls听The听Knowledge听Illusion.听Here to shed some light on how people overestimate their understanding of the world and听its consequences that has for us.听

Welcome,听Phil, and thank you so much for being here.

Phil Fernbach: Thanks for having me it鈥檚 a pleasure.

Kramer: Great.听We're really interested in learning more.听So, Phil, your research largely centers around听The听Knowledge听Illusion. Tell us more about听this illusion.

Phil Fernbach Headshot

Fernbach: The听Knowledge听Illusion is a very profound fact about human beings.听This was actually phenomenon that was first studied in the cognitive science world, in the nineties, by a researcher by the name of Frank Keil. And in his studies, he brought people into the lab, and he asked them about their understanding of sort of common household objects, like zippers and toilets and ballpoint pens. The first thing he would do would听be he鈥檇 ask people how well they understood those objects.听Ask yourself how well do you understand how a toilet works. And his subjects and most people, when we've studied the same things, sort of nod their heads and say,听鈥淥h yeah, I听know how that works.鈥 I have a decent understanding of the mechanisms.听In the next phase of the study, what he would do is ask people to explain in detail exactly how the object听works, and what he found was pretty amazing.听He found that people, in general, know remarkably little about听the way the world works. They reach inside and try to explain these phenomena, and they听realize that they have almost nothing to听say, maybe one or two听sentences. And yet, that feeling they have at the beginning, that they understand these things in a lot more depth than they do.听The disconnect between those two things is听what鈥檚 called in the cognitive science world 鈥淭he听Illusion of听Explanatory听Depth鈥 it鈥檚 people's belief that they can explain things in more depth than they can. I got really interested in that phenomenon because me and my co-author Steve Sloman we, realized that this wasn't really about toilets and ballpoint pens. But it was actually about a lot of things. So听really pervasive phenomenon that we tend to overestimate our understanding of things.听And we started studying this in other areas where the implications are really important, like, for instance, people's political beliefs.听Or their beliefs about some of the issues you mentioned before, like, science-based issues and so on.

Kramer:听Thank you very much for that. Now that you've explained to us what听The听Knowledge听Illusion is, where did you go from there? Where did you take this information?

Fernbach:听Starting with this basic idea that people overestimate their understanding of the world, we sort of asked two big questions. The first one is and that gets into the psychology of the way that the mind works. I'm a cognitive scientist by听training, as is Sloman, my co-author.听So if you look at our book, the first half of the book is really a book of cognitive science, which is trying to dissect and understand why this illusion happens.听And in order听to do so, you have to go pretty deep into human psychology and the psychology of groups as well. Social cognition.听The other question that we ask is, 鈥淲here does this play out?鈥澨鼳nd what sort of benefits and drawbacks does this have for human beings and society? And there, we talk about a lot of different areas. I mentioned politics. I mentioned science but also areas like decision-making, education,听and conceptions of what it means to be intelligent and how to work together in groups, and all this other kind of stuff.听So, the second half of the book听is applying the concepts in the first half of the book to sort of these important issues.听And reasons we wrote a whole book about this is because as we started peeling back the layers, we just found that there was a lot.

Kramer:听Now that we understand more about the illusion, can you tell us more about the root of this illusion, Phil, to ground us as we move forward and eventually think about implications?

Fernbach: Yeah. So, one of the big ideas that we talk about is this notion of ignorance.听So, the illusion has two pieces. One is that we don't know very much, which is, you know, kind of interesting in and of itself.听And the second is that we think we know more than we do.听So, the first piece why are individuals ignorant about听the way that the world works?听The answer is that human听beings, as individuals, we just don't have that much capacity to store complex information about the world. Just store detailed information about the world. The mind is not really built for that. There's just too much complexity in the world and it as individuals.听And if we would try to master all of that complexity, we would just fail. It's impossible. There was a great study that we听talked about in the book by a guy named Landauer, a听psychologist in the听鈥80s, who was trying to estimate the memory capacity of human beings on the same scale as you would measure the memory capacity of a computer. And I won't get into the details of how he did this, but it was pretty clever. And he got to an estimate in a few different听ways, and听all the estimates kind of agreed鈥 and the answer was mind-blowing. It was one gigabyte, which is way less than you would have on a thumb drive that might be in your pocket right now.听Human beings just are not built to store a lot of detailed听information; we鈥檙e built for other things. We're really good at sort of common sense at听generalization, at figuring out how to solve problems in new situations.听We tend not to store a lot of detailed information.听Because, a lot of the times, we don't need that detailed information to get by in the world. I might not know how a toilet works, but I know who to call if it breaks. I might not need to know how it works in a lot of detail.听So, that raises the second question, which is why do we overestimate our understanding? Why do we fail to realize that we don't know as much as we think we do? And that is the answer that we come to in the book is pretty deep. And it gets into the subtitle of the book, which is called听鈥淲hy听We听Never听Think听Alone.鈥 And the concept is that human beings were not built as individuals to store a lot of detailed information. What we're built to do is to collaborate in communities of knowledge in groups where every individual has a specialized little bit of knowledge, and we can work together, as a community, to pursue as a sort of arbitrarily complex goals. And so you don't need any individual in the group to know everything. What you need is everybody to know their little piece. And then, as human beings, we need to have cognitive functions, cognitive capacities to be able to collaborate and work together with other human beings. And that seems to be what human beings are so good at.听And where does the illusion come from? The illusion comes from the fact that most of what we know or think we know is actually not in our听own heads, but it's in the heads of other people or the environment, or听on the internet.听And so, we often fail to realize because it's so natural for us to rely on information that exists outside of our own heads. We often fail to realize what's in our heads and what鈥檚 elsewhere. So if everybody around me is sort of nodding their head and saying,听鈥淥h yeah, we understand this.鈥 We sort get the feeling that we ourselves understand it as well. And that sort of sets them understanding that comes from the people around having the knowledge that we don't have is where we argue the illusion comes from. And you can see why we had to write a whole book about this because the story is not so simple. It's actually a pretty nuanced account of听the way the mind works and听the way knowledge works across human beings, and so on. But that's the basic idea is that as individuals, we don't know very much because it's impossible for us to know that much about the world. And we rely on others in our communities for a lot of the knowledge that we rely on.听And that gives us听sort of the feeling that we ourselves understand when we don't sometimes.听

Kramer:听That's really interesting,听Phil. Especially as we think about the implications for group work, which is incredibly important within the business world. Can you tell us more about the implications for groups within a business context?

Fernbach: Yeah, absolutely. Some of听the most the deepest implications of these ideas are in terms of the way we should think about how we add value to the world or to a business. And there's a sort of traditional conception of intelligence that we discuss at length in the book. It's this idea called G that stands for general intelligence. And that's traditionally been the way people that think about someone's value.听鈥淥h, they're smart.鈥 And everyone thinks they know what that means.听And听usually, what that entails is being really good at thinking quickly, solving tricky anagrams, retaining a bunch of information. All that kind of stuff that we traditionally you would see on an intelligence test, but what these听ideas suggest to me that maybe it's not so important. That someone has a huge amount of mental听horsepower, for instance,听or that they know. Or feel like they know tons of information because everything human beings do that matters听is, really, by virtue of this ability to collaborate in groups. Where people have different bits of information. And it's really the process of collaboration that creates something great. And peoples, you should really evaluate people's worth, not by听how smart they are in the traditional sense, but in terms of how much they help a group to succeed. And there鈥檚 a lot of different ways can help a group succeed. And maybe you do want someone on the team who's听has tons of mental horsepower and can think quickly, and so on.听But you need other types of people听who contribute in different ways as well.听A good team has听complementary sets of skills.听And the counterpoint to this is that听a good leader should be aware that they themselves don't understand everything about a particular problem. All the problems we work on in business nowadays are complex, and we often鈥擨'm sure your listeners have the experience of running into people all the time鈥 who feel like they know everything. And in fact, they might feel pressure to pretend like they understand everything in detail. That's why people never听ask obvious questions in a business setting because they think that they should understand everything in detail and know everything. So a good group is going to have a leader who understands his or听her limitations and knows how toput together a team with the complementary skills in a way that functions effectively.

Kramer: Absolutely. That certainly makes sense. And, Phil, I'm wondering how this might connect to what you talk about in terms of the overestimation of our abilities sometimes?听And memory kind of听reinforcing that we're better at something than we are? Could you talk to us more about this memory bias as it relates to overconfidence and investing in some work that you've recently completed?

Fernbach: Sure. Yeah, I'd be happy to.听That鈥檚 a paper that just came out a month or two ago. And it's in听the very important area of investing.听And we know, from a lot of studies, that investors tend to be overconfident.听And that's why oftentimes they trade a time and then make all these, you know? They wheel and deal and make all these moves. And听then, if you look actually at the data, almost nobody beats just a听buy-and-hold strategy over听the听long term. So听there鈥檚 much more simple solutions to the investing problem听where you can grow your wealth.听And people who are overconfident, which is a lot, tend to over-manage their portfolios. Actually, do worse than just a simple听sort of buy-and-hold strategy. It's very common.听One question that's like that comes to mind,听鈥淚s this is an area where people have tons of feedback on their performance?鈥 If you make a bad trade, you learn about it. If you make a good trade, you learn about it. You would think over time that, people would figure out and become more calibrated in terms of their abilities to beat the market and so on. But they don't.听So we asked the question in this work. Why is that?听Could it have something to do with people's memory of their past performance being biased? And that's exactly what we find, which is that people tend to remember their past performance as being better than it actually was.听And that sort of supports this, feeling that they're better traders than they are.

Kramer: Thank you. It's so interesting because you've got this memory bias, and then you also have this knowledge, illusion thinking that you know more than you do. Because those that are around, you know, information. You're in a group setting. Sometimes you're filling in these听gaps, either with听this听information, that you think that听you have or to present as if you already know. So it's this conglomeration of a variety of issues around the solution that we have the听knowledge.

Fernbach: I think you're right.听The reason I got so interested in overconfidence as a phenomenon is because I think it's one of the most, if not the most important, psychological biases. And what you find when you dig in is that听there鈥檚 actually several different reasons why people tend to be overconfident.听One of those is the knowledge illusion. We tend just not to realize how complex the world is and how much is going on. And we tend to over-simplify, and so that's one path to overconfidence. Another path to overconfidence is the idea of confirmation bias. And I don't know if your listeners are familiar with听the term,听but confirmation bias is this is actually not one bias. Still, it鈥檚 a set of biases听that basically all lead us toprocess information in a way that makes us confirm what we already believe or what we want to believe. If I think the Broncos are like the best team. People probably don't believe that anymore, but if they did, then you see some sort of ambiguous outcome in a game, and you say,听鈥淪ee, like that shows that they're the best.鈥澨鼳nd if you are a Patriots fan, you would look at that and say,听鈥淣o, that shows that they're not good.鈥 So this is what people do all the time.听They engage in confirmation bias; they attend up and up.听Any source, any piece of听evidence, will lead them to just strengthen what they already believe. That's number two. And then, this third one, this memory bias that we seem to be hardwired. To have a kind of nostalgia where we remember the good stuff, and we forget the bad stuff, and that can also lead to overconfidence.

So, you put all these things, three things together, and you end up with a pretty powerful bias, where we tend to overestimate our abilities. Tend to overestimate our knowledge, and maybe, we'll talk about this in a little bit. But, it's sort of听a double-edged sword, overconfidence. Because there are situations where it can be good to be overconfident, but it can also be, it can lead to huge problems.听Overconfidence can decimate individuals.听That can decimate society. You know, look at the financial crisis of 2008, a case where traders were totally overconfident. They felt like they understood these derivatives听markets, and they really didn't understand at all. And they became so overconfident that nothing could ever go wrong, and look what happens.听So that's the downside, but there can be positives too. I mean, there has to be a reason from an evolutionary perspective. There has to be a reason听why, despite the dangers, people tend to being听keep overconfident.

Kramer: And that's a great point, Phil. Despite the danger, people are听overconfident. And you've alluded to the fact that there are positives to overconfidence. Could you tell us a little bit more about what those positives might be?

Fernbach: Sure. So I think of it as two things that you can benefit from by being overconfident.听One of them is that you'll try something that's pretty risky.听But might have a high payoff. And so听entrepreneurs, for instance, are famously overconfident.听And if you sat an entrepreneur down and you walk through every reason why their business might fail, maybe they would be deterred, and they actually wouldn't start a business because the probability of success is pretty low.听Entrepreneurship is really hard. I mean, making a successful business is difficult. Most businesses fail.听However, you can't succeed unless you try. Some people try, and they succeed and wow, do they听do great. And so听that鈥檚 one benefit is that it'll push you to try something that might have a high probability of failure but a big payoff. The second one is sort听the social benefit.听People react to confidence and when somebody acts confident, other people listen to them and follow them and promote听them. And by the way, don't try to enter the same business as them.听So听there are all these different kinds of social benefits that you can get by being overconfident.

Now, of course, that comes with the danger because if you're miscalibrated, you鈥檙e gonna be surprised. A lot of those entrepreneurs who start businesses are surprised when things don't go as well as they听assume, when the world is more complicated than they thought when something comes up that they didn't think about. And businesses sometimes, and, you know, by the way, not just businesses, but governments, also sometimes feel the sting of trusting people who are overconfident too much. So just look at Elizabeth Holmes. For instance, she convinced a lot of people to invest in a venture that was doomed to fail. And a lot of people got听egg on their听face. A lot of people lost a lot of money.听And it was because she projected so much confidence for that. At least, that was one reason why she was so successful.

Kramer:听It's really interesting, Phil. We started to talk more about overconfidence, and you听looping back to these three principles.听You talked about oversimplification, the confirmation bias, and the memory bias. We addressed a couple of these. I'd like to explore the oversimplification a little bit more because I think you recently published some work on over-simplification, specifically as related to categorizing people into distinct groups even when the data's more continuous, and this really raises challenges for businesses. Could you tell us more about that?

Fernbach: That was published in the Harvard听Business听Review a听year or听two years ago with former听Leeds professor Bart de Langhe, who's actually moved on to teach in Barcelona. And it's called听The Dangers of听Categorical Thinking. And what we do in that paper is we talk about a bunch of these instances where people take a continuous situation, and they like to break things up into groups that they can understand. This is what the human mind is really built for: we're really good at categorizing.听But some of the danger is that sometimes those categories aren't real things.听

A good example would be a lot of personality tests, like the Myers-Briggs听test, where people say,听鈥淥h yeah, I'm an empathic introvert or whatever it is.鈥 It turns out that those categorizations don't really have any validity to them at all.听There鈥檚听not really separate groups of people听that have the characteristics thatfit into these groups. Everybody's different. And really, these quantities vary听continuously.听Yet what we do is we break people into groups and say,听鈥淵ou're like this, and you're like this.鈥 And when we do, we talk about four dangers in the paper.听The first is amplification means that we think that people who are in separate categories are more different from each听other than, in fact, they are.

A good example would be if you say that someone's a Republican.听Or that someone's a Democrat. The picture that people have in their mind of the prototypical Republican and Democrat is a lot more extreme in terms of distance from each other than is true in reality.听There听are certainly differences. There's real polarization. The perceived polarization is much bigger. That's amplification.听Compression is the second one.听Compression is the idea that we think of everybody who we put into a category as being the same or very similar. That is also not the case; within a category are very different from each other. A lot of times, the third one is discrimination. Once you put things into groups, now you can treat the groups. And the fourth one is what we call fossilization, which is the idea that we get this feeling that the world is a certain way because we think of it in a particular category of a structure. Then, we get stale because we often fail to recognize that the world is changing because we think things are just the way they are.听This often happens with businesses in industries that are changing quickly. You have a categorization of, I don't know what it is, but like, these are our target customers.

This is what they're like, or this is the way that you do innovation in this space. This is what the product matrix looks like. And here's where we could add value. And so on. You have a radical change in an industry. Those categorical structures no longer fit. And you hold yourself. It's likeelectric vehicles鈥攁 lot of the OEMs. The traditional auto听manufacturers听take their gas cars and听throw electric drive听trains in the front hood.听They do not realize that the way transport听will happen in the next 20 years is a lot different. So, maybe they should be thinking about the world a little bit differently.听But when categorical听thinking forces us into these patterns, that can be hard to breathe.

Kramer: So听Phil, you just talk to us about the dangers of categorical thinking and the fork patterns that emerge in categorical thinking, which is a challenge for businesses.听What can businesses do to combat or mitigate categorical thinking? And the four patterns therein?

Fernbach: Sure. So in the paper, we gave four suggestions.听 The first one is听simply to increase awareness. All are aware of this as being a problem, it, naturally, will be something that's on people's minds, and that might help. The second one is to develop capabilities, to analyze data correctly. So businesses more and more these days are dependent on their data and their data analytics and their data analysis capabilities.听And so if you're doing a segmentation study for them,听and you're used to the traditional thing, let's put people into groups and then target particular groups and so on. If you go and read the paper, you'll see that听there are some problems with that sort of traditional approach because it is a kind of categorical thinking that doesn't always match reality.听If you have the appropriate capabilities听in-house to know how to properly analyze such data in more of a continuous way, that's definitely. The third one is what we call auditing decision criteria.听

Sometimes in businesses, we engage in a kind of categorical, go-no-go decision-making style, where it's really a kind of categorical thinking. If X target is hit, you will go down the path. If it's not, go down path B. That's taking a continuous quantity, say听whether we hit a target or don't.And the continuous quantity is now dichotomized and turned into a categorical decision. It's not really good to do听that because you do not want to make a big business decision听on the basis just by chance falling on one side or the other of some arbitrary criteria. And so, what you really want to do is find more continuous ways to mitigate the risk. So if you have really strong evidence, then you would want to take stronger action. And if you听have weak evidence. You would want to take a weak action. So thinking about your decision-making in a more听continuous way is a helpful thing. And the fourth thing, to sort a combat this idea of听fossilization is to hold kind of brainstorming meetings. We call them听de-fossilization meetings, where you听really try to interrogate your deepest sort, most foundational beliefs about the听way your听industry works, about the customer segments in your industry, about the competitive landscape, and so on. And really try to interrogate those and ask yourself whether you're falling into this trap of having kind of a fossilized view of the world. So those are the four things that we recommend.

Kramer: Great. Thank you. That's incredibly clear and really helpful as we think about it from a business perspective. Looping back to the first point you听made there鈥 awareness and thinking about that from an individual lens. How do we be more self-aware? How do we not fall into the trap? That is the knowledge illusion.

Fernbach: Yeah, that's听a great question.听And if the answer is听that, it's really hard. I mean, I study this stuff for a living, and I still fall for those Knowledge听Illusion all the time. I find catch myself all the听time听going,听鈥淥h yeah.听And then wait a second.鈥 It happens to me all the time. But what I have found is that you can train yourself to be better calibrated just by getting into the habit of asking yourself whether you understand something as deeply as you think you do. There's this concept that I like to talk about called intellectual humility.听And intellectual humility, I think of it as being this midpoint between overconfidence and听diffidence, and diffidence means being so unsure about anything that you're completely paralyzed, and you can't do anything. That's not. Diffidence听is if you learn about this knowledge illusion听and then you start thinking about how complicated the world is. You can actually pretty quickly get yourself into a pretty different place because of most of the decisions we have to make. We just do not have enough information. We don't understand them well听enough, and so on.听But oftentimes, we do need to make a decision.听There's never enough information. And as individuals, we just can't hope to know everything about a particular topic. It's just too complicated.听So this midpoint intellectual humility between听diffidence and overconfidence is what I aspire to a lot of the time.

Like I said earlier, it's not always the best. Sometimes it's good to be a little overconfident because it gets you. It gives you a nudge to try something challenging or risky. But in general, calibration is a good thing.听Calibrated investors don't end up getting themselves into big trouble. Calibrated politicians do not听overpromise and underdeliver, and so on. I do think that it is possible to train yourself to habitually ask yourself, ask听yourself the question,听鈥淒o I understand this as well as I think I do?And then, if the answer is no,听the result is not necessarily to say,听鈥淥kay, I'm not going to take a position on this issue.鈥 Okay. Is climate change real? Do I understand climate change?听As well as I thought, probably not. I mean, it's a pretty complicated topic.听Does that mean I should say,听鈥淥kay. Throw my hands up in the air and say, maybe it's not real?鈥 No. However,听what it does say that maybe you should back off the strength of your position a little bit? Maybe you shouldn't tell your cousin at Thanksgiving dinner that听they鈥檙e a total idiot for believing anything different听from what you believe? Because it turns out that you probably don't know what you're talking about听either, you just happened to听be, in this case, on the right side of it. I think that鈥檚 actually promotes more positive discourse. It leads to a lot more positive听interactions and son on.听So, I definitely think that's a good policy to take on听board.

Kramer: You had talked about being in a group and being afraid to ask questions because you want to appear as if you understand what is being talked about.听And maybe you think that you do. Is there something that you can do in those situations to calibrate yourself听at the moment and decide to ask that question?听

Fernbach:听Yeah. I wrote this article听a couple of years ago, and it's called,听. The truth is that a lot of the times, a lot of people in the room if you don't understand something, it's not making sense to you. A lot of the people in the room feel the same way, but nobody asks the question because they don't want to look like they don't know what they're talking about. So, the quick answer is, if you find yourself in that situation, ask. The longer answer is that in order听to do that, you really need a good organizational culture that promotes听that kind of questioning. Because if you don't have that kind of organizational culture, you can suffer penalties from being that person, even if it benefits the firm if it benefits the company. There are sort of two sides to that. One is, we should be asking more stupid questions, and that's on individuals to some extent. But it's also on the leaders鈥 and organizational cultures to foster where it's okay not to know everything because nobody ever does. Otherwise, we鈥檙e听kind of living a lie. You听know, going through pretending everyone knows what they're talking about.听When it's just not the nature of human beings to know what they're talking about a lot of the time,听Most of us know a little bit about a little bit, and that's okay because that's who we are as people.

Kramer: And in your research, did you learn anything about what businesses can do to create an environment where you know employees feel comfortable speaking up and asking these stupid听questions, as you've called it through research?

Fernbach: The evidence has been accruing for a while that听organizational cultures that听are not so hierarchical, and our focus on leaders who try to build teams that are greater than the sum of their parts.听And leader who people some autonomy to really succeed and all that kind of stuff. And leaders who are aware of their own limitations, those types of cultures, in the end, end up leading to better outcomes, both for the employees and for the business.听

Kramer: Thank you,听Phil.听

Fernbach: I've enjoyed speaking with you. Thanks so much for having me.

Kramer: Thank you again for listening to听Leeds Business Insights, and a special thank you to my guest, Phil Fernbach. Make sure you don't miss a single episode. Subscribe听to Leeds Business Insights wherever you get your podcasts. See you next time!