Machine Learning And Personalized Interventions: David Halpern

• Nudging against violence (domestic violence, classroom violence and civil violence)
• What nudging means in 2019 and how it will evolve in the next 10 years
• Behavioral science and machine learning: the implications of personalized interventions
• Nudging the nudgers: making nudging more ethical through enhanced democratic deliberation
• Interfacing public- and private-sector nudging for maximum impact
• The skills and experience you need to work in applied behavioral science
• How nudging should be regulated and who should decide the ethical boundaries of nudging
• The future of the BIT: exciting projects and challenges

From building an intervention to building a process

“The challenge is not just for the development of a one-off intervention, but also designing a platform and a way of working in your organization to be able to perpetually tune, refine, innovate, try new things. That’s often been one of the biggest steps.”

Some things are obvious but wrong

“Sometimes it’s being considered so self-evident that something is a no brainer; you say: ‘Of course, you should do the following.’ In medicine, particularly, this is referred to as the parachute test. It would be unethical to run a controlled trial because it’s so obvious that this thing is more effective [than what we currently use]. What is worth bearing in mind is there are now some very famous examples where people made that argument and when someone finally got around to doing a controlled trial, it turned out that the assumption was wrong. Wherever we can, we should check—and we should also check for other reasons, which is that: do we understand what the active ingredient is?”

People build their environment, and vice versa

“I’m quite a big believer in essentially forms of enhanced democratic deliberation that enable  samples of the public to walk that journey with us, hear different views and then let them make the decisions, essentially. Let them give us permission if they think it’s right to make the change. Put the power back into the hands of individual consumers, families and citizens to be able to shape the world, which in turn shapes them.”

The public needs to see inside the box

“I don’t think you just handle these arguments with a very elegant ethical internal argument. You do need to engage the public directly and have them be involved in shaping this, as sometimes put, it really matters who is nudging the nudger and we need to have strong mechanisms both in government but actually also in relation to private-sector players.”

Nudging at the public–private interface

“Some of the most interesting problems and puzzles in behavioral science are the interface between public-sector and private-sector operations. Designing markets that need that good companies and good products really come to the fore and grow. Right? What does that look like? How do you design two-way platforms that have the right characteristics that support innovation and growth?”

Nudging for good: conflicts and social mobility

“We’re really into what can you do to use behavioral science to stop conflicts and to reduce the reignition of previous conflicts which is very exciting. Social mobility will be another grey area and one of those great deep issues.”

When testing becomes the norm

“One of the telltale signs we’ll know if we’re successful is that we are not separated out as behavioral science anymore. You know what I mean? Empiricism won’t be ‘oh we do experiments.’ That’s just how you should do public administration. That’s how you should run things. Companies will just have this built into them, governments will have it built into them.”

• Predictiv: Rapid online research that tests human behavior
• Insights from behavioral sciences to prevent and combat violence against women
• Tackling tuberculosis in Moldova
• Using data science in policy
• Social support and attendance in further education colleges in the UK

• Social Capital (2004)
• The Hidden Wealth of Nations (2009)
• Inside the Nudge Unit: How Small Changes Can Make a Big Difference (2016)
• MINDSPACE: Influencing Behavior Through Public Policy (2010)

Amazon’s mechanical turk: online crowdsourcing platform

Jakob: Thank you so much for joining us today, David. We’re very honoured to have you.

Jakob: Today, we’ll be discussing some of the large trends in the industry, but before we do that, I think a lot of people who are familiar with you would love to know, what are you working on these days? What are some of the more exciting projects you can share with us?

David: That’s like asking, “Who’s your favourite Child?”. There’s a lot of exciting things that we’re doing. High up in the list, is some of the work we’re doing on domestic violence, which is tough. There aren’t very many interventions that work well. There is a particularly interesting intervention in Australia, which is going very well. We are also doing a lot of stuff around financial behavior and how it interacts with disadvantage and tunneling effects and so on.

David: Actually a lot of our work these days is also market design moving backwards and forwards between quite micro behavior like on sugar, if you change positioning or something, or different labels, how they affect what people choose right up to how does that go into design. We’ve been very, we spent a lot of time on the design of the UK sugar tax and sugar levy, which has been highly effective in terms of reducing volumes, so its that relationship between the micro and the macro.

Jakob: Great. Thank you so much for that David. If I can just pick one particular theme of the ones that you have just mentioned spark my interest because I happen to work a bit on violence prevention projects at the World Bank Group. You mentioned initially the topic of domestic violence and particularly in Australia. Could you share with our listeners a little bit more what this type of work entails?

David: Sure. On violence, in fact we’re doing quite a lot of work. Across the world a lot of the volume by the way of activity of police is involved in violence and as we see reductions actually settle on other kinds of form of crime or problematic behavior. It can range and we’ve been doing work in refugee camps to see if we can reduce violence in a classroom setting, which are very tough environment indeed, where people are trying to almost do crowd control. What is an effective intervention in that context? We’ve had some success, through to the work on domestic violence has been in relation to people, actually various points here where they turn up to court, but also we don’t have the results yet. We have very interesting intervention, which is in the field working with core workers and the people who are often trying to stop their own behavior and using implementation intentions to help them plan ahead, and think about what’s happening and so should act differently in the context.

David: The more extreme form of that is we’re doing some work in Latin American to see if we can make it less likely to have the recognition of a civil war, two wars start every year. One of the things I think that sits behind this is people are now maybe increasingly familiar with using behavioral science to get people to pay their tax on time or to get us to save more for our pensions or whatever. A lot of what human behavior is about is the flesh and blood stuff, and literally in the case of violence, of course just emotional and hot headed and groupish, and behavioral science ought to, and I think does have quite a lot to say in relation to these types of issues too.

Jakob: Fantastic. Thank you, David. Well, I may, as you said, I think the expertise that we bring or some of our listeners bring is and has been out there for quite a while is about how to apply behavioral science to change letters, et cetera. I think a lot of people would be interested in how to apply it to such complex issues as violence. Maybe we can circle back to that later, but let me move on and maybe shed some light for some of our listeners that may not even be familiar with the topic of behavioral science per se. Interest in applied behavioral science seems to be continuously growing. With that said views about what nudging, irrationality, behavioral economics or behavioral science are, have also shifted. If I would ask you David, what do you think nudging means in 2019, and how do you think this is likely to change in the coming years?

David: Well, essentially because different languages translate it in a slightly different way but with most people, I think it’s a gentle prompt. Because it’s often seen in relation to other kinds of levers, so financial incentive or allure with a very strong sanction attached to it. Nudging being something which is a much gentle prompt or cue than that which then in principle the individual can override if they want to do so and make a different choice. In that sense, it fits with its North American origins of being, if not actually choice and harnessing at least not choice reducing if possible. Maybe that’s what I assume means to many people still. That’s still, I think amongst those who are practitioners, it’s deepening and broadening in the areas that it’s being used, so people were used to it being a very simple one off little cue, like, Oh, you know, those people pay their tax on time.

David: Oh that’s interesting. Then you become more likely to pay your tax, result which of course we’ve now replicated in many countries. Let’s say it has lots of other aspects to it so it can be applied in relation to public service population. We’re just about to release results around clinicians to increase the referral rates of clinicians or patients who have symptoms that might be cancer with quite a big effect size, so sometimes you want to nudge experts behavior, or in relation to or another medical example. More than a million people in the world die still from Tuberculosis, and yet we’ve had a treatment for Tuberculosis since the 1940s. A key issue is that people don’t persist with their treatment.

David: The classic World Health Organization approach is what’s called Observed Treatment, so you literally watch someone making sure they’re having their pills. It’s pretty clunky and difficult and we’ve done an intervention and a trial in Moldova, which doubles Observed Treatment. That’s more than just a cue in a letter, some of these things are much more expensive. It’s a pretty exciting area. It continues to be very, very vibrant and it’s also bumping into certainly in our work, and I’m sure of many others with other kinds of new approaches such as machine learning being combined and big data in a way that’s really exciting.

Jakob: Fantastic. Thanks David. On that last point, I would like to actually just pick up a bit because machine learning and especially the overlap with AI is also something that we’re looking into with great curiosity at the Decision Lab. If I would ask you as a followup like specifically, what the BIT currently is looking at when it comes to applying or the overlap of behavioral science and machine learning, what comes to mind?

David: We ourselves have done and published, you may know a number of, if you like interventions, explorations using machine learning where some people have moved even inside the field, so people like [Sandra 00:08:04], who’ve gone in various in some of these issues. Then maybe because it’s a very empirical approach, people get drawn into it. We started using it in a number of ways. One is that of course you can use these massive data sets, including around people’s behaviors. Often we might of almost exhaust data, which turns out to be key and predictive. An example would be revisiting the original New York Bloomberg work, when trying to work out where to send your inspectors. What are the clues that telling you that a doctoral school might be not very good, and that you can use these clues and behavior and very large data sets to identify some of those issues. That’s a pretty important application.

David: It can be used on the individual level, which we’ve done some stuff. We’ve done work identifying cases or individuals, kids at risk where the system has wrongly marked them in retrospect, as mark for no further action where we should have done something more. One of the reasons why it also comes together, I should explain, I’ll just run with a medical example, is it’s all very well identifying the clinician that appears to be underperforming in some significant way. In other words, they’re missing diagnoses, et cetera. Well, at the same time, remember we’re very busy developing interventions. That’s a great deal of what we do including say for clinicians. We’ve done work for example with clinicians that are over prescribing antibiotics, or I just mentioned earlier the example of clinicians who might be under referring people who have symptoms that may well be cancer.

David: Well if you brought those two things together, that becomes very powerful. We can identify where there’s under-performance in a systematic way, but then we can do something about it. One of the holy grails there also, which is certainly active area is can you work out what intervention would work for who? It becomes much, much more tailored interventions to help support someone. For example, a disadvantaged student in college where everyone will make sure they get there, or when they get there, help them perform best or what intervention would be best for which students to make sure they get the best out of their educational experience and do best in life. You know what I mean? It might not be the same treatment for everyone and using these techniques enable us to do if you like precision interventions or [inaudible 00:10:42] might have talked about personalized defaults in some way.

Jakob: Right. Okay. That makes perfect sense. I think one thought that obviously pops into my mind, but we’ll get into that in one of the further questions is, the more you individualize interventions, the more potentially complex testing becomes. Right. Some of the organizations that we’ve been working with or hearing about, what they like about the behavioral science approach which often is that they can somewhat use it on scale and therefore use some type of cost effectiveness when it comes to testing that versus doing the individualized approach. Again, I’ll ask you a question on that a bit further down the line.

Jakob: I’d like to just shift gears to talk about the state of the industry. You’ve mentioned previously that one of the most important things where you actually didn’t mention it today, but we know that one of the most important things that the Behavior Insights Team have contributed to behavior science or applied behavioral science is a stronger emphasis on empiricism. While this is obviously something that can be very beneficial to organizations, it also comes with a lot of challenges, especially as more and more nuts and unit spawn, for lack of a better word. At times we hear especially from the private sector and that circles back to the point that I was just making that they don’t have the off needed luxury of time and budgets to conduct complex randomized controlled trials yet they still want to apply behavioral science in a sound, somewhat defendable manner.

Jakob: David, if I was going to ask you, what do you think are the biggest challenges for an organization looking to apply behavioral science in an empirical manner, and what’s your take on how this can be tackled?

David: Yes, so remember it’s not just businesses actually, but governments have the same challenge where sometimes there’s real urgency to act. You have to make a decision. It’s not good you’re saying, “Hmm, let’s think about it and run a whole lot of trials.” You do have to take a view and sometimes what you’re doing is you’re bordering on your history of previous interventions to say, “Well, if we have to take a part in this situation, we think this would be your best runner.” Both private sectoral and governments, one of the implications of this is we often talk about in terms of humility, human beings are complicated and they may operate along the model you think that they may not, and we should be empirical. If you’re going to try something, don’t just try one version of it, try multiple versions and see which is more effective.

David: Some parts of the commercial world, not least where it hits digital and AB formatting, it’s become very widespread, the use of experimentation in fact on an absolutely massive scale as you might know. In other areas, however, it’s not used at all. We’re actually changing in Britain, what’s called the Green Book, which is the Treasury book, which tells policymakers how they should go about appraising options and so on. It used to say, you should do your cost benefit analysis and then try the intervention. It would be a good idea afterwards to evaluate it. It’s now really, we’ve moved to a world where we’re saying, “No, I mean, run, wherever you can, run multiple versions.” It’s not as though a once off, it just never end, experimentation should never end. You build machinery practices that are designed to make it easy and low cost to experiment, in the same way that AB formatting will do that for a website, well, you should do that in many, many areas.

David: I’m going to give you a concrete example. One of our trials we’ve been very proud of in recent years we worked with top researchers at Harvard and others was this beautiful intervention group study supporter for young people where they are asked would they like to nominate two people who will be their study supporters? These people then receive information about what’s going on in school, and in college, and they might want to ask the young person, “Well, how do you find that vertical? Don’t forget to bring your calculator for the test or whatever.” The fantastic results increases attendance, and it increased the pass rate versus people who are going to retake by about 28% on the main trial, which we did. It’s a huge effect size and pretty cheap. That’s great. We could just leave it at that and say, that’s fantastic, but why would we do that?

David: We were also now running variations which is, what happens if the texts go to the individual rather than the study supporter, or which text is the best one to use? Or when would you use it? The challenge is not just for the development of the one off intervention, but it’s also designing a platform and a way of working in your organization to be able to perpetually tune, refine, innovate, try new things. That’s often been a very, that’s one of the biggest steps. Even if you go to the simplest example is like a firm trying to redesign it’s invoicing, or a government trying to sharpen up how it collects taxes.

David: In the early work, often with a big organization, it’s like, well, how would we even run a randomized control trial? We’re not set up to do that. You have to redesign the systems to make that possible, but once you’ve done that, then that’s really, you’re on a whole, you’re going somewhere, you’ve built an engine, essentially, an evidential engine to move forward.

Jakob: Right? I think that’s a pretty understandable and especially when we speak of policy change, when we speak scale, it’s understandable that this has to be tested as good as possible. Your point on why would you stop just at one test if you can then conduct variations that can improve things even further then it is almost obvious that you should be going further into testing, so that resonates well.

Jakob: David, I just want to share with you and I actually also ask you what your take is on the so called just dues. Just a brief example, when I was reading one of the interventions of behavior, what we call it behavioral audits actually in the Comoro Islands in East Africa, and this was about electricity bills and people not paying their bills. We went there and we did some behaviorly informed surveys, focus groups, shadowing exercises. We very quickly found out that there are very simple and almost obvious barriers. For example, people, they have to go to a payment station physically and there’s only one on the Island where they can pay their bill.

Jakob: There we figured out, well, it’s almost a no brainer that if we somewhat make, I don’t know, the bills come to them or if have some mobile payment system that that will improve at least the payment rates. Right? We didn’t, or the project leaders on this particular project didn’t even have any interest in conducting an RCT on this. It’s just something that they call, well, let’s just do it and see how it works. This is a simple example. It was in a pretty small scale project, but for people out there in the behavioral science world, what do you think of this just do it approach?

David: Well, look, I mean, I’ve been a policy maker also for a long time, and there are times when you do have to just do it. Right? It may seem obvious maybe to complicate your trial. There are many interventions or changes we’ve been involved in. Changing towards enrolment and pensions in the UK. Literally more than 10 million extra savers now as well as of course, similar things with 401k. We actually didn’t have an RCT at the beginning of that, although we had lots of evidence and as the data community is overwhelmingly obvious is being effective. On promoting the use of electronic cigarettes where we change the policy business to make them available on the basis that we think we’ve got addictive behavior, you want to introduce a less addictive alternative. There were lots of various bits of information which we were converging on, and we thought this being the right approach, but we didn’t, we would’ve loved to have done, run a pure RCT to check some of the assumptions.

David: That does happen sometimes, but there is one really important selling tree point, which is it’s worth bearing in mind and people like Ben Goldacre have made this argument, which is that sometimes it’s being considered so self evident that something, it’s a no brainer as you say. Of course, you should do the following, and in fact in medicine particularly sometimes is referred to as the parachute test, that it would be unethical to run a controlled trial because it’s so obvious that this thing is more effective. We are going to jump out of an airplane and say, “We’re going to see whether the parachutes are effective.” You can imagine, you and the even numbers will jump with a parachute and you and the odd numbers have no parachute, and we’ll find out what happens.

David: This is generally considered unethical. This is often used as a defence in a number of areas including in medicine, why certain trials shouldn’t be done. What is worth bearing in mind is there are now some very famous examples where people made that argument and when someone finally got around to doing a controlled trial, it turned out that the assumption was wrong. A very famous example has been after having a head injury that you should give a steroid injection, not particularly behavioral though, but I think it was considered unethical to do a trial because steroids would reduce swelling and so on and so on. It was self evident that was right.

David: Two RCTs done in recent years both show that giving steroids to people after head injuries makes them more likely to die. We do have to be serious about the humility. I mean, sometimes you can see before or after measures just seems so overwhelmingly obvious. Wherever we can, we should check and we should also check for other reasons, which is that do we understand what the active ingredient is? Quite often we’re in a situation where we’ll do some kitchen sink, where we’re actually going to try several things at once. Hopefully we say it works, but we’re actually not sure which was the active ingredient. I’m okay about that. That’s a good problem. It seems to me to have like, well, this thing seems to be working really well. Now let’s figure out which of these elements is the most important and then can we optimize it? I hope that’s a reasonable answer. Does that fit with your example?

Jakob: Absolutely David, thanks for that. I mean, if I hear it correctly, it sounds a bit like we really need to, I love the humility point. We need to keep in mind what the potential costs are, right, and what the potential health implications are and if it happens to be health. This is an area where it’s absolutely unimaginable to go ahead without any rigid testing. Maybe areas like the one I gave on the electricity are things that make it somewhat morally more defendable to look at what we call these more just do it.

Jakob: I put that out as a question, but that’s a perfect segue into the next question, which is more about ethics of behavioral science and nudges. As a nonprofit here, The Decision Lab, we’re particularly interested in the ethical dimensions of nudging. One compelling argument we’ve heard for why nudging is ethical or can be ethical is that choice architecture happens all the time whether we think about it or not? Therefore, it’s an ethical imperative to think more deeply and deliberately about how we’re doing this. That’s an very interesting view, but it brings up further ethical questions. If nudging gives you a tool to be more deliberate and empirical in the way you affect people’s decisions, how can we make sure that we do this in a way that is aligned with people’s interest as much as possible? Is the answer to create discourse and let people decide where to be nudged, or should we decide for them based on societal ideas such as you just said, being healthy and or being prepared for retirement? What’s your take on that Dave?

David: I think it’s incredibly interesting. Many of us have wrestled with this. Cass Sunstein of course this thought about it it’s a lot, and we do too. There are lots of levels to it. There are questions both about methods, literally experimentation and testing, which we touched on a bit. Then there are also questions about behavioral science and nudging. Let’s at least acknowledge the ones around either experimentation where some people think it’s or the ethical questions, that are right ethical principles such as everyone should be treated the same in many domains. I personally take a different view, which is it’s often unethical not to have tested. There’s is also a way, how the hell do you know if you’re doing harm or good? That’s a battle that continues to rage and many people don’t take it as self evident that it’s the right thing to do to experiment.

David: You’re also meaning in relation to call behavioral science too especially around choice architecture. It’s still a pretty good argument to run. Well, whether you like it or not, behavioral science is precipitating out. It’s crystallizing out choices. The canteen thing, we never quite thought about it before, but if it’s true that most of your plate is filled with the first three things you see in the canteen, and it really matters what you’ve chosen. You might not have thought about it before, but now it’s suddenly is a real choice and you have to take a view on it. That’s not trivial as to on what dimension you optimize. I think broadly, the North American response, the Cass, the Richard Thaler type answer tends to be, well, why don’t we try and set it before in a way that most people would think it was a sensible way of doing it, and that maybe you yourself would think that, but you still leave the choice in play.

David: That works to a point, but by no means, I think the end of the matter. At the very least, we know that people do make different choices in the moment than the choice they make on reflection. It’s in the famous Danish Worker Study when he won a competition and do you want chocolate or do you want a bowl of fruit? That people are weak and advanced to choose fruits. When the guy turns up and says, “I’m really sorry, this is terribly embarrassing. We’ve lost your form. What is it you wanted? The vast majority of people will flip from saying, fruit to now say actually it was chocolate. In a moment they’ve chosen chocolate, right?

David: Which was right and which was wrong even within ourselves is not a trivial matter and myself I think there’s another level beyond it, which is not just the choices that you make for yourself on reflection and then, or in the form of commitment devices. But collectively, what are the decisions we make as a society in or group when we talk to other people, which what’s the right way we should try, and set the defaults, the norms when we’re trying to encourage? For that, I mean, my view is there’s no escaping. We should use proper democratic mechanisms. In fact, we should go further than current democratic mechanisms in many areas where we should ask the public that this is an interesting dilemma. This is our shaping behavior. What do you think, how do you think we should set this? Should we remove chocolate from by the checkouts in supermarkets?

David: Well we could just make a view on that, but maybe we should get groups of customers and ask them, what do you think having shown you the evidence and how it changes your behavior? They might well come back and say, “Well, get rid of all of that,” or they might say, “Well, couldn’t you mark the isles and have guilt free isles and then have some, which are like, that’s where the chocolate is and you’re with your kids, you can choose one or the other.” My point about it is, I didn’t think you just handle these arguments with a very elegant ethical internal argument. You do need to engage the public directly and have them be involved in shaping this, as sometimes put, it really matters who is nudging the nudger and we need to have strong mechanisms both in government but actually also in relation to private sector players.

David: If you’re, if you’re a big social media giant and you’re making quite important decisions about choice architecture that’s affecting teenagers and lots of other people, how does the community get to express its view about setting the parameters and how long you’d be online or how you set the toggles. These are important questions, not just for governments but also for companies too.

Jakob: Right? Nudging the nudgers, I love that sentence. I’d like to just ask you a quick followup on this. Also the idea of testing or asking the people; Asking them for their decision on or their views on whether this is ethical or not ethical. I mean, one thing while you were speaking that came to mind is that nowadays you have these easily accessible crowd sourcing platforms like Amazon’s Mturk (Mechanical Turk) or others where you can quickly test across a pretty large sample sizes some ideas. I wonder, David, for you guys at BIT because one thing that I’ve heard from a friend that I’ve had discussions with who doesn’t know a whole lot about behavior science, but when he heard about the whole concept of nudging, he says, “Well, so is it, do you guys then to decide what the right behaviors are?” We just had that discussion that it’s not us.

Jakob: I guess what I wanted to ask you is that, first of all, do you guys already start using these kinds of methods to when you have an intervention idea to ask the general population for I guess on the average consensus, but then if you do so what are the potential payoffs, the trade offs because you can then probably argue that that potential sample size didn’t have access to the research that actually shows that the general public opinion is not the right one.

David: Yes, indeed. By the way, there’s a specific thing you mentioned in there which is to do with online testing versus, we ourselves have built a platform called Predictiv which we use to test certain things like terms and conditions so people understand is that they’re very good for things like comprehension. You were asking something slightly different, which is not just what’s the effect of this in prime one way or, but do you then ask people about to what extent do you think it’s right, it had this impact on your behavior? I go back to this point that we can ask people to be reflective about it, but there are so many choices in the world. We really all want to spend all our time deciding all of these things, setting toggles, setting switches, and either individually or do it collectively. And Cass in fact has made the argument in the US context sometimes an important principle is that people might decide not to decide, they just got better things to do in their life, which will be true in many domains.

David: Our house view has long been, where possible, and we would love to do it frankly more extensively, is you actually bring people together and you out that. We run a couple of deliberative forums and such as in Australia, where we’ve taken a sample of probably, I mean, I could give you, we do one on obesity for example where people are brought together, they were showing lots and lots of the evidence. They could then themselves choose which are the experts they wanted to hear from and they also heard from industry or from academic players and they were asked then to give a view, having heard all available science and the other aspects of industry view, what do they think would be the right policy to move forward?

David: Certainly they get to shape it or I love a more recent version we did, which I thought was totally fascinating, is in the world of social media where that caused massive effects in this massive testing being done by many commercial players who are hatching retention, and they’re feeding, advertising and so on. That’s all I’m saying, it’s right or wrong. We do that set has certain kinds of facts. We put together a group of teenagers and we got them really to talk about a combination of exposing them to various kinds of facts, and also learning from them about what they were doing in their behavior, and then involving them in essential design sprint to help co-produce or co-design what that could mean.

David: That can vary from what could they themselves just do, the decisions they would make around, if you’re spending the first hour of every day on Snapchat completing your streak, you know how do you feel about that? Can you take back control? Can you redesign products, what would it look like? What are the kind of leavers could be built into them that you as an individual user then could take control over? Also some of them are, as I said, not just individual choices, they’re collective choices. How would you wish to shape the character or social interaction on social media? That’s something which we have to decide together, not just as individuals.

David: Yes, my own view, I reckon that’s a long time. I’m quite a big believer in essentially forms of enhanced democratic deliberation that enable, I mean, frankly, not everybody, because we got better things to do in our lives, but samples of the public to walk that journey with us, hear different views and then let them make the decisions essentially. Let then give us permission if they think that to be right to make the change, put that, the power back into the hands of individual consumers, families, citizens to be able to shape the world, which in turn shapes them.

Jakob: Got it and that makes perfect sense. To shift gears David, I’d like to now just, I think a lot of our listeners are interested in, they’re fascinated, they’ve read books like Nudge Shunned and maybe your book Inside the Nudge Unit and others and they are now interested in how to have a career in behavioral science? I’d like to speak to you just a bit about what it takes to have a career in behavior science. Behavior science is an appealing career choice for many, especially those who want to sit at the intersection between various fields as well as between theory and application, but for that very reason also to it’s somewhat tough field to prepare well for. Many of our listeners have asked us how they can best prepare for the field. With that in mind, what skills do you think can apply to behavioral scientists will most likely need to have in the next 10 years? And how can they best prepare for that?

David: Yeah, it’s a great question. It is a very, very exciting, vibrant field. Then to some extent, of course it’s evolution of existing fields. I actually explain for our listeners that I myself am a recovering academic, you see sometimes said that I used to like that I’m tenured at Cambridge, so I’m an escapee. One of the frustrations with academia is that tends to put things into narrower disciplines. Because one of the reasons we underlined earlier on in the naming of the Behavioral Insights Team, what we’re going to call it behavioral economics, etc. Danny Kahneman know goes well you can’t call it behavior economics, why is the economist is getting all the credit, what about psychologists, anthropologists? A range of disciplines have things to add and one of the things I hope we’ll see and we already do start to see is that for students that today and the graduates is that there are offerings which are blended disciplines. You can do psychology and economics with anthropology.Why not have a bit of design in there as well, or how to be an entrepreneur?

David: There’s more blended approaches coming forward. There are certainly at least some institutions, and some masters in the world which are offering that combination. But the truth is quite often people have to do it for themselves, and for us in many units, we ended up trying to combine the teams by choosing different kinds of people, and bringing them together. The foundations of your question, what do you really need? I mean, you need passion and curiosity about human behavior. It’s not just very practical stuff. It’s also incredibly interesting to understand who we are, what’s the nature of human beings and our own behavioral decision making? But others so no psychology but more generally, what makes people tick, what is really driving their behavior? There is some kind of core knowledge about actually empirically know what drives behavior.

David: For us, we’re very much rooted this as in an empirical tradition. I guess you might try and do it in a different way, but for us that means understand methods, understand what a randomized control trial is and how a step wedge might be done or propensity score matching. These methods, things, particularly quantitative but also qualitative analysis, being able to analyze data. Data and those tools, they’re the key to the universe really. They can help us know what’s going on. Don’t shy away from those courses, those options in college, get into them, it’s just incredibly rich.

David: Of course the behavioral science which we use and probably you use is not just an academic matter, it’s also about applying it to real world issues. That’s not everyone’s cup of tea. Some people are just very interested just looking at the science and abstraction. For us in that sense, we’re engineers. We’re not pure and natural scientists where we’re trying to use these tools to really address problems in the world and have some impact. That’s very exciting I think, but it’s not for everyone. Yes, at least that trilogy, behavioral science is a cool, essentially empirical content we’ve got so far. The methods build up those methods, but also interest and curiosity, and exposing yourself to the real world challenges, the real world administrative systems, and are you interested in actually having an impact? That isn’t for everyone, as I think for me are incredibly exciting combination.

Jakob: Right. Thank you David. If I could just ask you, is it a fair statement to say that while assumptions and views depending on the academic field you’re stemming from may differ, there still needs to be an agreement on the methods that will test those assumptions in order to find some somewhat of a consensus within behavioral science?

David: Yes. I mean, there are in a crazy way, there are some emerging consensus, errors in frameworks so we use lots of different frameworks, but it’s just one of the core insights I think is that if you understand and think about what’s happening in a human brain let alone in the society, is there are just multiple influences. There are so many processes. In general, the scientific method is one based on humility, right? It’s acknowledging the extent of your ignorance and that some of the best scientists will say, “Everything they ever did got proved to be wrong.” But that’s okay. It’s just the hour glass reducing the time. It means that we should be embracing empiricism.

David: Again, Philip Tetlock’s hard work illustrates this very well. There are lots of people in the world and lots of pundits who have very confident, nice, elegant theories. I’ll give you a very strong view on something, often there are predictions around the pool as opposed to people who acknowledged the world and suddenly human beings being more complicated and they have doubt, they embrace doubt if we think it exists, but we’re not really sure. You are perpetually testing learning, and trying to evolve our approach and our understanding.

David: That seems to me, it should be true for any discipline, but for behavioral science it is especially true. If you’d like to create a different one, when I started my life many years ago as a natural scientist, whatever, and are a lot of physics feels like you start with the world looking incredibly complicated and then you are able to elucidate these underlying principles or laws which are at a simpler and cleaner in some ways be it through the major forces or quantum. Well, Psychology is almost the other way around. We start off thinking, oh, human behavior is not that complicated, but the more you dig into it even as simple perception tasks, you realize there are multiple processes that are running in parallel and it gets more and more complicated in some ways the more you dig. You better get used to or expect a lifetime of learning. You’re not going to just get that and say, “Oh, well that sorted, I understand at all.”

Jakob: Great, that makes a lot of sense. As we are now coming slowly towards the end of our podcast today, I would like to just ask you David a bit about your take on behavioral science, especially as it relates to the private sector. Let me ask you, the reason why I’m asking you this is because, as I think a lot of our listeners know, the applied behavioral science and nudging world really started in the public sector. I mean, your cabinet team was the first mover, but then quickly nudge units at public, multilateral such as the World Bank, the United Nations or other governments followed. Today I’d say a lot of governments employ at least one or two behavioral scientists, and nudging or applied behavioral economics. That shows that it seems to be best suited for effecting public policy.

Jakob: However, after observing the success of nudge units across governments, an increasing number of private sector companies have also followed suit with their own nudge units. I’ve shared with you an example of The Decision Lab working with some private sector players on building out their own nudge units and here at left and right people are saying this bank, this insurance company, they’re all interested in building on their own nudge units now. David, what’s your take on the private sector’s increased appetite in doing this applied behavioral science work for their businesses, but also given the ethical conversations we had earlier, and where do you see behavioral science evolve, especially in the private sectors in the years to come?

David: It’s an incredibly interesting question. I mean, frankly, whether you are in the private or public sector, you’re going to bump into this. Some I’m sure would say what we now call nudging and behavioral science, there are people in the private sector who would say, well, you can see examples of that going back to the 1930s. There are many industries, even if it wasn’t as overt which for a long time have used behavioral science, not always for good, you might argue. The gambling industry is very sophisticated in its use of behavior science, has been for some time. It’s been up against game for sure. Tversky and Kahneman’s original work, it’s about how people make risk judgments, so no surprise the gambling industry has got an interest in making you think, overestimate your chance of winning and feeling really good when you get near misses and not feel too bad when you lose in filling in all the blanks.

David: One of the issues that it definitely hits is what’s the ethics? If the ethics apply in relation and absolutely to where governments should or shouldn’t be nudging, they absolutely apply on the private sector side too. Often through market evolution if not overtly, industries have developed often quite sophisticated approaches in one way or another, you have cash backs will be simple examples that you know that you can offer a big cash back for your new printer, or your whatever it would be because most people will overestimate the chance that they will get around to doing the claim, claim the cashback. Models can be built on that basis, a way in which you sell a product. There’ll be lots of these issues which essentially use behavioral science.

David: I think one reason why governments, whether they want to or not regulate stuff pooled into this area, is to try and police and work out what are the parameters of acceptable nudging inside the private sector. In essence, like any form of knowledge or technology, behavioral science can be used for good or for bad in same way that biochemical technologies can be used to make amazing new precision medicines, they can also be used to make neurological agents to kill people. You can use behavioral science to really help people save more and live more healthy lives and so on but you can also use them in order to scam people and take advantage and sell financial products that people don’t really need. Cialdini’s work of course was a beautiful earlier illustration of those sorts of abusive practices as much as good practices. We will need to be aware of that possibility, and partly the role of government and regulators is to set the parameters to make sure that stuff isn’t used and abused. Citizens themselves of course can learn to recognize abusive practice and adapt and learn as well.

David: BIT we are generally by design, you may know we’re actually at a social purpose company ourselves these days and by our limitation we don’t allow to just do work unless there’s social impacts to it. Well functioning markets are also a part of the story, indeed just the way I conclude on that is some of the most interesting problems and puzzles in behavioral science are the interface between public sector and private sector operations. Designing markets that need that good companies and good products really come to the fore and grow. Right? What does that look like? How do you design two-way platforms that have the right characteristics that support innovation and growth? Do such platforms can either be built by governments or indeed, sometimes by private sector players themselves.

David: It’s incredibly interesting and important sets of questions this, and it’s funny people often are more familiar with asking about the ethics of nudging governments, but whether we like it or not, citizens are being nudged day in, day out by all kinds of players on both commercial side as well as the public sector side and indeed frankly by our friends and our relatives and lots of other people too. It’s part of life, and it’s my hope for many of us to try and use this technology, this knowledge for good in the world as opposed to for bad.

Jakob: Fantastic. A quick follow up, one thought that we have been thinking through is, is there a time potentially coming to have some type of global ethics body on nudging? I’d be very curious to hear your thoughts on this. I mean, I think we’re going to can agree that whether it’s in finance and law and in any of these larger fields, and it’s a process that keeps on being improved constantly. There are some type of governing bodies, ethical institutes that try to somehow influence the ethical aspects of these fields. Nudging or behavior science in itself as it is now being applied, it’s in that sense of relatively new field I think that’s fair to say. What is your take on this idea that maybe people would feel more relaxed about the ethical question and implication of applied behavioral science if they knew there was a neutral, third party type of ethical governing a body overlooking this?

David: I mean, are you asking an empirical question, which I’m not just on the specifics of the client whether that’s true. I mean, if you think of George Loewenstein’s work on privacy and so on, sometimes when you reveal the people like, oh, there’s something else you should worry about, don’t worry there’s a body who is going to sort it out. Actually that’s support which say stop worrying. Anyway, that isn’t just to say it’s still the right thing to do.

David: Maybe, I definitely think there’s something we have to think about whether it’s unique to nudging behavioral science or not. I have a question mark. I would say very similar questions apply say around machine learning and the use of algorithms is that in the behavioral science nudging bucket, I mean, it overlaps with it, but it’s definitely not the same. These are experimentation in relation to pharmaceutical practice. That’s an area where there’s been evolving regulatory practice over a long period of time.

David: Experimentation in general let alone behavioral science, has raised some question. Yeah, should it be? Yes, I think so. Certainly within disciplines you would hope within industries, sometimes governments themselves will set those parameters and in the end I think, well, who sets the rules and I go back to my phrase earlier, who nudges the nudgers? It is important that in any domain that you have divisions of power and responsibility and that no one is completely sovereign, everyone should answer to someone else. I think it is important and my own view is that governments and indeed industries will have to strike in their governance arrangements. They should do so around these kinds of practices where their customers or citizens are more able to shape and determine them.

David: That’s not a view which everyone agrees with. In Britain at the moment we’re having some interesting constitutional issues raised by the contrast between a referendum and the parliament having a different view potentially. My view is we should have many places, a third chamber, which is a sample of the public who come together and take on particularly around lifestyle choices and decisions, where they help to shape and choose what they would be like. I guess what I’m saying is that one of the mechanisms which you start to see evolve is, yeah, people should publish practicals ideally, and sometimes you’ll have some ethical boards like you’d see in the academic world to say, “Is it okay to do this or is it not?” Remember we do sometimes turn to our democratic structures to do some of that, but it’s not just a deeper set of questions. Yeah, it will be great to see more of that. It’s just not limited to nudging, there’s lots of other things we do too.

Jakob: It makes sense David. We’re coming towards the end of the chat, and we would like to ask you what short or longterm future you envision? I think a lot of listeners are curious, what do you envision for the Behavior Insights Team and what types of projects your team is most excited about in the coming years?

David: Yeah, so that’s fair enough. I think the things which are the most exciting, and that probably BIT research team is, one of our roles as we often help other governments and other bodies, sometimes private sector nowadays to build these capacities. Partly our role is also to keep pushing what’s the frontier. There’s a lot to be said in just to scaling these approaches. I’ve often said and I serve ministers in Britain has what’s called National Advisor and Networks, which is to take that empiricism and try, and figure out what’s the best way of teaching kids? What’s the best way of reducing crime? That’s not just a behavioral matter. I’m a great champion of this. Other countries like Canada or Australia are also coming on board about that.

David: I think that’s very exciting. I sometimes think that history will say the most important thing that BIT did for the world is it actually helped to push that empiricism regardless of behavioral science. Within diverse science itself, and boy, the world there’s no shortage of great challenges. I think for ourselves, I think with many colleagues across the world, we’re starting to move. Yes, let’s carry on doing the nuts and bolts issues like getting people pay their tax on time will save more or to turn down their thermostats, but it’s also moving onto some of the really big wicked issues, obesity, improving the functions of economy. I do think one of the ironies about behavioral economics specifically is that it at least apply to economics where there are lots of behavioral based market failures, and I think it has a lot of quite profound implications for economic policy that haven’t been thought through that we think about them.

David: There’s a lot of issues to do with the flesh and blood of humanity that get expressed as wars, I mean two wars every year starting. We’re really into, well, what can you do to use behavioral science to stop conflicts and to reduce the reignition of previous conflicts which is very exciting. Social mobility will be another grey area and one of those great deep issues. What can we do to help in multiple aspects of the subtle forces that are holding back some of our kids be it in terms of their early years, there are 30 million world problem, or how can you get parents to engage more early on and mesh with their kids through to the essential life skills that we should be nurturing in young people right through to social capital and network effects or saving. How can we use Fintech to support rainy day saving and will the consequence be as great as we think they might be?

David: It’s a fairly exciting, vibrant time to be engaged in this for people and very early on their careers to think about what to do and have to think our kids will look back and just think, what the hell did you use to do guys? You used to try and figure out the world using these very, very strange models of human behavior, which were very unrealistic, and you never tested things either. No wonder that the world was such a mess. I do think, and I think some of those exciting stuff going on right now is and going forward are these very big challenges and trying to measure ourselves and take on some of these very big human challenges and see if we can do something about them. Why not? Hey, we might as well give it a try.

Jakob: Got it. So I think the good news from if I heard you correctly, is that we’re not going to run out of work anytime soon in the fields. It looks like there’s plenty of areas where behavioral science can be of value add.

David: Yeah, indeed maybe just a concluding comment is that one of the telltale signs we’ll know if we’re successful is because we weren’t really separated it as behavioral science anymore. You know what I mean? Empiricism won’t be “oh we do experiments”. That’s just how you should do public administration. That’s how you should run things. Companies will just have this built into them, governments will have it built into them and in the same way we don’t really talk about digital or technology separate. We’ll get to that point, but we’re not there yet, that’s for sure.

Jakob: Got it. Well, fantastic David. I want to thank you for all your insights that you’ve shared with us today. Is there anything else you would like to let the audience know before we wrap up?

David: No, I think it’s fantastic there are people interested in this area as it sits. I think we know enough to know it’s a very, very powerful tool. It’s nearly a decade that the Behavioral Insights Team has been running in the UK and helping other countries now. Bring it on, come all, come when the war is won, and also probably let’s not lose our fascination with it. It’s also about who we are as human beings and the nature of our society. It’s an incredibly intellectually interesting journey that we’re all on together to understand who we are and what makes ourselves tick. Not only is it practical, but it’s also interesting and we should try and hold on to behavioral insights at home.

Jakob: Great. Personally, humility, nudging the nudgers and let’s not lose our fascination with it are the three big takeaways I’m taking away. I want to thank you so much David for your time today and I wish you, and the whole BIT all the best for 2019 and beyond. Thank you.

David: Thanks so much. Yeah.

Jakob: Bye.

We want to hear from you! If you are enjoying these podcasts, please let us know. Email our editor with your comments, suggestions, recommendations, and thoughts about the discussion.