A person holds a smartphone in their left hand and grips a car steering wheel with their right hand, with a dashboard displaying speed and controls in the background.

Freeing Cognitive "Bottleneck Congestion" in Autonomous Vehicles

read time - icon

0 min read

Jun 05, 2018

In March 2018, Tesla’s second fatal crash involving its autopilot self-steering system happened on highway 101 in Mountain View, California (The Guardian Staff 2018). Collision reports showed that the driver, Apple software engineer Wei Huang, had received both visual and auditory cues from the self-steering system prior to his vehicle crashing into a concrete median, which tragically killed him. Apparently, Huang had 150 meters of the median in view, or five seconds to react and avoid the barrier if he had been paying full attention to the situation at hand.

Although autonomous vehicle systems have saved more lives than shed (Marshall 2017), should we expect more incidents like these to occur during their continued production? What is more, does the fact that accidents still occur in autonomous self-steering systems (which are designed to improve driver safety) necessitate a deeper investigation into the relationship between hazard perception, automated cues, and multi-tasking?

Although they represent an important part of technological advancement, autonomous vehicles still  introduce disturbances for drivers, who may otherwise view them as a way to kick back and direct their attention elsewhere. Putting such trust into driver assistance design can introduce drivers to a dangerous amount of risk, instead of making driving easier and safer. According to behavioral science, this increased capacity to multitask behind the wheel may bring further problems for other drivers and road safety in general, as studies show that our cognitive decision-making systems aren’t as sophisticated as we may think.

To mitigate these risks, the autonomous vehicle industry may benefit from these behavioral science insights, and uncover more about the driver’s cognitive architecture and decision-making processes. By understanding when, where, and how drivers most optimally multitask, the industry can help design policies and technological interventions that enhance synchrony in the autonomous transportation realm.

References

Beattie, David, Lynne Baillie, and Martin Halvey. 2017. “Exploring How Drivers Perceive Spatial Earcons in Automated Vehicles.” Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1 (3): 36:1–36:24. https://doi.org/10.1145/3130901.

Broeker, Laura, Andrea Kiesel, Stefanie Aufschnaiter, Harald E. Ewolds, Robert Gaschler, Hilde Haider, Stefan Künzell, et al. 2017. “Why Prediction Matters in Multitasking and How Predictability Can Improve It.” Frontiers in Psychology 8. https://doi.org/10.3389/fpsyg.2017.02021.

Ernst, Marc O. 2006. “A Bayesian View on Multimodal Cue Integration.” Perception 131 (Chapter 6). https://pub.uni-bielefeld.de/publication/2355548.

Fagerlonn, J., and H. Alm. 2010. “Auditory Signs to Support Traffic Awareness.” IET Intelligent Transport Systems 4 (4): 262–69. https://doi.org/10.1049/iet-its.2009.0144.

Fischer, Rico, and Franziska Plessow. 2015. “Efficient Multitasking: Parallel versus Serial Processing of Multiple Tasks.” Frontiers in Psychology 6. https://doi.org/10.3389/fpsyg.2015.01366.

Heiden, Remo M.A. van der, Shamsi T. Iqbal, and Christian P. Janssen. 2017. “Priming Drivers Before Handover in Semi-Autonomous Cars.” In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, 392–404. CHI ’17. New York, NY, USA: ACM. https://doi.org/10.1145/3025453.3025507.

Ho, Cristy, Nick Reed, and Charles Spence. 2006. “Assessing the Effectiveness of ‘Intuitive’ Vibrotactile Warning Signals in Preventing Front-to-Rear-End Collisions in a Driving Simulator.” Accident Analysis & Prevention 38 (5): 988–96. https://doi.org/10.1016/j.aap.2006.04.002.

Ho, Cristy, Nick Reed, and Charles Spence. 2007. “Multisensory In-Car Warning Signals for Collision Avoidance.” Human Factors 49 (6): 1107–14. https://doi.org/10.1518/001872007X249965.

Ho, Cristy, and Charles Spence. 2005. “Assessing the Effectiveness of Various Auditory Cues in Capturing a Driver’s Visual Attention.” Journal of Experimental Psychology. Applied 11 (3): 157–74. https://doi.org/10.1037/1076-898X.11.3.157.

Ho, Dr Cristy, and Professor Charles Spence. 2012. The Multisensory Driver: Implications for Ergonomic Car Interface Design. Ashgate Publishing, Ltd.

Hommel, B. 1998. “Automatic Stimulus-Response Translation in Dual-Task Performance.” Journal of Experimental Psychology. Human Perception and Performance 24 (5): 1368–84.

Knowles, W. B. 1963. “Operator Loading Tasks.” Human Factors 5 (April): 155–61. https://doi.org/10.1177/001872086300500206.

Lee, Yi-Ching, John D. Lee, and Linda Ng Boyle. 2009. “The Interaction of Cognitive Load and Attention-Directing Cues in Driving.” Human Factors 51 (3): 271–80. https://doi.org/10.1177/0018720809337814.

Levy, Jonathan, Harold Pashler, and Erwin Boer. 2006. “Central Interference in Driving: Is There Any Stopping the Psychological Refractory Period?” Psychological Science 17 (3): 228–35. https://doi.org/10.1111/j.1467-9280.2006.01690.x.

Marshall, Aarian. 2017. “Wanna Save Lots of Lives? Put (Imperfect) Self-Driving Cars on the Road, ASAP.” WIRED. November 7, 2017. https://www.wired.com/story/self-driving-cars-rand-report/.

Merat, Natasha, and A Jamson. 2017. “How Do Drivers Behave in a Highly Automated Car?” In , 514–21. https://doi.org/10.17077/drivingassessment.1365.

Radlmayr, Jonas, Christian Gold, Lutz Lorenz, Mehdi Farid, and Klaus Bengler. 2014. “How Traffic Situations and Non-Driving Related Tasks Affect the Take-Over Quality in Highly Automated Driving.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting 58 (1): 2063–67. https://doi.org/10.1177/1541931214581434.

Sage, Alexandria, and Paul Lienert. 2016. “Ford Plans Self-Driving Car for Ride Share Fleets in 2021.” Reuters, August 17, 2016. https://www.reuters.com/article/us-ford-autonomous/ford-baidu-co-invest-in-autonomous-tech-firm-velodyne-idUSKCN10R1G1.

Schoettle, Brandon, and Michael Sivak. 2014. “A Survey of Public Opinion about Autonomous and Self-Driving Vehicles in the U.S., the U.K., and Australia.” Public Opinion, Survey. Ann Arbor, Michigan: University of Michigan. https://deepblue.lib.umich.edu/handle/2027.42/108384.

Shepardson, David. 2017. “Tesla, Others Seek Ways to Ensure Drivers Keep Their Hands on the Wheel.” Reuters, June 24, 2017. https://www.reuters.com/article/us-usa-autos-selfdriving-safety/tesla-others-seek-ways-to-ensure-drivers-keep-their-hands-on-the-wheel-idUSKBN19E1ZA.

Steenken, Rike, Lars Weber, Hans Colonius, and Adele Diederich. 2014. “Designing Driver Assistance Systems with Crossmodal Signals: Multisensory Integration Rules for Saccadic Reaction Times Apply.” PLoS ONE 9 (5). https://doi.org/10.1371/journal.pone.0092666.

Strand, Niklas, Josef Nilsson, I. C. MariAnne Karlsson, and Lena Nilsson. 2014. “Semi-Automated versus Highly Automated Driving in Critical Situations Caused by Automation Failures.” Transportation Research Part F: Traffic Psychology and Behavior, Vehicle Automation and Driver Behavior, 27 (November): 218–28. https://doi.org/10.1016/j.trf.2014.04.005.

Talsma, Durk, Daniel Senkowski, Salvador Soto-Faraco, and Marty G. Woldorff. 2010. “The Multifaceted Interplay between Attention and Multisensory Integration.” Trends in Cognitive Sciences 14 (9): 400–410. https://doi.org/10.1016/j.tics.2010.06.008.

The Guardian Staff. 2018. “Tesla Car That Crashed and Killed Driver Was Running on Autopilot, Firm Says.” The Guardian, March 31, 2018, International Edition edition. https://www.theguardian.com/technology/2018/mar/31/tesla-car-crash-autopilot-mountain-view.

Welford, A. T. 1952. “The ‘Psychological Refractory Period’ and the Timing of High-Speed Performance—a Review and a Theory.” British Journal of Psychology. General Section 43 (1): 2–19. https://doi.org/10.1111/j.2044-8295.1952.tb00322.x.

Wickens, Christopher D. 2002. “Multiple Resources and Performance Prediction.” Theoretical Issues in Ergonomics Science 3 (2): 159–77. https://doi.org/10.1080/14639220210123806.

About the Author

Smiling person wearing a beanie and a leather jacket, standing in front of shelves filled with books in a dimly lit room.

Hanna Haponenko

McMaster University

Hanna obtained her undergraduate degree in Health Sciences before branching off to focus on cognition and perception, and is currently a PhD candidate in Cognitive Psychology at McMaster University. Her current research endeavours involve coding a driving simulator to test the effectiveness of cues while multitasking.

About us

We are the leading applied research & innovation consultancy

Our insights are leveraged by the most ambitious organizations

Image

I was blown away with their application and translation of behavioral science into practice. They took a very complex ecosystem and created a series of interventions using an innovative mix of the latest research and creative client co-creation. I was so impressed at the final product they created, which was hugely comprehensive despite the large scope of the client being of the world's most far-reaching and best known consumer brands. I'm excited to see what we can create together in the future.

Heather McKee

BEHAVIORAL SCIENTIST

GLOBAL COFFEEHOUSE CHAIN PROJECT

OUR CLIENT SUCCESS

$0M

Annual Revenue Increase

By launching a behavioral science practice at the core of the organization, we helped one of the largest insurers in North America realize $30M increase in annual revenue.

0%

Increase in Monthly Users

By redesigning North America's first national digital platform for mental health, we achieved a 52% lift in monthly users and an 83% improvement on clinical assessment.

0%

Reduction In Design Time

By designing a new process and getting buy-in from the C-Suite team, we helped one of the largest smartphone manufacturers in the world reduce software design time by 75%.

0%

Reduction in Client Drop-Off

By implementing targeted nudges based on proactive interventions, we reduced drop-off rates for 450,000 clients belonging to USA's oldest debt consolidation organizations by 46%

Read Next

Notes illustration

Eager to learn about how behavioral science can help your organization?