The potential and pitfalls of AI in healthcare
Artificial intelligence (AI) is making waves in all kinds of sectors, and healthcare is no exception. The use of algorithms and chatbots in medicine holds immense promise, from easing the burden on healthcare workers to improving patient outcomes and accessibility. However, the path to fully realizing this potential is paved with serious equity considerations that cannot be ignored. This piece delves into both the promise and the challenges of AI in healthcare, underscoring the importance of ethical and equitable implementation.
References
- Scheinker, D., & Bohn, R. E. (2022). Improving Healthcare Productivity by Using Technology Strategically. Health Management, Policy, and Innovation. https://hmpi.org/2022/10/07/improving-healthcare-productivity-by-using-technology-strategically/
- Agatstein, K. (2023, December). Chart Review Is Dead; long live chart review: How artificial intelligence will make human review of medical records obsolete, One day. Population health management. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10698762/
- The benefits of AI in Healthcare. IBM. (2023, July 11). https://www.ibm.com/blog/the-benefits-of-ai-in-healthcare/
- AI for Health Care: Concepts and Applications. Harvard. (n.d.). https://www.hsph.harvard.edu/ecpe/programs/ai-for-health-care-concepts-and-applications/?gclid=cjwkcajwx46tbhbheiwara_djpivzt43u3rvveax4p7j3gjz4rknn-99z-4adr_3cniltlqubnkrdbocqi0qavd_bwe
- Young, L. (2021, September 30). AI can predict cancer risk through mammograms. University of Hawaiʻi at Mānoa. https://manoa.hawaii.edu/news/article.php?aId=11568
- Komorowski, M., Celi, L. A., Badawi, O., Gordon, A. C., & Faisal, A. A. (2018, October 22). The Artificial Intelligence Clinician learns optimal treatment strategies for sepsis in intensive care. Nature News. https://www.nature.com/articles/s41591-018-0213-5
- Potts, C., Ennis, E., Bond, R. B., Mulvenna, M. D., McTear, M. F., Boyd, K., Broderick, T., Malcolm, M., Kuosmanen, L., Nieminen, H., Vartiainen, A. K., Kostenius, C., Cahill, B., Vakaloudis, A., McConvey, G., & O’Neill, S. (2021). Chatbots to support mental wellbeing of people living in rural areas: Can user groups contribute to co-design?. Journal of technology in behavioral science. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8450556/
- Benavides-Vaello, S., Strode, A., & Sheeran, B. C. (2013, January). Using technology in the delivery of Mental Health and Substance Abuse Treatment in rural communities: A Review. The journal of behavioral health services & research. https://pubmed.ncbi.nlm.nih.gov/23093443/
- Habicht, J., Viswanathan, S., Carrington, B., Hauser, T. U., Harper, R., & Rollwage, M. (2024, February 5). Closing the accessibility gap to mental health treatment with a personalized self-referral chatbot. Nature News. https://www.nature.com/articles/s41591-023-02766-x
- Branley-Bell, D., Brown, R., Coventry, L., & Sillence, E. (2023, September 11). Chatbots for embarrassing and stigmatizing conditions: Could chatbots encourage users to seek medical advice?. Frontiers. https://www.frontiersin.org/articles/10.3389/fcomm.2023.1275127/full
- Cutler, D. M. (2023, July 6). What artificial intelligence means for health care. JAMA Health Forum. https://jamanetwork.com/journals/jama-health-forum/fullarticle/2807176
- Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019, October). Dissecting racial bias in an algorithm used to manage the health of populations | science. Science. https://www.science.org/doi/10.1126/science.aax2342
- Seyyed-Kalantari, L., Zhang, H., McDermott, M. B. A., Chen, I. Y., & Ghassemi, M. (2021, December). Underdiagnosis bias of artificial intelligence algorithms applied to chest radiographs in under-served patient populations. Nature medicine. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8674135/
- Benjamin, R. (2025, October 25). Assessing risk, automating racism. Science. https://www.science.org/doi/10.1126/science.aaz3873
- McCoy, L. G., Banja, J. D., Ghassemi, M., & Celi, L. A. (2020, November). Ensuring machine learning for healthcare works for all. BMJ health & care informatics. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7689076/
- Ledford, H. (2019, October 24). Millions of black people affected by racial bias in health-care algorithms. Nature News. https://www.nature.com/articles/d41586-019-03228-6
- M;, C. I. P. (2019, February). Can ai help reduce disparities in general medical and Mental Health Care?. AMA journal of ethics. https://pubmed.ncbi.nlm.nih.gov/30794127/
- Igoe, K. J. (2021, March 12). Algorithmic bias in health care exacerbates social inequities - how to prevent it. Harvard. https://www.hsph.harvard.edu/ecpe/how-to-prevent-algorithmic-bias-in-health-care/
- Zucker, I., & Prendergast, B. J. (2020, June 5). Sex differences in pharmacokinetics predict adverse drug reactions in women. Biology of sex differences. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7275616/
- Frank, E., & Olaoye, G. O. (2024, February). Privacy and data protection in AI-enabled healthcare systems. Research Gate. https://www.researchgate.net/publication/378287462_Privacy_and_data_protection_in_AI-enabled_healthcare_systems
- Carlos, J., & Demil, G. (n.d.). How do you measure AI accuracy?. LinkedIn. https://www.linkedin.com/advice/3/how-do-you-measure-ai-accuracy-skills-information-technology
- Wawira Gichoya, J., McCoy, L. G., Celi, L. A., & Ghassemi, M. (2021, April). Equity in essence: A call for operationalising fairness in machine learning for Healthcare. BMJ health & care informatics. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8733939/
- Murdoch, B. (2021, September 15). Privacy and artificial intelligence: Challenges for protecting health information in a new era - BMC medical ethics. BioMed Central. https://bmcmedethics.biomedcentral.com/articles/10.1186/s12910-021-00687-3
- World Health Organization. (2021). Ethics and governance of Artificial Intelligence for Health. World Health Organization. https://www.who.int/publications/i/item/9789240029200
- NHS. (2019, October). Artificial Intelligence: How to get it right. NHS England. https://transform.england.nhs.uk/media/documents/NHSX_AI_report.pdf
About the Author
Sophie Cleff
Sophie is an Associate at The Decision Lab. She holds a Bachelor of Science in Microbiology and Immunology from McGill University. She is passionate about applying her research background to interdisciplinary problems, especially related to public health. Before joining The Decision Lab, Sophie worked with the Montreal Children’s Hospital and Translating Emergency Knowledge for Kids (TREKK) to increase the quality, safety, and integrity of research in pediatric medicine. In her free time, she enjoys crocheting and playing the guitar.
About us
We are the leading applied research & innovation consultancy
Our insights are leveraged by the most ambitious organizations
“
I was blown away with their application and translation of behavioral science into practice. They took a very complex ecosystem and created a series of interventions using an innovative mix of the latest research and creative client co-creation. I was so impressed at the final product they created, which was hugely comprehensive despite the large scope of the client being of the world's most far-reaching and best known consumer brands. I'm excited to see what we can create together in the future.
Heather McKee
BEHAVIORAL SCIENTIST
GLOBAL COFFEEHOUSE CHAIN PROJECT
OUR CLIENT SUCCESS
$0M
Annual Revenue Increase
By launching a behavioral science practice at the core of the organization, we helped one of the largest insurers in North America realize $30M increase in annual revenue.
0%
Increase in Monthly Users
By redesigning North America's first national digital platform for mental health, we achieved a 52% lift in monthly users and an 83% improvement on clinical assessment.
0%
Reduction In Design Time
By designing a new process and getting buy-in from the C-Suite team, we helped one of the largest smartphone manufacturers in the world reduce software design time by 75%.
0%
Reduction in Client Drop-Off
By implementing targeted nudges based on proactive interventions, we reduced drop-off rates for 450,000 clients belonging to USA's oldest debt consolidation organizations by 46%
