Conversational agents in healthcare: a systematic review
- PMID:30010941
- PMCID: PMC6118869
- DOI: 10.1093/jamia/ocy072
Conversational agents in healthcare: a systematic review
Abstract
Objective: Our objective was to review the characteristics, current applications, and evaluation measures of conversational agents with unconstrained natural language input capabilities used for health-related purposes.
Methods: We searched PubMed, Embase, CINAHL, PsycInfo, and ACM Digital using a predefined search strategy. Studies were included if they focused on consumers or healthcare professionals; involved a conversational agent using any unconstrained natural language input; and reported evaluation measures resulting from user interaction with the system. Studies were screened by independent reviewers and Cohen's kappa measured inter-coder agreement.
Results: The database search retrieved 1513 citations; 17 articles (14 different conversational agents) met the inclusion criteria. Dialogue management strategies were mostly finite-state and frame-based (6 and 7 conversational agents, respectively); agent-based strategies were present in one type of system. Two studies were randomized controlled trials (RCTs), 1 was cross-sectional, and the remaining were quasi-experimental. Half of the conversational agents supported consumers with health tasks such as self-care. The only RCT evaluating the efficacy of a conversational agent found a significant effect in reducing depression symptoms (effect size d = 0.44, p = .04). Patient safety was rarely evaluated in the included studies.
Conclusions: The use of conversational agents with unconstrained natural language input capabilities for health-related purposes is an emerging field of research, where the few published studies were mainly quasi-experimental, and rarely evaluated efficacy or safety. Future studies would benefit from more robust experimental designs and standardized reporting.
Protocol registration: The protocol for this systematic review is registered at PROSPERO with the number CRD42017065917.
Figures


Similar articles
- Artificial Intelligence-Based Conversational Agents for Chronic Conditions: Systematic Literature Review.Schachner T, Keller R, V Wangenheim F.Schachner T, et al.J Med Internet Res. 2020 Sep 14;22(9):e20701. doi: 10.2196/20701.J Med Internet Res. 2020.PMID:32924957Free PMC article.
- A Systematic Review on Healthcare Artificial Intelligent Conversational Agents for Chronic Conditions.Bin Sawad A, Narayan B, Alnefaie A, Maqbool A, Mckie I, Smith J, Yuksel B, Puthal D, Prasad M, Kocaballi AB.Bin Sawad A, et al.Sensors (Basel). 2022 Mar 29;22(7):2625. doi: 10.3390/s22072625.Sensors (Basel). 2022.PMID:35408238Free PMC article.Review.
- The Personalization of Conversational Agents in Health Care: Systematic Review.Kocaballi AB, Berkovsky S, Quiroz JC, Laranjo L, Tong HL, Rezazadegan D, Briatore A, Coiera E.Kocaballi AB, et al.J Med Internet Res. 2019 Nov 7;21(11):e15360. doi: 10.2196/15360.J Med Internet Res. 2019.PMID:31697237Free PMC article.Review.
- The Effectiveness of Artificial Intelligence Conversational Agents in Health Care: Systematic Review.Milne-Ives M, de Cock C, Lim E, Shehadeh MH, de Pennington N, Mole G, Normando E, Meinert E.Milne-Ives M, et al.J Med Internet Res. 2020 Oct 22;22(10):e20346. doi: 10.2196/20346.J Med Internet Res. 2020.PMID:33090118Free PMC article.
- Promoting Physical Activity Through Conversational Agents: Mixed Methods Systematic Review.Luo TC, Aguilera A, Lyles CR, Figueroa CA.Luo TC, et al.J Med Internet Res. 2021 Sep 14;23(9):e25486. doi: 10.2196/25486.J Med Internet Res. 2021.PMID:34519653Free PMC article.
Cited by
- Chatbots to Support People With Dementia and Their Caregivers: Systematic Review of Functions and Quality.Ruggiano N, Brown EL, Roberts L, Framil Suarez CV, Luo Y, Hao Z, Hristidis V.Ruggiano N, et al.J Med Internet Res. 2021 Jun 3;23(6):e25006. doi: 10.2196/25006.J Med Internet Res. 2021.PMID:34081019Free PMC article.
- Voice-Controlled Intelligent Personal Assistants in Health Care: International Delphi Study.Ermolina A, Tiberius V.Ermolina A, et al.J Med Internet Res. 2021 Apr 9;23(4):e25312. doi: 10.2196/25312.J Med Internet Res. 2021.PMID:33835032Free PMC article.
- A Therapeutic Relational Agent for Reducing Problematic Substance Use (Woebot): Development and Usability Study.Prochaska JJ, Vogel EA, Chieng A, Kendra M, Baiocchi M, Pajarito S, Robinson A.Prochaska JJ, et al.J Med Internet Res. 2021 Mar 23;23(3):e24850. doi: 10.2196/24850.J Med Internet Res. 2021.PMID:33755028Free PMC article.Clinical Trial.
- Effectiveness of Telephysiotherapy in Improving Older Adults' Physical and Psychological Outcomes: A Systematic Review and Meta-Analysis.Man SS, Wen H, Chiu KT, Wang F, Chan HS.Man SS, et al.Healthcare (Basel). 2024 Sep 5;12(17):1775. doi: 10.3390/healthcare12171775.Healthcare (Basel). 2024.PMID:39273801Free PMC article.Review.
- Developing and Sustaining an Effective and Resilient Oncology Careforce: Opportunities for Action.Takvorian SU, Balogh E, Nass S, Valentin VL, Hoffman-Hogg L, Oyer RA, Carlson RW, Meropol NJ, Sheldon LK, Shulman LN.Takvorian SU, et al.J Natl Cancer Inst. 2020 Jul 1;112(7):663-670. doi: 10.1093/jnci/djz239.J Natl Cancer Inst. 2020.PMID:31868912Free PMC article.
References
- McTear M, Callejas Z, Griol D.. The Conversational Interface: Talking to Smart Devices. Springer; 2016.
- Weizenbaum J. ELIZA—a computer program for the study of natural language communication between man and machine. Commun ACM 1966; 91: 36–45.
- Bickmore TW, Silliman RA, Nelson K, et al. A randomized controlled trial of an automated exercise coach for older adults. J Am Geriatr Soc 2013; 6110: 1676–83. - PubMed
Publication types
MeSH terms
Related information
LinkOut - more resources
Full Text Sources
Other Literature Sources
Miscellaneous