Accessibility settings

This paper is in the following e-collection/theme issue:

Applications of AI (396) Reviews in Digital Mental Health (313) Chatbots and Conversational Agents (815) Artificial Intelligence (2488)

Published on in Vol 4 (2025)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/69006, first published .
Person using ChatGPT on a laptop, showing the AI chatbot interface with examples and capabilities.

Standardizing and Scaffolding Health Care AI-Chatbot Evaluation: Systematic Review

Standardizing and Scaffolding Health Care AI-Chatbot Evaluation: Systematic Review

Authors of this article:

Yining Hua1 Author Orcid Image ;   Winna Xia2 Author Orcid Image ;   David Bates3 Author Orcid Image ;   George Luke Hartstein4 Author Orcid Image ;   Hyungjin Tom Kim5 Author Orcid Image ;   Michael Li1 Author Orcid Image ;   Benjamin W Nelson2 Author Orcid Image ;   Charles Stromeyer IV2 Author Orcid Image ;   Darlene King6 Author Orcid Image ;   Jina Suh7 Author Orcid Image ;   Li Zhou3 Author Orcid Image ;   John Torous2 Author Orcid Image
Article Authors Cited by (6) Tweetations Metrics

Journals

  1. M U P, H R P, K P P, D N P, H N T. AI - Powered Medical Chatbot for Symptom Check. E3S Web of Conferences 2026;692:03010 View
  2. Barnawi G, Lazarowitz R, Nukaly H, Kashkari S, Lipner S. Ethical implications of artificial intelligence language interpretation tools in dermatology. Journal of the American Academy of Dermatology 2026 View
  3. Wang X, Yin C, He H, Guo J, Fu X, Bai F. Benchmarking public large language model responses to patient-facing inflammatory bowel disease questions: informational quality, transparency proxies, and readability. Frontiers in Public Health 2026;14 View
  4. McGee A, Parsons G, Zhaunova L, Paul A, Kazlou A, Xu Y, Stsefanovich H, Klepchukova A, Meczner A. Safety-focused development and evaluation of an LLM sexual well-being chatbot for women: A methods-focused feasibility study. DIGITAL HEALTH 2026;12 View
  5. Castaño-Villegas N, Villa M, Barrientos K, Llano I, Velásquez L, Zea J. Arkangel AI, OpenEvidence, ChatGPT, Medisearch: Are They Objectively up to Medical Standards? A Real-Life Assessment of LLM Chatbots in Health Care. Mayo Clinic Proceedings: Digital Health 2026;4(2):100356 View
  6. AmirHossein Ourang S, Kahler B, Ha W, Jafari B, Zahedrozegar S, Nosrat A. Artificial Intelligence Chatbots’ Performance on Dental Trauma Case-based Queries: Examining the Effect of Prompt and Content Engineering. Journal of Endodontics 2026 View