잠시만 기다려 주세요. 로딩중입니다.

Key Principles of Clinical Validation, Device Approval, and Insurance Coverage Decisions of Artificial Intelligence

Korean Journal of Radiology 2021년 22권 3호 p.442 ~ 453
박성호, 최재순, 변정식,
소속 상세정보
박성호 ( Park Seong-Ho ) - University of Ulsan College of Medicine Asan Medical Center Department of Radiology
최재순 ( Choi Jae-Soon ) - University of Ulsan College of Medicine Asan Medical Center Department of Biomedical Engineering
변정식 ( Byeon Jeong-Sik ) - University of Ulsan College of Medicine Asan Medical Center Department of Gastroenterology

Abstract


Artificial intelligence (AI) will likely affect various fields of medicine. This article aims to explain the fundamental principles of clinical validation, device approval, and insurance coverage decisions of AI algorithms for medical diagnosis and prediction. Discrimination accuracy of AI algorithms is often evaluated with the Dice similarity coefficient, sensitivity, specificity, and traditional or free-response receiver operating characteristic curves. Calibration accuracy should also be assessed, especially for algorithms that provide probabilities to users. As current AI algorithms have limited generalizability to real-world practice, clinical validation of AI should put it to proper external testing and assisting roles. External testing could adopt diagnostic case-control or diagnostic cohort designs. A diagnostic case-control study evaluates the technical validity/accuracy of AI while the latter tests the clinical validity/accuracy of AI in samples representing target patients in real-world clinical scenarios. Ultimate clinical validation of AI requires evaluations of its impact on patient outcomes, referred to as clinical utility, and for which randomized clinical trials are ideal. Device approval of AI is typically granted with proof of technical validity/accuracy and thus does not intend to directly indicate if AI is beneficial for patient care or if it improves patient outcomes. Neither can it categorically address the issue of limited generalizability of AI. After achieving device approval, it is up to medical professionals to determine if the approved AI algorithms are beneficial for real-world patient care. Insurance coverage decisions generally require a demonstration of clinical utility that the use of AI has improved patient outcomes.

키워드

Software validation; Device approval; Insurance coverage; Artificial intelligence

원문 및 링크아웃 정보

  

등재저널 정보