FDA Updates – September 2023
September 1, 2023Fei-Fei Li
October 1, 2023Article of the Month – September 2023
Development and Validation of an Artificial Intelligence System to Optimize Clinician Review of Patient Records...
Development and Validation of an Artificial Intelligence System to Optimize Clinician Review of Patient Records
Importance
Physicians are required to work with rapidly growing amounts of medical data. Approximately 62% of time per patient is devoted to reviewing electronic health records (EHRs), with clinical data review being the most time-consuming portion.
Objectives
To determine whether an artificial intelligence (AI) system developed to organize and display new patient referral records would improve a clinician’s ability to extract patient information compared with the current standard of care.
Design, Setting and Participants
In this prognostic study, an AI system was created to organize patient records and improve data retrieval. To evaluate the system on time and accuracy, a nonblinded, prospective study was conducted at a single academic medical center. Recruitment emails were sent to all physicians in the gastroenterology division, and 12 clinicians agreed to participate. Each of the clinicians participating in the study received 2 referral records: 1 AI-optimized patient record and 1 standard (non–AI-optimized) patient record. For each record, clinicians were asked 22 questions requiring them to search the assigned record for clinically relevant information. Clinicians reviewed records from June 1 to August 30, 2020.
Outcomes and Measures.
The time required to answer each question, along with accuracy, was measured for both records, with and without AI optimization. Participants were asked to assess overall satisfaction with the AI system, their preferred review method (AI-optimized vs standard), and other topics to assess clinical utility.
Results
Twelve gastroenterology physicians/fellows completed the study. Compared with standard (non–AI-optimized) patient record review, the AI system saved first-time physician users 18% of the time used to answer the clinical questions (10.5 [95% CI, 8.5-12.6] vs 12.8 [95% CI, 9.4-16.2] minutes; P = .02). There was no significant decrease in accuracy when physicians retrieved important patient information (83.7% [95% CI, 79.3%-88.2%] with the AI-optimized vs 86.0% [95% CI, 81.8%-90.2%] without the AI-optimized record; P = .81). Survey responses from physicians were generally positive across all questions. Eleven of 12 physicians (92%) preferred the AI-optimized record review to standard review. Despite a learning curve pointed out by respondents, 11 of 12 physicians believed that the technology would save them time to assess new patient records and were interested in using this technology in their clinic.
Conclusions
In this prognostic study, an AI system helped physicians extract relevant patient information in a shorter time while maintaining high accuracy. This finding is particularly germane to the ever-increasing amount of medical data and increased stressors on clinicians. Increased user familiarity with the AI system, along with further enhancements in the system itself, hold promise to further improve physician data extraction from large quantities of patient health records.
Relevance to Healthcare Field
An American Medical Association study done in 2020 found that for every hour the physician spends with patients, they will spend two hours on the Electronic Health Record system documenting and managing the patient’s chart. The more time spent by physicians on EHRs, the less time spent face-to-face with patients, creating a higher incidence of physician burnout. This study proposes an AI software that helps physicians get the relevant information needed faster and more efficiently: saving 18% of the time compared to the standard patient referral record review and providing 14.5 minutes saved per patient encounter. Implementing this software will benefit physicians to avoid time wasted on checking non relevant information leading to burnout, while increasing the quality of care and patient satisfaction. Time saved allows more patients to be seen with increases in slots available for new visits, leading to a decreased waiting time for consults.