xRead - Incorporating Artificial Intelligence into Clinical Practice (March 2026)

Ng et al. BMC Medical Informatics and Decision Making

(2025) 25:236

Page 12 of 24

Improving accuracy in identifying relevant information in clinical narratives was a key focus; this could involve better informa

Key Findings Novel Features

tion extraction techniques for categorizing free-form speech into structured formats. The study suggests further testing with real-world clinical scenarios to ensure robustness.

The study highlighted the high error rates associated with SR, particularly for complex clinical tasks, recommending

further improvements in SR technology to reduce errors caused by misinterpretation of clinical terms. It was noted that current SR systems

were not optimally integrated with EHR systems, leading to workflow inefficiencies and errors.

Precision 0.794 WER (mean) 0.43 NR Cascaded SR and IE to fill out a hando ver form for clinical proofing and 0.759 Recall 0.929 0.653

sign-off provide a way to make clinical documentation more effective and efficient;also improves accessibility

and availability of existing documents in clinical judgment, situational-aware ness, and decision making.

Using SR for clinical documenta tion was significantly slower, with

task completion times being 18.11% longer compared to using KBM. SR also resulted in a higher number of

errors, with 390 errors observed in SR compared to 245 in KBM, including er

rors with potential patient harm. While task interruptions did not significantly impact performance, the increased

error rates and slower documentation times highlight safety and efficiency concerns with SR in its current form​.

AI Transcription

Proficiency (paper

specific outcomes)

NR Mean task completion time (s) 112.38 131.44 170.48 201.84

Potential for patient

harm (major errors) 2 29 11 21

Typographical errors 142 133 71 119

Metric (F1 score, F1 0.856

Precision, Recall, WER) 0.702

Gold standard - Irrelevant text

- Macro-averaged

over 35 nonempty categories in a form

Gold standard - Simple task Key

board and Mouse (KBM)

- Simple task SR

- Complex task KBM

- Complex task SR

Comparator Type Subcategories Performance

Standard

Original written, free-form text

documents by

the registered nurse

Standardized

version of a

commercial

electronic health record system

Table 2 (continued)

Study Reference Suom inen et

al., 2015 [15]

Hodgson et al.,

2017

[16]

Made with FlippingBook - professional solution for displaying marketing and sales documents online