Marcin, Thimo; Lüthi, Ailin; Graf, Ronny R.; Krummrey, Gert; Schauber, Stefan K.; Breakey, Neal; Hautz, Wolf E.; Hautz, Stefanie C. (2023). Is language an issue? Accuracy of the German computerized diagnostic decision support system ISABEL and cross-validation with the English counterpart Diagnosis, 10(4), pp. 398-405. De Gruyter 10.1515/dx-2023-0047
|
Text
Diagnosis-2023_ISABEL.pdf - Published Version Available under License Creative Commons: Attribution (CC-BY). Download (496kB) | Preview |
Objectives Existing computerized diagnostic decision support tools (CDDS) accurately return possible differential diagnoses (DDx) based on the clinical information provided. The German versions of the CDDS tools for clinicians (Isabel Pro) and patients (Isabel Symptom Checker) from ISABEL Healthcare have not been validated yet. Methods We entered clinical features of 50 patient vignettes taken from an emergency medical text book and 50 real cases with a confirmed diagnosis derived from the electronic health record (EHR) of a large academic Swiss emergency room into the German versions of Isabel Pro and Isabel Symptom Checker. We analysed the proportion of DDx lists that included the correct diagnosis. Results Isabel Pro and Symptom Checker provided the correct diagnosis in 82 and 71 % of the cases, respectively. Overall, the correct diagnosis was ranked in 71 , 61 and 37 % of the cases within the top 20, 10 and 3 of the provided DDx when using Isabel Pro. In general, accuracy was higher with vignettes than ED cases, i.e. listed the correct diagnosis more often (non-significant) and ranked the diagnosis significantly more often within the top 20, 10 and 3. On average, 38 ± 4.5 DDx were provided by Isabel Pro and Symptom Checker. Conclusions The German versions of Isabel achieved a somewhat lower accuracy compared to previous studies of the English version. The accuracy decreases substantially when the position in the suggested DDx list is taken into account. Whether Isabel Pro is accurate enough to improve diagnostic quality in clinical ED routine needs further investigation.
Item Type: |
Journal Article (Original Article) |
|---|---|
Division/Institute: |
School of Engineering and Computer Science > Institut für Medizininformatik I4MI School of Engineering and Computer Science |
Name: |
Marcin, Thimo; Lüthi, Ailin; Graf, Ronny R.; Krummrey, Gert  0000-0002-8397-2336; Schauber, Stefan K.; Breakey, Neal; Hautz, Wolf E. and Hautz, Stefanie C. |
Subjects: |
Q Science > QA Mathematics > QA75 Electronic computers. Computer science Q Science > QA Mathematics > QA76 Computer software R Medicine > R Medicine (General) |
ISSN: |
2194-802X |
Publisher: |
De Gruyter |
Language: |
English |
Submitter: |
Gert Krummrey |
Date Deposited: |
10 Jan 2024 11:07 |
Last Modified: |
10 Jan 2024 11:07 |
Publisher DOI: |
10.1515/dx-2023-0047 |
PubMed ID: |
37480571 |
Uncontrolled Keywords: |
clinical decision support; diagnostic accuracy; diagnostic decision support; diagnostic error; differential diagnosis generator; emergency medicine |
ARBOR DOI: |
10.24451/arbor.20901 |
URI: |
https://arbor.bfh.ch/id/eprint/20901 |
Actions (login required)
 |
View Item |