Automated identification of diagnostic labelling errors in medicine

Hautz, Wolf E; Kündig, Moritz; Tschanz, Roger; Birrenbach, Tanja; Schuster, Alexander; Bürkle, Thomas; Hautz, Stefanie C; Sauter, Thomas C; Krummrey, Gert (2021). Automated identification of diagnostic labelling errors in medicine Diagnosis (Berl), 9(2), pp. 241-249. 10.1515/dx-2021-0039

[img]
Preview
Text
10.1515_dx-2021-0039.pdf - Published Version
Available under License Creative Commons: Attribution (CC-BY).

Download (730kB) | Preview

Objectives: Identification of diagnostic error is complex and mostly relies on expert ratings, a severely limited procedure. We developed a system that allows to automatically identify diagnostic labelling error from diagnoses coded according to the international classification of diseases (ICD), often available as routine health care data. Methods: The system developed (index test) was validated against rater based classifications taken from three previous studies of diagnostic labeling error (reference standard). The system compares pairs of diagnoses through calculation of their distance within the ICD taxonomy. Calculation is based on four different algorithms. To assess the concordance between index test and reference standard, we calculated the area under the receiver operating characteristics curve (AUROC) and corresponding confidence intervals. Analysis were conducted overall and separately per algorithm and type of available dataset. Results: Diagnoses of 1,127 cases were analyzed. Raters previously classified 24.58% of cases as diagnostic labelling errors (ranging from 12.3 to 87.2% in the three datasets). AUROC ranged between 0.821 and 0.837 overall, depending on the algorithm used to calculate the index test (95% CIs ranging from 0.8 to 0.86). Analyzed per type of dataset separately, the highest AUROC was 0.924 (95% CI 0.887-0.962). Conclusions: The trigger system to automatically identify diagnostic labeling error from routine health care data performs excellent, and is unaffected by the reference standards' limitations. It is however only applicable to cases with pairs of diagnoses, of which one must be more accurate or otherwise superior than the other, reflecting a prevalent definition of a diagnostic labeling error.

Item Type:

Journal Article (Original Article)

Division/Institute:

School of Engineering and Computer Science > Institut für Medizininformatik I4MI

Name:

Hautz, Wolf E;
Kündig, Moritz;
Tschanz, Roger;
Birrenbach, Tanja;
Schuster, Alexander;
Bürkle, Thomas;
Hautz, Stefanie C;
Sauter, Thomas C and
Krummrey, Gert

Subjects:

R Medicine > RZ Other systems of medicine

ISSN:

2194-8011

Language:

English

Submitter:

Thomas Bürkle

Date Deposited:

24 Jan 2022 16:21

Last Modified:

15 May 2022 01:35

Publisher DOI:

10.1515/dx-2021-0039

PubMed ID:

34674415

ARBOR DOI:

10.24451/arbor.16410

URI:

https://arbor.bfh.ch/id/eprint/16410

Actions (login required)

View Item View Item
Provide Feedback