Denecke, Kerstin; Reichenpfader, Daniel; Willi, Dominic; Kennel, Karin; Bonel, Harald; Nairz, Knud; Cihoric, Nikola; Papaux, Damien; von Tengg-Kobligk, Hendrik (2024). Person-based design and evaluation of MIA, a digital medical interview assistant for radiology Frontiers in Artificial Intelligence, 7, pp. 1-15. Frontiers Research Foundation 10.3389/frai.2024.1431156
|
Text
frai-2-1431156.pdf - Published Version Available under License Creative Commons: Attribution (CC-BY). Download (1MB) | Preview |
Introduction: Radiologists frequently lack direct patient contact due to time constraints. Digital medical interview assistants aim to facilitate the collection of health information. In this paper, we propose leveraging conversational agents to realize a medical interview assistant to facilitate medical history taking, while at the same time offering patients the opportunity to ask questions on the examination. Methods: MIA, the digital medical interview assistant, was developed using a person-based design approach, involving patient opinions and expert knowledge during the design and development with a specific use case in collecting information before a mammography examination. MIA consists of two modules: the interview module and the question answering module (Q&A). To ensure interoperability with clinical information systems, we use HL7 FHIR to store and exchange the results collected by MIA during the patient interaction. The system was evaluated according to an existing evaluation framework that covers a broad range of aspects related to the technical quality of a conversational agent including usability, but also accessibility and security. Results: Thirty-six patients recruited from two Swiss hospitals (Lindenhof group and Inselspital, Bern) and two patient organizations conducted the usability test. MIA was favorably received by the participants, who particularly noted the clarity of communication. However, there is room for improvement in the perceived quality of the conversation, the information provided, and the protection of privacy. The Q&A module achieved a precision of 0.51, a recall of 0.87 and an F-Score of 0.64 based on 114 questions asked by the participants. Security and accessibility also require improvements. Conclusion: The applied person-based process described in this paper can provide best practices for future development of medical interview assistants. The application of a standardized evaluation framework helped in saving time and ensures comparability of results.
Item Type: |
Journal Article (Original Article) |
|---|---|
Division/Institute: |
School of Engineering and Computer Science > Institute for Patient-centered Digital Health School of Engineering and Computer Science > Institute for Patient-centered Digital Health > AI for Health School of Engineering and Computer Science |
Name: |
Denecke, Kerstin 0000-0001-6691-396X; Reichenpfader, Daniel 0000-0002-8052-3359; Willi, Dominic; Kennel, Karin; Bonel, Harald; Nairz, Knud; Cihoric, Nikola; Papaux, Damien and von Tengg-Kobligk, Hendrik |
Subjects: |
Q Science > Q Science (General) R Medicine > R Medicine (General) T Technology > T Technology (General) |
ISSN: |
2624-8212 |
Publisher: |
Frontiers Research Foundation |
Language: |
English |
Submitter: |
Kerstin Denecke |
Date Deposited: |
26 Aug 2024 15:41 |
Last Modified: |
18 Sep 2024 10:12 |
Publisher DOI: |
10.3389/frai.2024.1431156 |
Related URLs: |
|
ARBOR DOI: |
10.24451/arbor.22318 |
URI: |
https://arbor.bfh.ch/id/eprint/22318 |
Actions (login required)
 |
View Item |