A2 Refereed review article in a scientific journal
Automation complacency: risks of abdicating medical decision making
Authors: Saadeh, Michael I.; Janhonen, Joel; Beer, Emily; Castelyn, Camille; Hoffman, David N.
Publisher: Springer Science and Business Media LLC
Publication year: 2025
Journal:AI and ethics
Volume: 5
ISSN: 2730-5953
eISSN: 2730-5961
DOI: https://doi.org/10.1007/s43681-025-00825-2
Web address : https://doi.org/10.1007/s43681-025-00825-2
Self-archived copy’s web address: https://research.utu.fi/converis/portal/detail/Publication/505127756
This work investigates automation complacency in relation to decision support systems used in healthcare contexts, especially their impact on clinicians, patients, and the quality of care. While AI and decision support systems can enhance efficiency and outcomes in healthcare, the potential for automation bias risks clinical perils. These include eroded vigilance, impoverished therapeutic relationships, and potentially poorer outcomes regarding overall well-being. This work highlights these concerns to urge actors in the health sector to effectively integrate technology in a way that spares cognitive resources without compromising the essential role of human experts in making medical decisions. To ensure decision support improves patient care, it is crucial to balance computational processing of information with embodied local expertise; we provide a possible starting point for mindful integration. The implementation of systems in the clinical context should encourage vigilance and guard against fatigue and complacency. There is reason to be excited about increasingly efficient and available care. If the risks of automation complacency are avoided, shared time and resources can be used to preserve and promote valuable interactions, insights, and holistic aspects of care.
Downloadable publication This is an electronic reprint of the original article. |
Funding information in the publication:
Open Access funding provided by University of Turku (including Turku University Central Hospital). No funding was received to assist with the preparation of this manuscript.