A4 Refereed article in a conference publication

Exploring the Potential of LLMs for Patient Safety Incident Reporting in Finland: Interview Insights and a Proof-of-Concept Study




AuthorsAnnevirta, Jusa; Saarenpää, Ilkka

EditorsMantas, John; Hasman, Arie; Gallos, Parisis; Zoulias, Emmanouil; Karitis, Konstantinos

Conference nameInternational Conference of Informatics, Management and Technology in Healthcare

PublisherIOS Press BV

Publication year2025

JournalStudies in Health Technology and Informatics

Book title Global Healthcare Transformation in the Era of Artificial Intelligence and Informatics

Journal name in sourceStudies in Health Technology and Informatics

Volume328

First page 41

Last page45

eISBN 978-1-64368-600-4

ISSN0926-9630

eISSN1879-8365

DOIhttps://doi.org/10.3233/SHTI250669

Web address https://ebooks.iospress.nl/doi/10.3233/SHTI250669

Self-archived copy’s web addresshttps://research.utu.fi/converis/portal/detail/Publication/499593301


Abstract
This paper explores the potential of Large Language Models (LLMs) to improve patient safety incident (PSI) reporting in Finland. Through semi-structured interviews with doctors and authorities, key requirements and perspectives on AI integration were gathered. A Proof-of-Concept (PoC) study evaluated the feasibility of using a commercial LLM (GPT-4o) to generate structured PSI reports from unstructured clinical text from patient records. Interview results highlighted the need for integrated and automated reporting systems, with AI seen as a tool to reduce documenting burden and improve data analysis. The PoC demonstrated the technological capability of the LLM to generate coherent and relevant reports but also revealed challenges in completeness and distinguishing incident causality. The findings suggest promising avenues for leveraging LLMs in PSI reporting, warranting further research and development for national implementation.

Downloadable publication

This is an electronic reprint of the original article.
This reprint may differ from the original in pagination and typographic detail. Please cite the original version.




Funding information in the publication
The work was funded by the Finnish Ministry of Social Affairs and Health (STM) as a part of an initiative led by the Finnish Centre for Client and Patient Safety on improving national patient safety reporting in Finland.


Last updated on 2025-02-09 at 15:47