A1 Refereed original research article in a scientific journal
Large Language Models for Risk Detection in E-commerce: Reliability, Semantic Alignment, and Managerial Insights; 
Authors: Davoodi, Laleh; Ginter, Filip; Salimi, Sima; Lorentz, Harri
Publisher: Springer Science and Business Media LLC
Publication year: 2026
Journal: SN Computer Science
Article number: 645
Volume: 7
Issue: 6
ISSN: 2662-995X
eISSN: 2661-8907
DOI: https://doi.org/10.1007/s42979-026-05213-z
Publication's open availability at the time of reporting: Open Access
Publication channel's open availability : Partially Open Access publication channel
Web address : https://doi.org/10.1007/s42979-026-05213-z
Self-archived copy’s web address: https://research.utu.fi/converis/portal/detail/Publication/526916405
Self-archived copy's licence: CC BY
Self-archived copy's version: Publisher`s PDF
The increasing complexity of global e-commerce supply chains underscores the need for automated, context-aware risk monitoring systems capable of interpreting large volumes of unstructured information. Although Large Language Models (LLMs) have shown strong performance across natural language processing tasks, their application to real-world supply chain risk detection remains limited. This study presents a novel, manually annotated dataset of 121 business news articles related to five major steel companies, using the Cambridge Risk Taxonomy. Leveraging this dataset, we evaluate two state-of-the-art LLMs in a multi-label risk classification task using few-shot prompting. The results demonstrate that LLMs can approximate human annotation, though challenges persist in detecting domain-specific risks such as Geopolitical threats and in avoiding label overgeneration. Beyond classification, we further assess the capacity of LLMs to generate managerial risk summaries. We show that summaries derived from model-predicted risks exhibit strong semantic alignment to summaries generated from human annotations, highlighting the potential of LLMs to support executive-level risk interpretation. Overall, this study contributes the first publicly available dataset of fine-grained, hierarchical risk annotations in an e-commerce supply chain context and provides empirical evidence on the opportunities and limitations of LLMs for both analytical and narrative forms of automated risk assessment.
Keywords:
Business News Analysis, E-commerce, LLMs
Downloadable publication This is an electronic reprint of the original article. |  |
Funding information in the publication:
Open Access funding provided by University of Turku (including Turku University Central Hospital). We gratefully acknowledge the financial support provided by Business Finland, as this research was carried out within the framework of the AI-SIM project.
