A1 Refereed original research article in a scientific journal
Advancing Reproducibility and Accountability of Unsupervised Machine Learning in Text Mining: Importance of Transparency in Reporting Preprocessing and Algorithm Selection
Authors: Valtonen Laura, Mäkinen Saku J, Kirjavainen Johanna
Publisher: Sage Publications
Publication year: 2022
Journal: Organizational Research Methods
Journal name in source: ORGANIZATIONAL RESEARCH METHODS
Journal acronym: ORGAN RES METHODS
Number of pages: 26
ISSN: 1094-4281
eISSN: 1552-7425
DOI: https://doi.org/10.1177/10944281221124947
Web address : https://journals.sagepub.com/doi/10.1177/10944281221124947
Self-archived copy’s web address: https://research.utu.fi/converis/portal/detail/Publication/176969243
Machine learning (ML) enables the analysis of large datasets for pattern discovery. ML methods and the standards for their use have recently attracted increasing attention in organizational research; recent accounts have raised awareness of the importance of transparent ML reporting practices, especially considering the influence of preprocessing and algorithm choice on analytical results. However, efforts made thus far to advance the quality of ML research have failed to consider the special methodological requirements of unsupervised machine learning (UML) separate from the more common supervised machine learning (SML). We confronted these issues by studying a common organizational research dataset of unstructured text and discovered interpretability and representativeness trade-offs between combinations of preprocessing and UML algorithm choices that jeopardize research reproducibility, accountability, and transparency. We highlight the need for contextual justifications to address such issues and offer principles for assessing the contextual suitability of UML choices in research settings.
Downloadable publication This is an electronic reprint of the original article. |  |
