A1 Refereed original research article in a scientific journal
Do all politicians sound the same? Comparing model explanations to human responses; 
Authors: Tarkka, Otto; Elo, Kimmo; Ginter, Filip; Laippala, Veronika
Publisher: The Association for Computers and the Humanities
Publication year: 2026
Journal: DHQ: Digital Humanities Quarterly
Volume: 20
Issue: 1
eISSN: 1938-4122
DOI: https://doi.org/10.63744/vjurh6rtug2p
Publication's open availability at the time of reporting: Open Access
Publication channel's open availability : Open Access publication channel
Web address : https://doi.org/10.63744/vjurh6rtug2p
Self-archived copy’s web address: https://research.utu.fi/converis/portal/detail/Publication/526586287
Self-archived copy's licence: CC BY ND
Self-archived copy's version: Publisher`s PDF
It is sometimes said that all politicians sound the same with their speeches mired in political jargon full of clichés and false promises. To investigate how distinct the plenary speeches of political parties truly are and what linguistic features make them distinct, we trained a BERT classifier to predict the party affiliation of Finnish members of parliament from their plenary speeches. We contrasted and compared model performance to human responses to see how humans and the model differ in their ability to distinguish between the parties. We used the model explainability method SHAP to identify the linguistic cues that the model most relies on. We show that a deep learning model can distinguish between parties much more accurately than the respondents to the questionnaire. The SHAP explanations and questionnaire responses reveal that whereas humans tend to rely on mostly topical cues, the model has learned to recognize other cues as well, such as personal style and rhetoric.
Downloadable publication This is an electronic reprint of the original article. |  |
Funding information in the publication:
This research was funded by the Research Council of Finland [grant number 353569]
