A3 Refereed book chapter or chapter in a compilation book

Challenges of reporting societal impacts for research evaluation purposes – the case of sociology




AuthorsMuhonen Reetta, Tellmann Silje

EditorsEngels, T.C.E. & Kulczycki, E.

Publication year2022

Book title Handbook on Research Assessment in the Social Sciences

First page 335

Last page349

ISBN978-1-80037-254-2

DOIhttps://doi.org/10.4337/9781800372559.00030

Web address https://doi.org/10.4337/9781800372559.00030

Self-archived copy’s web addresshttps://research.utu.fi/converis/portal/detail/Publication/53652977


Abstract

This study explores the challenges of reporting societal impacts for ex post evaluation purposes. Our starting point are the challenges researchers meet when writing about narrative impact cases. We introduce a distinction between the factual and rhetorical components of impact arguments. With this, we highlight how a focus on societal impacts as effects, in combination with requirements to support impacts with evidence, sets limits to the reporting on impacts. We apply this distinction in an empirical analysis of impact case studies submitted by sociologists to Research Excellence Framework (REF2014) in the United Kingdom and to Sameval 2018 in Norway, and we highlight the challenges researchers face in building arguments regarding instrumental, conceptual and symbolic impacts. Based on our findings, sociologists encounter problems specifically in evidencing conceptual impacts, that are claimed to generate the most profound changes in society. In building causality and credibility into the cases, the ultimate challenge remains: Indirect, non-linear and diffuse impacts are too vague to be captured in a concrete manner.


Downloadable publication

This is an electronic reprint of the original article.
This reprint may differ from the original in pagination and typographic detail. Please cite the original version.





Last updated on 2024-26-11 at 23:08