A1 Refereed original research article in a scientific journal
The unholy marriage? Integrating qualitative and quantitative information in Delphi processes
Authors: Tapio P, Paloniemi R, Varho V, Vinnari M
Publisher: ELSEVIER SCIENCE INC
Publication year: 2011
Journal: Technological Forecasting and Social Change
Journal name in source: TECHNOLOGICAL FORECASTING AND SOCIAL CHANGE
Journal acronym: TECHNOL FORECAST SOC
Number in series: 9
Volume: 78
Issue: 9
First page : 1616
Last page: 1628
Number of pages: 13
ISSN: 0040-1625
DOI: https://doi.org/10.1016/j.techfore.2011.03.016
Abstract
This study analyses the strengths, weaknesses and pitfalls encountered when combining qualitative and quantitative information in a Delphi process and when reporting the results as scenarios or images of the future. The paper draws material from seven Disaggregative Policy Delphi processes conducted in Finland in 1999-2008, in which the authors were researchers or advisors. The cases are analysed in terms of the level of integration and the ways to overcome the difficulties. A learning 'community of practice' was created by these afterthoughts and by organising an international conference workshop on the issue. Qualitative and quantitative material was holistically integrated in one case. In the other cases, solutions led to domination of one material type over another but even then the other material did give relevant points to scenario formation. Finally, we give recommendations for tackling the pitfalls: 1) balancing between qualitative and quantitative, 2) balancing between formal structure and questions raised in the process, 3) framing questions to discover alternative future states, 4) paying attention to panellists' style, 5) dealing with lack of data for comprehensive cluster analysis, 6) considering scenario consistency, 7) understanding manager's responsibility and, 8) understanding the epistemological aspects of Delphi data. We conclude that integrating qualitative and quantitative material by using mixed methods to form coherent scenarios is at the same time desirable, possible and difficult - making the 'unholy marriage' a worthy adventure. (C) 2011 Elsevier Inc. All rights reserved.
This study analyses the strengths, weaknesses and pitfalls encountered when combining qualitative and quantitative information in a Delphi process and when reporting the results as scenarios or images of the future. The paper draws material from seven Disaggregative Policy Delphi processes conducted in Finland in 1999-2008, in which the authors were researchers or advisors. The cases are analysed in terms of the level of integration and the ways to overcome the difficulties. A learning 'community of practice' was created by these afterthoughts and by organising an international conference workshop on the issue. Qualitative and quantitative material was holistically integrated in one case. In the other cases, solutions led to domination of one material type over another but even then the other material did give relevant points to scenario formation. Finally, we give recommendations for tackling the pitfalls: 1) balancing between qualitative and quantitative, 2) balancing between formal structure and questions raised in the process, 3) framing questions to discover alternative future states, 4) paying attention to panellists' style, 5) dealing with lack of data for comprehensive cluster analysis, 6) considering scenario consistency, 7) understanding manager's responsibility and, 8) understanding the epistemological aspects of Delphi data. We conclude that integrating qualitative and quantitative material by using mixed methods to form coherent scenarios is at the same time desirable, possible and difficult - making the 'unholy marriage' a worthy adventure. (C) 2011 Elsevier Inc. All rights reserved.
UTU Research Portal