Debriefing in gaming simulation for research: Opening the black box of the non-trivial machine to assess validity and reliability
2015 (English)In: Proceedings - Winter Simulation Conference, IEEE conference proceedings, 2015, 3505-3516 p.Conference paper (Refereed)
Gaming simulation allows for experiments with sociotechnical systems and has as such been employed in the railway sector to study the effects of innovations on robustness and punctuality. Systems work as non-trivial machines and the effect of an innovation on a dependent variable is potentially context, time and history dependent. However, several constraints inhibit the use of validity increasing measures such as repeated runs and increasing sample size. Based on a debriefing framework, insights from qualitative process research and six games with Dutch and UK railway traffic operators, we provide a guide on how to assess and increase reliability and validity. The key is for game players, observers and facilitators to open up the black box and thereby assessing how the innovation brought about any changes, if these changes are insensitive to changes in parameters and if the conclusions hold outside the game.
Place, publisher, year, edition, pages
IEEE conference proceedings, 2015. 3505-3516 p.
Dependent variables, Game players, Gaming simulation, Non-trivial, Qualitative process, Reliability and validity, Sample sizes, Sociotechnical systems, Railroads
IdentifiersURN: urn:nbn:se:kth:diva-176115DOI: 10.1109/WSC.2014.7020182ScopusID: 2-s2.0-84940538637ISBN: 9781479974863OAI: oai:DiVA.org:kth-176115DiVA: diva2:874712
2014 Winter Simulation Conference, WSC 2014, 7 - 10 December 2014
QC 201511272015-11-272015-11-022015-11-27Bibliographically approved