Katie Seaborn
Editorial Notes
The author has requested minor, non-substantive changes to the Version of Record and, in accordance with ACM policies, a Corrected Version of Record was published on October 27, 2023. For reference purposes, the VoR may still be accessed via the Supplemental Material section on this page.
ABSTRACT
Games user research is a-booming—or maybe a-goomba-ing—with a boundless parade of papers popping up from every nook and pipe. We may need a super power—or super method—from another world. I outline three motivations for jump-starting research synthesis in games user research. I argue that: research synthesis will validate this field of study and enrich primary research (meta-scholarship); we must level up both primary and secondary research (education); and we should reflect this epistemological stance in community structures and adopt established tools and protocols (standardization). I offer power-ups to get the toads rolling.
Supplemental Material
- 2020. Rise of the preprints. Nature Cancer 1, 11 (Nov. 2020), 1025–1026. https://doi.org/10.1038/s43018-020-00151-y Number: 11 Publisher: Nature Publishing Group.Google Scholar
Cross Ref
- Vero Vanden Abeele, Katta Spiel, Lennart Nacke, Daniel Johnson, and Kathrin Gerling. 2020. Development and validation of the player experience inventory: A scale to measure player experiences at the level of functional and psychosocial consequences. International Journal of Human-Computer Studies 135 (2020), 102370. https://doi.org/10.1016/j.ijhcs.2019.102370Google ScholarDigital Library
- Mara Balestrini, Yvonne Rogers, and Paul Marshall. 2015. Civically Engaged HCI: Tensions between Novelty and Social Impact. In Proceedings of the 2015 British HCI Conference (Lincoln, Lincolnshire, United Kingdom) (British HCI ’15). Association for Computing Machinery, New York, NY, USA, 35–36. https://doi.org/10.1145/2783446.2783590Google ScholarDigital Library
- Florian Brühlmann and Elisa D Mekler. 2018. Surveys in games user research. Games user research (2018), 141–162.Google ScholarCross Ref
- Johan S. G. Chu and James A. Evans. 2021. Slowed canonical progress in large fields of science. Proceedings of the National Academy of Sciences 118, 41 (Oct. 2021). https://doi.org/10.1073/pnas.2021636118Google ScholarCross Ref
- Ricardo Jorge Dinis-Oliveira. 2020. COVID-19 research: Pandemic versus “paperdemic”, integrity, values and risks of the “speed science”. Forensic sciences research 5, 2 (2020), 174–187. https://doi.org/10.1080/20961790.2020.1767754Google ScholarCross Ref
- Kathrin Gerling and Max V Birk. 2022. Reflections on Rigor and Reproducibility: Moving Toward a Community Standard for the Description of Artifacts in Experimental Games Research. In Extended Abstracts of the 2022 Annual Symposium on Computer-Human Interaction in Play. 266–267. https://doi.org/10.1145/3505270.3558360Google ScholarDigital Library
- Neal R. Haddaway, Biljana Macura, Paul Whaley, and Andrew S. Pullin. 2018. ROSES RepOrting standards for Systematic Evidence Syntheses: pro forma, flow-diagram and descriptive summary of the plan and conduct of environmental systematic reviews and systematic maps. Environmental Evidence 7, 1 (March 2018). https://doi.org/10.1186/s13750-018-0121-7Google ScholarCross Ref
- Aqeel Haider, Casper Harteveld, Daniel Johnson, Max V Birk, Regan L Mandryk, Magy Seif El-Nasr, Lennart E Nacke, Kathrin Gerling, and Vero Vanden Abeele. 2022. miniPXI: Development and validation of an eleven-item measure of the player experience inventory. Proceedings of the ACM on Human-Computer Interaction 6, CHI PLAY (2022), 1–26. https://doi.org/10.1145/3549507Google ScholarDigital Library
- Megan L. Head, Luke Holman, Rob Lanfear, Andrew T. Kahn, and Michael D. Jennions. 2015. The extent and consequences of p-hacking in science. PLOS Biology 13, 3 (March 2015), e1002106. https://doi.org/10.1371/journal.pbio.1002106 Publisher: Public Library of Science.Google ScholarCross Ref
- Kasper Hornbæk. 2015. We Must Be More Wrong in HCI Research. Interactions 22, 6 (oct 2015), 20–21. https://doi.org/10.1145/2833093Google ScholarDigital Library
- Marina Krnic Martinic, Dawid Pieper, Angelina Glatt, and Livia Puljak. 2019. Definition of a systematic review used in overviews of systematic reviews, meta-epidemiological studies and textbooks. BMC medical research methodology 19 (2019), 1–12.Google Scholar
- Abigail M Methley, Stephen Campbell, Carolyn Chew-Graham, Rosalind McNally, and Sudeh Cheraghi-Sohi. 2014. PICO, PICOS and SPIDER: A comparison study of specificity and sensitivity in three search tools for qualitative systematic reviews. BMC health services research 14, 1 (2014), 1–10. https://doi.org/10.1186/s12913-014-0579-0Google ScholarCross Ref
- David Moher, Alessandro Liberati, Jennifer Tetzlaff, Douglas G Altman, and the PRISMA Group*. 2009. Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA statement. Annals of internal medicine 151, 4 (2009), 264–269. https://doi.org/10.7326/0003-4819-151-4-200908180-00135Google ScholarCross Ref
- Cale J Passmore, Mathew K Miller, Jun Liu, Cody J Phillips, and Regan L Mandryk. 2020. A cheating mood: The emotional and psychological benefits of cheating in single-player games. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play. 58–70. https://doi.org/10.1145/3410404.3414252Google ScholarDigital Library
- Katja Rogers and Katie Seaborn. 2023. The Systematic Review-lution: A Manifesto to Promote Rigour and Inclusivity in Research Synthesis. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–11. https://doi.org/10.1145/3544549.3582733Google ScholarDigital Library
- Katie Seaborn, Giulia Barbareschi, and Shruti Chandra. 2023. Not Only WEIRD but “Uncanny”? A Systematic Review of Diversity in Human–Robot Interaction Research. International Journal of Social Robotics (2023), 1–30. https://link.springer.com/article/10.1007/s12369-023-00968-4Google Scholar
- Patrick E. Shrout and Joseph L. Rodgers. 2018. Psychology, science, and knowledge construction: Broadening perspectives from the replication crisis. Annual Review of Psychology 69, 1 (2018), 487–510. https://doi.org/10.1146/annurev-psych-122216-011845Google ScholarCross Ref
- Isabelle Stengers. 2018. Another Science is Possible: A Manifesto for Slow Science. John Wiley & Sons. Google-Books-ID: oxJSDwAAQBAJ.Google Scholar
- Gehad Mohamed Tawfik, Kadek Agus Surya Dila, Muawia Yousif Fadlelmola Mohamed, Dao Ngoc Hien Tam, Nguyen Dang Kien, Ali Mahmoud Ahmed, and Nguyen Tien Huy. 2019. A step by step guide for conducting a systematic review and meta-analysis with simulation data. Tropical medicine and health 47, 1 (2019), 1–9. https://doi.org/10.1186/s41182-019-0165-6Google ScholarCross Ref
Index Terms
- Super Synthesis Pros., or Why CHI PLAY Needs Research Synthesis
Recommendations
Engaging in Videogame Play: An Activity-Centric Analysis of the Player Experience
OzCHI '15: Proceedings of the Annual Meeting of the Australian Special Interest Group for Computer Human InteractionThis paper focuses on examining play activities in people's favourite videogame experience. Through interviews with 30 videogame players we discovered which types of play activities are most appealing. Our research identifies the level of appeal of a ...
The Game as a Classroom: Understanding Players’ Goals and Attributions from a Learning Perspective
FDG '20: Proceedings of the 15th International Conference on the Foundations of Digital GamesMuch work has been done on educational games, game-based learning, and gamification in recent years, exploring how games may benefit learning. However, the reverse relationship has yet to be fully explored—how can educational psychology and pedagogy ...
Understanding expectations with multiple controllers in an augmented reality videogame
CHI PLAY '14: Proceedings of the first ACM SIGCHI annual symposium on Computer-human interaction in playPlayer experiences and expectations are connected. The presumptions players have about how they control their gameplay interactions may shape the way they play and perceive videogames. A successfully engaging player experience might rest on the way ...
Comments