Abstract
Detailed recordings of employee behaviour can give organisations valuable insights into their work processes. However, recording techniques each have their advantages and disadvantages in terms of their obtrusiveness for participants, the richness of information they capture, and the risks that are involved. In an effort to systematically compare recording techniques, we conducted a multiple-case study at a multinational professional services organisation. We followed six participants for a working day, comparing the outcomes from non-participant observation, screen recording, and timesheet techniques. We generated 136:04 h of data and 849 records of activities. We identified 58 differences between the techniques. The results show that the use of only one technique will not produce a complete and accurate record of the activities that occur on the screen (online), in the hallway (offline), and in the extra hours (overtime). Therefore, it is vital to choose a technique wisely, taking into account the type of information it does not capture. Furthermore, this study identifies some open challenges with respect to accurately recording employee behaviour.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
See folder “Literature Review Results”: https://doi.org/10.5281/zenodo.7535574.
- 2.
Website TechSmith: https://www.techsmith.com/snagit-features.html.
- 3.
Website Alteryx: https://www.alteryx.com/.
- 4.
See folder “Results Multiple Case Study”: https://doi.org/10.5281/zenodo.7535574.
References
Anderson-Gough, F., Grey, C., Robson, K.: Tests of time: organizational time-reckoning and the making of accountants in two multi-national accounting firms. Acc. Organ. Soc. 26(2), 99–122 (2001). https://doi.org/10.1016/S0361-3682(00)00019-2
Augusto, A., et al.: Automated discovery of process models from event logs: review and benchmark. IEEE Trans. Knowl. Data Eng. 31(4), 686–705 (2019). https://doi.org/10.1109/tkde.2018.2841877
Baier, T., Di Ciccio, C., Mendling, J., Weske, M.: Matching events and activities by integrating behavioral aspects and label analysis. Softw. Syst. Model. 17(2), 573–598 (2017). https://doi.org/10.1007/s10270-017-0603-z
Espedal, G., Jelstad Løvaas, B., Sirris, S., Wæraas, A.: Researching Values: Methodological Approaches for Understanding Values Work in Organisations and Leadership. Springer, Cham (2022). https://doi.org/10.1007/978-3-030-90769-3
Ghasemi, M., Amyot, D.: Process mining in healthcare: a systematised literature review. Int. J. Electron. Healthc. 9(1), 60–88 (2016). https://doi.org/10.1504/IJEH.2016.078745
Gratton, L.: The Shift: The Future of Work is Already Here. William Collins, Glasgow (2014)
Grisold, T., Mendling, J., Otto, M., vom Brocke, J.: Adoption, use and management of process mining in practice. Bus. Process. Manag. J. 27(2), 369–387 (2021)
Ho, W.Y.J.: ‘I knew that you were there, so I was talking to you’: the use of screen-recording videos in online language learning research. Qual. Res. 21(1), 120–139 (2021). https://doi.org/10.1177/1468794119885044
Ind, N.: Inside out: how employees build value. J. Brand Manag. 10(6), 393–402 (2003). https://doi.org/10.1057/palgrave.bm.2540136
Johnson, B.M.: Understanding the work of top managers: a shadowing study of Canadian healthcare CEOs. Ph.D. thesis, University of Warwick (2013). https://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.589919
Krieter, P.: Can I record your screen? Mobile screen recordings as a long-term data source for user studies. In: Proceedings of the 18th International Conference on Mobile and Ubiquitous Multimedia, pp. 1–10 (2019)
Lammers, W.J., Badia, P.: Fundamentals of Behavioral Research Textbook. Wadsworth Publishing, Belmont (2004). https://uca.edu/psychology/fundamentals-of-behavioral-research-textbook/
Lethbridge, T.C., Sim, S.E., Singer, J.: Studying software engineers: data collection techniques for software field studies. Empir. Softw. Eng. 10(3), 311–341 (2005). https://doi.org/10.1007/s10664-005-1290-x
Mannhardt, F., de Leoni, M., Reijers, H.A., van der Aalst, W.M.P., Toussaint, P.J.: From low-level events to activities - a pattern-based approach. In: La Rosa, M., Loos, P., Pastor, O. (eds.) BPM 2016. LNCS, vol. 9850, pp. 125–141. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-45348-4_8
Marin-Castro, H.M., Tello-Leal, E.: Event log preprocessing for process mining: a review. Appl. Sci. 11(22), 10556 (2021). https://doi.org/10.3390/app112210556
McDonald, S.: Studying actions in context: a qualitative shadowing method for organizational research. Qual. Res. 5(4), 455–473 (2005). https://doi.org/10.1177/1468794105056923
Mills, A.J., Durepos, G., Wiebe, E.: Encyclopedia of Case Study Research. Sage Publications, Thousand Oaks (2009). https://doi.org/10.4135/9781412957397
Mintzberg, H.: Structured observation as a method to study managerial work. J. Manage. Stud. 7(1), 87–104 (1970). https://doi.org/10.1111/j.1467-6486.1970.tb00484.x
Nicolini, D.: Practice Theory, Work, and Organization. Oxford University Press, Oxford (2012)
Robson, C., McCartan, K.: Real World Research: A Resource for Social Scientists and Practitioner-Researchers. Blackwell Publishing, Hoboken (2002)
Shull, F., Singer, J., Sjøberg, D.I.: Guide to Advanced Empirical Software Engineering. Springer, London (2007). https://doi.org/10.1007/978-1-84800-044-5
Stickdorn, M., Hormess, M.E., Lawrence, A., Schneider, J.: This is Service Design Doing: Applying Service Design and Design Thinking in the Real World. O’Reilly, Sebastopol (2018)
Yin, R.K.: Case Study Research and Applications: Design and methods. Sage Publications, Thousand Oaks (2018)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Šinik, T., Beerepoot, I., Reijers, H.A. (2023). A Peek into the Working Day: Comparing Techniques for Recording Employee Behaviour. In: Nurcan, S., Opdahl, A.L., Mouratidis, H., Tsohou, A. (eds) Research Challenges in Information Science: Information Science and the Connected World. RCIS 2023. Lecture Notes in Business Information Processing, vol 476. Springer, Cham. https://doi.org/10.1007/978-3-031-33080-3_21
Download citation
DOI: https://doi.org/10.1007/978-3-031-33080-3_21
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-33079-7
Online ISBN: 978-3-031-33080-3
eBook Packages: Computer ScienceComputer Science (R0)