Abstract
The proposed study examines the simultaneous influence of factors (environment, type of task, and product properties) upon functional user states that critically affect assessor performance during the realization of various online tasks. In addition, test environment format varies as individual vs. group one, to assess whether testing conditions affect the test results. The test uses two types of tasks that, respectively, induce user functional states of anxiety and monotony/fatigue. Differences in product features are represented by two university website layouts with high and low aesthetic quality, as measured by website aesthetic quality index (U-index, our earlier elaboration). We have employed two groups of metrics to measure user performance, directed at both cognitive and emotional components of the user states. For cognitive efficiency, intellectual lability and productivity of cognitive operations were assessed. Emotional stress was measured by four metrics of self-assessment, namely the level of anxiety, fatigue, excitement, and confidence. Two assessor groups were put in conditions of individual vs. group task solving. Within each group, sub-groups were assigned either anxiety-inducing or fatigue-inducing tasks. For each task, subgroups worked with webpages of either high (U-index > 17) or low (U-index < 8) aesthetic quality. As the test results show, group task solving enhances the synchronous impact of website aesthetics and task features upon the user states. Interaction of high-quality design, group environment, and a monotonous task provides for an antagonistic effect: aesthetic layout in a group environment significantly reduces the fatigue rate. Low aesthetic quality in a group environment leads to cumulative effects in combination with any type of task: for monotonous tasks, it contributes to the development of fatigue, while for anxiety-inducing tasks it grows anxiety, and, in both cases, productivity drops.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Gilal, N.G., Zhang, J., Gilal, F.G.: The four-factor model of product design: scale development and validation. J. Prod. Brand Manag. 27(6), 684–700 (2018)
Madathil, C.K., Greenstein, J.S.: Synchronous remote usability testing: a new approach facilitated by virtual worlds. In Proceedings of SIGCHI Conference on Human Factors in Computing Systems, pp. 2225–2234. ACM (2011)
Kjeldskov, J., Skov, M.B., Stage, J.: A longitudinal study of usability in health care: does time heal? Int. J. Med. Inf 79(6), 135–143 (2008)
Leonova, A.B.: The concept of human functional state in Russian applied psychology. Psychol. Russia 2, 517–538 (2009)
Sonderegger, A., Zbinden, G., Uebelbacher, A., Sauer, J.: The influence of product aesthetics and usability over the course of time: a longitudinal field experiment. Ergonomics 55(7), 713–730 (2012)
Sauer, J., Sonderegger, A., Heyden, K., Biller, J., Klotz, J., Uebelbacher, A.: Extra-laboratorial usability tests: an empirical comparison of remote and classical field testing with lab testing. Appl. Ergon. 74, 85–96 (2019)
Sauer, J., Sonderegger, A.: The influence of product aesthetics and user state in usability testing. Behav. Inf. Technol. 30(6), 787–796 (2011)
Tuch, A.N., Roth, S.P., Hornbaek, K., Opwis, K., Bargas-Avila, J.A.: Is beautiful really usable? toward understanding the relation between usability, aesthetics, and affect in HCI. Comput. Hum. Behav. 28(5), 1596–1607 (2012)
Partala, T., Surakka, V.: The effects of affective interventions in human-computer interaction. Interact. Comput. 16(2), 295–309 (2004)
Ben-Bassat, T., Meyer, J., Tractinsky, N.: Economic and subjective measures of the perceived value of aesthetics and usability. ACM Trans. Comput. Human Interact. 13(2), 210–234 (2006)
Jones, F., Harris, P., Waller, H., Coggins, A.: Adherence to an exercise prescription scheme: the role of expectations, self-efficacy, stage of change and psychological well-being. Br. J. Health. Psychol. 10(3), 359–378 (2005)
Klein, J., Moon, Y., Picard, R.W.: This computer responds to user frustration: theory, design, and results. Interact. Comput. 14(2), 119–140 (2002)
Yakunin, A., Bodrunova, S.: Website aesthetics and functional user states as factors of web usability. In: Ahram, T., Taiar, R. (eds.) IHIET 2021. LNNS, vol. 319, pp. 394–401. Springer, Cham (2022). https://doi.org/10.1007/978-3-030-85540-6_51
Wiltermuth, S., Heath, C.: Synchrony and cooperation. Psychol. Sci. 20(1), 1–5 (2009)
Leonova, A.B.: Occupational stress, personnel adaptation, and health. In: Spielberger, C.D., Sarason, I.G. (eds.) Stress and Emotion: Anxiety, Anger, and Curiosity, pp. 109–125. Routledge, London (1996)
Bodrunova, S.S., Yakunin, A.V.: U-index: an eye-tracking-tested checklist on webpage aesthetics for university web spaces in Russia and the USA. In: Marcus, A., Wang, W. (eds.) DUXU 2017. LNCS, vol. 10288, pp. 219–233. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-58634-2_17
Mashin, V.A.: Analysis of heart rate variability based on the graph method. Hum. Physiol. 28(4), 437–447 (2002)
Wessman, A.E., Ricks, D.F.: Mood and Personality. Holt, Rinehart and Winston, New York (1966)
Acknowledgements
This research has been supported by the project ‘Center for International Media Research’ at St. Petersburg State University, project #92564395. The authors are grateful to all the assessors who took part in the study, including the students of School of Journalism and Mass Communications, St. Petersburg State University, Russia.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Yakunin, A.V., Bodrunova, S.S. (2022). Cumulative Distortions in Usability Testing: Combined Impact of Web Design, Experiment Conditions, and Type of Task and Upon User States During Internet Use. In: Soares, M.M., Rosenzweig, E., Marcus, A. (eds) Design, User Experience, and Usability: UX Research, Design, and Assessment. HCII 2022. Lecture Notes in Computer Science, vol 13321. Springer, Cham. https://doi.org/10.1007/978-3-031-05897-4_36
Download citation
DOI: https://doi.org/10.1007/978-3-031-05897-4_36
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-05896-7
Online ISBN: 978-3-031-05897-4
eBook Packages: Computer ScienceComputer Science (R0)