Abstract
This chapter is based on a research conducted that involves usability testing on websites performed on a target audience that are multilingual (English, Malay, Mandarin and Tamil). If a study is carried out without an eye tracker, the moderator has to rely on the think-aloud (TA) feedback and the notes captured by the usability analyst. Moreover, it has been found that using TA technique alone may not be suitable and reliable in usability studies in Malaysia whereby there exists high power distance (Hofstede’s model). With the eye tracker, the usability practitioner can now complement the TA feedback with one of the human biometric feature, which in this case is the user’s eye. This increases the data integrity obtained from all users. Using a combination of visualisation and analysis tools from the Tobii Studio such as cluster plot and gaze data, areas of high concentration in a web interface could be revealed. Based on the marked areas of interest (AOI), descriptive statistics such as fixation count, fixation duration, time to first fixation and mouse click-related data were used to correlate with the data obtained from the TA protocol. For instance, the consistent results from the TA and eye tracking enabled the moderator to conclude that one website had more efficient navigation strategy than other. There was a significant correlation and consistency between the TA feedback and the eye-tracking analysis. This enabled the usability analyst to present the findings with visual, audio and statistical evidence, eventually increasing the persuasive power towards the design and development team to implement changes. The findings of this study challenges the recruitment criteria spelt out in user experience (UX) studies today which limits the subjects to the language of the website being tested.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Abdollah, N.,Soo, S.T., Sivaji, A., (2013). Eyes on OSH – Usability Testing with Eye-Tracking and User Preference Rating. Springer International Publishing. Book Section Advances in Visual Informatics. Lecture Notes in Computer Science Volume 8237, 2013, (pp 323-334).
Blandford, A., E, A., Hyde, J. K., Green, T. R., & Connell, I. (2008). Scoping Analytical Usability Evaluation Methods: A Case Study. Human-Computer Interaction (pp. 278–327).
Claudia, E., & Wilson, S. (2007). Identifying web usability problems from eye-tracking data. British Computer Society (pp. 119–128.)
Goh, K.N., Chen, Y.Y., Lai, F.W., Daud, S.C., Sivaji, A., Soo, S.T. (2013). A Comparison of Usability Testing Methods for an E-Commerce Website: A Case Study on a Malaysia Online Gift Shop. Information Technology: New Generations (ITNG), 2013 Tenth International Conference on , vol., no., pp.143,150, 15-17 April 2013
Hofstede, G., & Hofstede, G. J. (2005). Cultures and organizations: software of the mind (Revised and expanded 2nd ed.). New York: McGraw-Hill. ISBN 978-0-07-143959-6. OCLC 57069196.
Oshlyansky, L. (2007). Cultural Models in HCI: Hofstede, affordance and technology acceptance, Swansea University.
Sherman, P (2009), UPA 2009 Salary Survey. Usability Professional’s Association. http://usabilityprofessionals.org/usability_resources/surveys/2009salarysurvey_PUBLIC.pdf . Accessed 15 Feb 2012.s
Sivaji, A., Mazlan, M. F., Shi–Tzuaan, S., Abdullah, A., & Downe, A. G. (2011). Importance of incorporating fundamental usability with social, trust & persuasive elements for E-Commerce website. IEEEXplore Business, Engineering and Industrial Applications (ICBEIA) (pp. 221–226).
Sivaji, A., Shi–Tzuaan, S. (2012). Website user experience (UX) testing tool development using open source software (OSS). Network of Ergonomics Societies Conference (SEANES), 2012 Southeast Asian, vol., no., pp. 1, 6, 9–12 July 2012.
Sivaji, A., Abdullah, M.R., Downe, A.G., Ahmad, W.F.W. (2013) Hybrid Usability Methodology: Integrating Heuristic Evaluation with Laboratory Testing across the Software Development Lifecycle. Information Technology: New Generations (ITNG), 2013 Tenth International Conference on , vol., no., pp.375,383, 15-17 April 2013.
Yammiyavar, P., Clemmensen, T., & Kumar, J. (2008). Influence of cultural background on non-verbal communication in a usability testing situation. International Journal of Design, 31–40.
Acknowledgements
The author would like to thank Mohamed Redzuan Abdullah from MIMOS Berhad who sponsored the MIMOS Usability/UX Lab that is equipped with the eye tracker. Many thanks go to Shi Tzuaan, Fahmi Mazlan and Zulkifle for facilitating the LBUT and Sujitra Balakrishnan for reviewing this chapter.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Sivaji, A., Wan Ahmad, W. (2014). Benefits of Complementing Eye-Tracking Analysis with Think-Aloud Protocol in a Multilingual Country with High Power Distance. In: Horsley, M., Eliot, M., Knight, B., Reilly, R. (eds) Current Trends in Eye Tracking Research. Springer, Cham. https://doi.org/10.1007/978-3-319-02868-2_21
Download citation
DOI: https://doi.org/10.1007/978-3-319-02868-2_21
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-02867-5
Online ISBN: 978-3-319-02868-2
eBook Packages: Humanities, Social Sciences and LawEducation (R0)