Abstract
Employment outcomes for autistic1 individuals are often poorer relative to their neurotypical (NT) peers, resulting in a greater need for other forms of financial and social support. While a great deal of work has focused on developing interventions for autistic children, relatively less attention has been paid to directly addressing the employment challenges faced by autistic adults. One key impediment to autistic individuals securing employment is the job interview. Autistic individuals often experience anxiety in interview situations, particularly with open-ended questions and unexpected interruptions. They also exhibit atypical gaze patterns that may be perceived as, but not necessarily indicative of, disinterest or inattention. In response, we developed a closed-loop adaptive virtual reality (VR)–based job interview training platform, which we have named Career Interview Readiness in VR (CIRVR). CIRVR is designed to provide an engaging, adaptive, and individualized experience to practice and refine interviewing skills in a less anxiety-inducing virtual context. CIRVR contains a real-time physiology-based stress detection module, as well as a real-time gaze detection module, to permit individualized adaptation. We also present the first prototype of the CIRVR Dashboard, which provides visualizations of data to help autistic individuals as well as potential employers and job coaches make sense of the data gathered from interview sessions. We conducted a feasibility study with 9 autistic and 8 NT individuals to assess the preliminary usability and feasibility of CIRVR. Results showed differences in perceived usability of the system between autistic and NT participants, and higher levels of stress in autistic individuals during interviews. Participants across both groups reported satisfaction with CIRVR and the structure of the interview. These findings and feedback will support future work in improving CIRVR’s features in hopes for it to be a valuable tool to support autistic job candidates as well as their potential employers.
- [1] 2013. Diagnostic and Statistical Manual of Mental Disorders: DSM-5 (5th ed.). American Psychiatric Association, Arlington, VA. xliv, 947 pages.Google ScholarCross Ref
- [2] . 2017. Neurodiversity as a competitive advantage. Harvard Business Review 95, 3 (2017), 96–103.Google Scholar
- [3] . 2014. The case for hiring “outlier” employees. Harvard Business Review Digital Articles (2014), 2–3.Google Scholar
- [4] . 2021. Azure. (2021). Retrieved September 11, 2021 from https://azure.microsoft.com/en-us/.Google Scholar
- [5] . 2008. An empirical evaluation of the system usability scale. International Journal of Human–Computer Interaction 24, 6 (2008), 574–594.Google ScholarCross Ref
- [6] . 2017. VirtualSpeech on BBC Business Live. (2017). Retrieved September 11, 2021 from https://virtualspeech.com/blog/virtualspeech-interview-on-bbc-business-live-world-news.Google Scholar
- [7] . 2013. A job interview simulation: Social cue-based interaction with a virtual character. In 2013 International Conference on Social Computing, (Alexandria, Virginia). IEEE, 220–227.Google ScholarDigital Library
- [8] . 2011. Simulated job interview skill training for people with psychiatric disability: Feasibility and tolerability of virtual reality training. Schizophrenia Bulletin 37, suppl_2 (2011), S91–S97.Google Scholar
- [9] . 2012. Random search for hyper-parameter optimization. Journal of Machine Learning Research 13, 10 (2012), 281–305.Google Scholar
- [10] . 2014. Physiological response measurements. In Eye Tracking in User Experience Design. Morgan Kaufmann, 81–108.Google ScholarCross Ref
- [11] . 2019. Design of a physiology-based adaptive virtual reality driving platform for individuals with ASD. ACM Transactions on Accessible Computing 12, 1 (2019), 1–24.Google ScholarDigital Library
- [12] . 1997. Matsumoto and ekman’s japanese and caucasian facial expressions of emotion (JACFEE): Reliability data and cross-national differences. Journal of Nonverbal Behavior 21, 1 (1997), 3–21.Google ScholarCross Ref
- [13] . 2017. Visualization of eye tracking data: A taxonomy and survey. In Computer Graphics Forum, Vol. 36. Wiley Online Library, 260–284.Google Scholar
- [14] . 2016. Autism Equality in the Workplace: Removing Barriers and Challenging Discrimination. Jessica Kingsley Publishers.Google Scholar
- [15] John Brooke. 1996. SUS-A quick and dirty usability scale. Usability Evaluation in Industry 189, 194 (1996), 4–7.Google Scholar
- [16] . 2018. Using virtual interactive training agents (ViTA) with adults with autism and other developmental disabilities. Journal of Autism and Developmental Disorders 48, 3 (2018), 905–912.Google ScholarCross Ref
- [17] . 2021. Brief report: Improving employment interview self-efficacy among adults with autism and other developmental disabilities using virtual interactive training agents (ViTA). Journal of Autism and Developmental Disorders 51, 2 (2021), 741–748.Google ScholarCross Ref
- [18] . 2007. Handbook of Psychophysiology. Cambridge University Press.Google ScholarCross Ref
- [19] . 2018. Visualization of eye-tracking patterns in autism spectrum disorder: Method and dataset. In 13th International Conference on Digital Information Management (ICDIM’18), (Berlin, Germany). IEEE, 248–253.Google ScholarCross Ref
- [20] . 2016. Investor classification and sentiment analysis. In IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM’16). 1177–1180.Google Scholar
- [21] . 2021. VIVE Pro Eye. (2021). Retrieved September 11, 2021 from https://www.vive.com/eu/product/vive-pro-eye/overview/.Google Scholar
- [22] David DeVault, Ron Artstein, Grace Benn, Teresa Dey, Ed Fast, Alesia Gainer, Kallirroi Georgila, Jon Gratch, Arno Hartholt, Margaux Lhommet, Gale Lucas, Stacy Marsella, Fabrizio Morbini, Angela Nazarian, Stefan Scherer, Giota Stratou, Apar Suri, David Traum, Rachel Wood, Yuyu Xu, Albert Rizzo, and Louis-Philippe Morency. 2014. SimSensei Kiosk: A virtual human interviewer for healthcare decision support. In Proceedings of the 2014 international conference on Autonomous agents and multi-agent systems (Paris, France).Google Scholar
- [23] . 2016. Virtual reality social cognition training for children with high functioning autism. Computers in Human Behavior 62 (2016), 703–711.Google ScholarDigital Library
- [24] . 2019. Sentiment analysis on educational datasets: A comparative evaluation of commercial tools. Educational Journal of the University of Patras UNESCO Chair 6, 1 (2019), 262–273.Google Scholar
- [25] . 1993. Facial expression and emotion. American Psychologist 48, 4 (1993), 384.Google ScholarCross Ref
- [26] . 2010. The Essential Guide to Effect Sizes: Statistical Power, Meta-analysis, and the Interpretation of Research Results. Cambridge University Press.Google ScholarCross Ref
- [27] . 2021. E4 Wristband: Real-time physiological data streaming and visualization. Retrieved September 11, 2021 from https://www.empatica.com/research/e4/.Google Scholar
- [28] . 2010. WordNet. In Theory and Applications of Ontology: Computer Applications. Springer, 231–243.Google Scholar
- [29] . 2018. Stress outcomes of four types of perceived interruptions. Human Factors 60, 2 (2018), 222–235.Google ScholarCross Ref
- [30] . 2018. Job interviewer techniques and script. (2018). Retrieved September 12, 2020 from https://www.crfonline.org/orc/ca/ca-14.html.Google Scholar
- [31] . 2021. Fove VR Platform. Retrieved September 11, 2021 from https://fove-inc.com/developers/.Google Scholar
- [32] . 1995. Design Patterns: Elements of Reusable Object-oriented Software. Pearson Deutschland GmbH.Google ScholarDigital Library
- [33] . 2020. Social assistive robotics for autistic children. In Workshop on Adapted Interaction with SociAl Robots (cAESAR’20), Vol. 2724. CEUR, 7–10.Google Scholar
- [34] . 2016. Promoting social interactions and job independence for college students with autism or intellectual disability: A pilot study. Journal of Autism and Developmental Disorders 46, 11 (2016), 3583–3596.Google ScholarCross Ref
- [35] . 2011. Data Mining: Concepts and Techniques. Elsevier.Google ScholarDigital Library
- [36] . 2014. Engaging young people with autism spectrum disorder in research interviews. British Journal of Learning Disabilities 42, 2 (2014), 153–161.Google ScholarCross Ref
- [37] . 2000. Wearable and Automotive Systems for Affect Recognition from Physiology. Ph.D. Dissertation. Massachusetts Institute of Technology, Cambridge, MA. Advisor(s) Rosalind W. Picard.Google ScholarDigital Library
- [38] . 2017. Employment programmes and interventions targeting adults with autism spectrum disorder: A systematic review of the literature. Autism 21, 8 (2017), 929–941.Google ScholarCross Ref
- [39] . 2013. The Apple iPad™as an innovative employment support for young adults with autism spectrum disorder and other developmental disabilities. Journal of Applied Rehabilitation Counseling 44, 1 (2013), 28–37.Google ScholarCross Ref
- [40] . 2011. An empirical review of the employment interview construct literature. International Journal of Selection and Assessment 19, 1 (2011), 62–81.Google ScholarCross Ref
- [41] . 2000. Speech & Language Processing. Pearson Education India.Google ScholarDigital Library
- [42] . 2004. Gesture: Visible Action as Utterance. Cambridge University Press.Google ScholarCross Ref
- [43] . 2016. Which terms should be used to describe autism? Perspectives from the UK autism community. Autism 20, 4 (2016), 442–462.Google ScholarCross Ref
- [44] . 2008. Emotion recognition based on physiological changes in music listening. IEEE Transactions on Pattern Analysis and Machine Intelligence 30, 12 (2008), 2067–2083.Google ScholarDigital Library
- [45] . 2017. Learning Microsoft Cognitive Services. Packt Publishing Ltd.Google ScholarDigital Library
- [46] . 2017. Research Methods in Human-computer Interaction. Morgan Kaufmann.Google Scholar
- [47] . 2003. A modified computer version of the paced auditory serial addition task (PASAT) as a laboratory-based stressor. The Behavior Therapist 26, 4 (2003), 290–293.Google Scholar
- [48] . 2013. Don’t interrupt me! An examination of the relationship between intrusions at work and employee strain. International Journal of Stress Management 20, 2 (2013), 77.Google ScholarCross Ref
- [49] Steven Bird, Ewan Klein, and Edward Loper. 2009. Natural language processing with Python: analyzing text with the natural language toolkit. O’Reilly Media, Inc.Google Scholar
- [50] . 2020. Prevalence of autism spectrum disorder among children aged 8 years–autism and developmental disabilities monitoring network, 11 sites, United States, 2016. MMWR Surveillance Summaries 69, 4 (2020), 1.Google ScholarCross Ref
- [51] . 2021. Ameliorating the disadvantage for autistic job seekers: An initial evaluation of adapted employment interview questions. Autism 25, 4 (2021), 1060–1075.Google ScholarCross Ref
- [52] . 2018. Differences aren’t deficiencies: Eye tracking reveals the strengths of individuals with autism. Retrieved September 12, 2021 from https://www.tobiipro.com/blog/eye-tracking-reveals-strengths-of-people-with-autism/.Google Scholar
- [53] . 2011. The use of auditory prompting systems for increasing independent performance of students with autism in employment training. International Journal of Rehabilitation Research 34, 4 (2011), 330–335.Google ScholarCross Ref
- [54] . 2015. Understanding the challenges faced by neurodiverse software engineering employees: Towards a more inclusive and productive technical workforce. In Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility, (New York, New York). 173–184.Google ScholarDigital Library
- [55] . 2017. Research needs and priorities for transition and employment in autism: Considerations reflected in a “Special Interest Group” at the International Meeting for Autism Research. Autism Research 10, 1 (2017), 15–24.Google ScholarCross Ref
- [56] . 2020. Heatmap. Retrieved September 12, 2020 from https://nivo.rocks/heatmap/.Google Scholar
- [57] . 2020. Interviewing autistic adults: Adaptations to support recall in police, employment, and healthcare interviews. Autism 24, 6 (2020), 1506–1520.Google ScholarCross Ref
- [58] . 1996. The affective significance of skin conductance activity during a difficult problem-solving task. Cognition & Emotion 10, 5 (1996), 481–504.Google ScholarCross Ref
- [59] . 2014. GloVe: Global vectors for word representation. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP’14). (Doha, Qatar). Association for Computer Linguistics, 1532–1543.Google ScholarCross Ref
- [60] . 2000. Affective Computing. MIT Press.Google ScholarDigital Library
- [61] . 2020. Sentiment analysis for customer review: Case study of GO-JEK expansion. Journal of Information Systems Engineering and Business Intelligence 6, 1 (2020), 1–8.Google ScholarCross Ref
- [62] . 2002. Consultation with children with autistic spectrum disorders about their experience of short-term residential care. British Journal of Learning Disabilities 30, 3 (2002), 97–104.Google ScholarCross Ref
- [63] . 2006. Basic emotions are associated with distinct patterns of cardiorespiratory activity. International Journal of Psychophysiology 61, 1 (2006), 5–18.Google ScholarCross Ref
- [64] . 2002. Psychophysiological control architecture for human-robot coordination-concepts and initial experiments. In Proceedings of the 2002 IEEE International Conference on Robotics and Automation, Vol. 4, (Washington, DC). IEEE, 3719–3724.Google ScholarCross Ref
- [65] . 2012. Eye tracking young children with autism. Journal of Visualized Experiments: JoVE61 (2012), 3675.Google Scholar
- [66] . 1995. MedCalc: A new computer program for medical statistics. Computer Methods and Programs in Biomedicine 48, 3 (1995), 257–262.Google ScholarCross Ref
- [67] . 2009. Atypical eye contact in autism: Models, mechanisms and development. Neuroscience & Biobehavioral Reviews 33, 8 (2009), 1204–1214.Google ScholarCross Ref
- [68] . 2021. PeopleSim. (2021). Retrieved September 11, 2021 from https://www.simmersion.com/peoplesim.Google Scholar
- [69] . 2015. Brief report: Vocational outcomes for young adults with autism spectrum disorders at six months after virtual reality job interview training. Journal of Autism and Developmental Disorders 45, 10 (2015), 3364–3369.Google ScholarCross Ref
- [70] . 2014. Virtual reality job interview training in adults with autism spectrum disorder. Journal of Autism and Developmental Disorders 44, 10 (2014), 2450–2463.Google ScholarCross Ref
- [71] . 2020. Using community-engaged methods to adapt virtual reality job-interview training for transition-age youth on the autism spectrum. Research in Autism Spectrum Disorders 71 (2020), 101498.Google ScholarCross Ref
- [72] . 2021. Job interview and vocational outcomes among transition-age youth receiving special education pre-employment transition services. Intellectual and Developmental Disabilities 59, 5 (2021), 405–421.Google ScholarCross Ref
- [73] . 2021. Virtual interview training for autistic transition age youth: A randomized controlled feasibility and effectiveness trial. Autism 25 (2021), 1536–1552.Google ScholarCross Ref
- [74] . 2018. Social anxiety in autism spectrum disorder: A systematic review. Research in Autism Spectrum Disorders 52 (2018), 51–68.Google ScholarCross Ref
- [75] . 2019. Business Woman. Retrieved September 11, 2021 from https://assetstore.unity.com/packages/3d/characters/humanoids/humans/business-woman-143301.Google Scholar
- [76] . 2020. Tobii Eye Tracking SDK. Retrieved September 12, 2020 from https://assetstore.unity.com/packages/tools/input-management/tobii-eye-tracking-sdk-90604.Google Scholar
- [77] . 2021. Realistic Eye Movements. Retrieved September 11, 2021 from https://assetstore.unity.com/packages/tools/animation/realistic-eye-movements-29168.Google Scholar
- [78] . 2013. JobTIPS: A transition to employment program for individuals with autism spectrum disorders. Journal of Autism and Developmental Disorders 43, 10 (2013), 2472–2483.Google ScholarCross Ref
- [79] . 2005. Affective computing: A review. In International Conference on Affective Computing and Intelligent Interaction, (Beijing, China). Springer, 981–995.Google ScholarDigital Library
- [80] . 2019. Sex differences in employment and supports for adults with autism spectrum disorder. Autism 23, 7 (2019), 1711–1719.Google ScholarCross Ref
- [81] . 1997. SSML: A speech synthesis markup language. Speech Communication 21, 1-2 (1997), 123–133.Google ScholarDigital Library
- [82] . 2021. Unity 2019.3. Retrieved September 11, 2021 from https://unity.com/releases/2019-3.Google Scholar
- [83] . 2020. Powerful Eyetracking for PC Games. Retrieved September 12, 2020 from https://gaming.tobii.com/.Google Scholar
- [84] . 1993. Heart rate variability. Annals of Internal Medicine 118, 6 (1993), 436–447.Google ScholarCross Ref
- [85] . 2021. VirtualSpeech: Soft Skills Training with VR. Retrieved September 11, 2021 from https://virtualspeech.com/.Google Scholar
- [86] . 2017. A pilot study assessing performance and visual attention of teenagers with ASD in a novel adaptive driving simulator. Journal of Autism and Developmental Disorders 47, 11 (2017), 3405–3417.Google ScholarCross Ref
- [87] . 2017. Effects of an employer-based intervention on employment outcomes for youth with significant support needs due to autism. Autism 21, 3 (2017), 276–290.Google ScholarCross Ref
- [88] . 2015. LittleHelper: An augmented reality glass application to assist individuals with autism in job interview. In 2015 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA’15), (Hong Kong, China). IEEE, 1276–1279.Google ScholarCross Ref
- [89] . 2021. Benchmarking commercial emotion detection systems using realistic distortions of facial image datasets. The Visual Computer 37, 6 (2021), 1447–1466.Google ScholarDigital Library
- [90] . 2019. Gesture interaction in virtual reality. Virtual Reality & Intelligent Hardware 1, 1 (2019), 84–112.Google ScholarCross Ref
- [91] . 2017. Brain responses to biological motion predict treatment outcome in young adults with autism receiving virtual reality social cognition training: Preliminary findings. Behaviour Research and Therapy 93 (2017), 55–66.Google ScholarCross Ref
Index Terms
- Career Interview Readiness in Virtual Reality (CIRVR): A Platform for Simulated Interview Training for Autistic Individuals and Their Employers
Recommendations
Effects of Virtual Reality Properties on User Experience of Individuals with Autism
In recent years, virtual reality (VR) has been become a popular training tool for individuals with Autism Spectrum Disorder (ASD). Although VR was proven to be a promising tool for individuals with ASD, effects of VR properties or attributes of user ...
Vocational Rehabilitation of Individuals with Autism Spectrum Disorder with Virtual Reality
In this article, a virtual reality system for vocational rehabilitation of individuals with disabilities (VR4VR) is presented. VR4VR uses immersive virtual environments to assess and train individuals with cognitive and physical disabilities. This ...
Are autistic children more vulnerable online? Relating autism to online safety, child wellbeing and parental risk management
NordiCHI '20: Proceedings of the 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping SocietyMany autistic children are active online users. Research suggests that they are subject to distress and poor wellbeing following online safety threats. However, it is unclear if autistic children are more likely to experience online safety risks ...
Comments