Qin Wu
Xiangming Xiao
Suranga Nanayakkara
ABSTRACT
Facial data of children aged 2 to 10 years was collected from three institutions in a large city; an autism rehabilitation center, a rehabilitation hospital, and an inclusive kindergarten. The dataset comprised facial data of 65 children diagnosed with autism, and 47 children with typical developmental. We employed the VGG-16 model to develop a facial feature recognition-based early screening system, which involves feature extraction and image processing of eyes, eyebrows, noses, and mouths. The data was processed and categorized using a Convolutional Neural Network (CNN) model, and the accuracy of this algorithm was validated. Cross-testing with the public database Kaggle and our dataset demonstrated an accuracy rate of up to 94% for the current training set. This indicates that the model trained by our system is proficient in classifying children’s facial data and maintains high precision on our database.
Supplemental Material
Available for Download
- Josephine Barbaro and Cheryl Dissanayake. 2013. Early markers of autism spectrum disorders in infants and toddlers prospectively identified in the Social Attention and Communication Study. Autism 17, 1 (2013), 64–86.Google Scholar
Cross Ref
- Kellen Briot, Adrien Pizano, Manuel Bouvard, and Anouck Amestoy. 2021. New technologies as promising tools for assessing facial emotion expressions impairments in ASD: a systematic review. Frontiers in psychiatry 12 (2021), 634756.Google ScholarCross Ref
- Kimberly LH Carpenter, Jordan Hahemi, Kathleen Campbell, Steven J Lippmann, Jeffrey P Baker, Helen L Egger, Steven Espinosa, Saritha Vermeer, Guillermo Sapiro, and Geraldine Dawson. 2021. Digital behavioral phenotyping detects atypical pattern of facial expression in toddlers with autism. Autism Research 14, 3 (2021), 488–499.Google ScholarCross Ref
- Keshi Dai. 2007. Early diagnosis of autism through analysis of pre-speech vocalizations. SIGACCESS Access. Comput.89 (sep 2007), 42–46. https://doi.org/10.1145/1328567.1328575Google ScholarDigital Library
- Ryan Anthony Jalova de Belen, Tomasz Bednarz, and Arcot Sowmya. 2021. EyeXplain Autism: Interactive System for Eye Tracking Data Analysis and Deep Neural Network Interpretation for Autism Spectrum Disorder Diagnosis. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI EA ’21). Association for Computing Machinery, New York, NY, USA, Article 364, 7 pages. https://doi.org/10.1145/3411763.3451784Google ScholarDigital Library
- Huiyu Duan, Guangtao Zhai, Xiongkuo Min, Zhaohui Che, Yi Fang, Xiaokang Yang, Jesús Gutiérrez, and Patrick Le Callet. 2019. A Dataset of Eye Movements for the Children with Autism Spectrum Disorder. In Proceedings of the 10th ACM Multimedia Systems Conference (Amherst, Massachusetts) (MMSys ’19). Association for Computing Machinery, New York, NY, USA, 255–260. https://doi.org/10.1145/3304109.3325818Google ScholarDigital Library
- Centers for Disease Control, Prevention, 2023. Autism prevalence higher, according to data from 11 ADDM communities.Google Scholar
- Frances Page Glascoe. 2003. Parents’ evaluation of developmental status: how well do parents’ concerns identify children with behavioral and emotional problems?Clinical pediatrics 42, 2 (2003), 133–138.Google Scholar
- Golijeh Golarai, Kalanit Grill-Spector, and Allan L Reiss. 2006. Autism and the development of face processing. Clinical neuroscience research 6, 3-4 (2006), 145–160.Google Scholar
- Antonio Gulli and Sujit Pal. 2017. Deep learning with Keras. Packt Publishing Ltd.Google Scholar
- Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton. 2012. Imagenet classification with deep convolutional neural networks. Advances in neural information processing systems 25 (2012).Google Scholar
- Yann LeCun, Léon Bottou, Yoshua Bengio, and Patrick Haffner. 1998. Gradient-based learning applied to document recognition. Proc. IEEE 86, 11 (1998), 2278–2324.Google ScholarCross Ref
- Shuo Liu, Yue Wang, and Yongning Song. 2023. Atypical facial mimicry for basic emotions in children with autism spectrum disorder. Autism Research (2023).Google Scholar
- Wenbo Liu, Ming Li, and Li Yi. 2016. Identifying children with autism spectrum disorder based on their face processing abnormality: A machine learning framework. Autism Research 9, 8 (2016), 888–898.Google ScholarCross Ref
- Catherine Lord, Mayada Elsabbagh, Gillian Baird, and Jeremy Veenstra-Vanderweele. 2018. Autism spectrum disorder. The lancet 392, 10146 (2018), 508–520.Google Scholar
- Angelina Lu and Marek Perkowski. 2021. Deep Learning Approach for Screening Autism Spectrum Disorder in Children with Facial Images and Analysis of Ethnoracial Factors in Model Development and Application. Brain Sciences 11, 11 (2021). https://doi.org/10.3390/brainsci11111446Google ScholarCross Ref
- Rhiannon Luyster. 2012. Autism Diagnostic Observation Schedule, (ADOS-2) Manual (Part II): Toddler Module. (2012).Google Scholar
- Natasha Malik-Soni, Andrew Shaker, Helen Luck, Anne E Mullin, Ryan E Wiley, ME Suzanne Lewis, Joaquin Fuentes, and Thomas W Frazier. 2022. Tackling healthcare access barriers for individuals with autism from diagnosis to adulthood. Pediatric Research 91, 5 (2022), 1028–1035.Google ScholarCross Ref
- Hiromi Nemoto, Pavel Korshunov, Philippe Hanhart, and Touradj Ebrahimi. 2015. Visual attention in LDR and HDR images. In 9th International Workshop on Video Processing and Quality Metrics for Consumer Electronics (VPQM).Google Scholar
- Chiugo Okoye, Chidi M Obialo-Ibeawuchi, Omobolanle A Obajeun, Sarosh Sarwar, Christine Tawfik, Madeeha Subhan Waleed, Asad Ullah Wasim, Iman Mohamoud, Adebola Y Afolayan, and Rheiner N Mbaezue. 2023. Early diagnosis of autism spectrum disorder: A review and analysis of the risks and benefits. Cureus 15, 8 (2023).Google Scholar
- Diana L Robins, Deborah Fein, and Marianne Barton. 2009. Modified checklist for autism in toddlers, revised, with follow-up (M-CHAT-R/F) TM. LineageN (2009).Google Scholar
- Noah J Sasson and Emily W Touchstone. 2014. Visual attention to competing social and object images by preschool children with autism spectrum disorder. Journal of autism and developmental disorders 44 (2014), 584–592.Google ScholarCross Ref
- Eric Schopler, Mary E Van Bourgondien, Glenna Janette Wellman, and Steven R Love. 2010. Childhood Autism Rating Scale–Second Edition (CARS-2). Los Angeles, CA: Western Psychological Services (2010).Google Scholar
- Da-Yea Song, So Yoon Kim, Guiyoung Bong, Jong Myeong Kim, and Hee Jeong Yoo. 2019. The use of artificial intelligence in screening and diagnosis of autism spectrum disorder: a literature review. Journal of the Korean Academy of Child and Adolescent Psychiatry 30, 4 (2019), 145.Google ScholarCross Ref
- Mark L Sundberg. 2008. VB-MAPP Verbal Behavior Milestones Assessment and Placement Program: a language and social skills assessment program for children with autism or other developmental disabilities: guide. Mark Sundberg.Google Scholar
- Uzma Haque Syeda, Ziaul Zafar, Zishan Zahidul Islam, Syed Mahir Tazwar, Miftahul Jannat Rasna, Koichi Kise, and Md. Atiqur Rahman Ahad. 2017. Visual Face Scanning and Emotion Perception Analysis between Autistic and Typically Developing Children. In Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable Computers (Maui, Hawaii) (UbiComp ’17). Association for Computing Machinery, New York, NY, USA, 844–853. https://doi.org/10.1145/3123024.3125618Google ScholarDigital Library
- Samy Tafasca, Anshul Gupta, Nada Kojovic, Mirko Gelsomini, Thomas Maillart, Michela Papandrea, Marie Schaer, and Jean-Marc Odobez. 2023. The AI4Autism Project: A Multimodal and Interdisciplinary Approach to Autism Diagnosis and Stratification. In Companion Publication of the 25th International Conference on Multimodal Interaction. 414–425.Google ScholarDigital Library
- Diana Weiting Tan, Murray T Maybery, Syed Zulqarnain Gilani, Gail A Alvares, Ajmal Mian, David Suter, and Andrew JO Whitehouse. 2020. A broad autism phenotype expressed in facial morphology. Translational psychiatry 10, 1 (2020), 7.Google Scholar
- Saime Tek and Rebecca J Landa. 2012. Differences in autism symptoms between minority and non-minority toddlers. Journal of autism and developmental disorders 42 (2012), 1967–1973.Google ScholarCross Ref
- Haishuai Wang, Lianhua Chi, Chanfei Su, and Ziping Zhao. 2022. ASDFace: Face-Based Autism Diagnosis via Heterogeneous Domain Adaptation. In Proceedings of the 31st ACM International Conference on Information & Knowledge Management (Atlanta, GA, USA) (CIKM ’22). Association for Computing Machinery, New York, NY, USA, 4999–5003. https://doi.org/10.1145/3511808.3557170Google ScholarDigital Library
Index Terms
- Early Autism Screening in Children Using Facial Recognition
Recommendations
Designing Interactive Technology to Support Children with Autism
CHI EA '24: Extended Abstracts of the 2024 CHI Conference on Human Factors in Computing SystemsThis study aims to investigate the design of interactive technologies to support the development of greetings, peer socialization, and daily life skills in autistic children. Collaboration with professional therapists and families is integral to ensure ...
Subtle facial expression recognition using motion magnification
This paper proposes a novel method for subtle facial expression recognition that uses motion magnification to transform subtle expressions into corresponding exaggerated ones. Motion magnification consists of four steps: First, active appearance model (...
Analysis of facial muscle activation in children with autism using 3D imaging
BIBM '15: Proceedings of the 2015 IEEE International Conference on Bioinformatics and Biomedicine (BIBM)Autism Spectrum Disorder (ASD) impairs an individual's non-verbal skills including natural and contextual facial expressions. Such impairments may manifest as odd facial expressions (facial oddity) based on subjective evaluations of facial images. A few ...
Comments