Abstract
Autism is a severe disorder affecting 1 in 160 children globally. Autism comprises of several development disabilities such as social, communicational and behavioural challenges. Children being diagnosed by the autism mainly face a hard time studying curriculum in inclusive classrooms based on their IQ level and the autism levels. Although, different strategies and learning teaching tools are available to support autistic children, only few systems aid them in learning efficiently, and are not highly interactive. Thus, the proposed Intelligent Education System primarily focuses on providing interactive learning experience to the autistic children with IQ level >50% and efficient teaching assistance to their tutors using augmented reality and machine learning in both English and Arabic The capability of the education system to perform an action, allows the autistic child to interact with the playable sand and gain interest. In learning stage, once the child scribbles on the sandbox, Kinect 3D camera captures and recognizes the drawn image. After the refinement and recognition of the image using OpenCV and classification model, the stored set of real world object are projected on the canvas. Besides, a webcam captures the facial expression of the child, and emotion detection algorithm determines the reaction of the child. Based on the child’s emotion, the current object is projected and pronounced three times to enforce better learning. Once the instructor chooses the language and character to be taught using the developed mobile application, the system displays it over the sandbox and further three objects that starts with the particular character are pronounced and projected. The system is tested rigorously with large set of users, and the results prove the efficiency of the system and happiness of the autistic children in better learning.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
World Health Organization: Autism spectrum disorders (2017). https://www.who.int/newsroom/fact-sheets/detail/autism-spectrum-disorders. Accessed 10 May 2019
Posserud, M.: Autistic features in a total population of 7–9-year-old children assessed by the ASSQ (Autism Spectrum Screening Questionnaire). J. Child Psychol. Psychiatry 47(2), 167–175 (2006)
Al-Farsi, Y.M., et al.: Brief report: prevalence of autistic spectrum disorders in the Sultanate of Oman. J. Autism Dev. Disord. 41(6), 821–825 (2011)
Al-Farsi, Y.M., et al.: Levels of heavy metals and essential minerals in hair samples of children with autism in Oman: a case–control study. Biol. Trace Elem. Res. 151(2), 181–186 (2013)
Ministry of Health: MOH Organizes Autism Workshop for Parents (2017). https://www.moh.gov.om/en/-/---542. Accessed 1 July 2019
Decristofaro, A.: Students with Autism in Inclusive Classrooms. University of Toronto (2016). Accessed 25 May 2019
Bernard-Opitz, V., Sriram, N., Nakhoda-Sapuan, S.: Enhancing social problem solving in children with autism and normal children through computer-assisted ınstruction. J. Autism Dev. Disord. 31(4), 377–384 (2001)
Shu, L.-Q., Sun, Y.-K., Tan, L.-H., Shu, Q., Chang, A.: Application of artificial intelligence in pediatrics: past, present and future. World J. Pediatr. 15(2), 105–108 (2019)
Lynch, M.: 7 Roles for Artificial intelligence in Education (2018). https://www.thetechedvocate.org/7-roles-for-artificial-intelligence-in-education/. Accessed 21 Dec 2018
Smith, T.J., et al.: Blending human and artificial ıntelligence to support autistic children’s social. ACM Trans. Comput. Hum. Interact. 25(6) (2018)
Tang, T.Y., Xu, J., Winoto, P.: An augmented reality-based word-learning mobile application for children with autism to support learning anywhere and anytime: object recognition based on deep learning. In: International Conference on Human-Computer Interaction, pp. 182–192. Springer, Cham (2019)
Special learning: Childhood Autism Rating Scale (2019). https://www.special-learning.com/article/childhood_autism_rating_scale. Accessed 25 Aug 2019
The Economic Times: Definition of System Testing | What is System Testing? System Testing Meaning (2019). https://economictimes.indiatimes.com/definition/system-testing. Accessed 25 May 2019
Acknowledgment
We would like to thank The Research Council (TRC) of Oman for funding to carry out this research as FURAP project. Our deepest gratitude towards the National University of Science and Technology for providing all the essential assets and facilities. All author states that there is no conflict of interest.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Asif, M.A., Al Wadhahi, F., Rehman, M.H., Kalban, I.A., Achuthan, G. (2020). Intelligent Educational System for Autistic Children Using Augmented Reality and Machine Learning. In: Raj, J., Bashar, A., Ramson, S. (eds) Innovative Data Communication Technologies and Application. ICIDCA 2019. Lecture Notes on Data Engineering and Communications Technologies, vol 46. Springer, Cham. https://doi.org/10.1007/978-3-030-38040-3_59
Download citation
DOI: https://doi.org/10.1007/978-3-030-38040-3_59
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-38039-7
Online ISBN: 978-3-030-38040-3
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)