skip to main content
10.1145/3364138.3364157acmotherconferencesArticle/Chapter ViewAbstractPublication PagesrehabConference Proceedingsconference-collections
short-paper

Improving cognitive abilities through gestural interaction

Published:29 January 2020Publication History

ABSTRACT

The psychology of learning and the neurosciences sustain an ongoing effort in the study of memory in order to facilitate teaching-learning processes. Special attention goes to Working Memory (WM), the conscious, short-term system where learning originates. Persons with cognitive deficiency, for example with Down Syndrome, present limiting conditions in phonological and visuospatial WM, with the latter being less affected. Gamified, digital learning resources, in a gestural interaction environment between human and computer, are proposed for stimulating new learning. We use a quasi-experimental methodology to measure the memory factor in image and text resources, both in a single class lesson and between lessons (Δt=1 wk.), in a population of three students (8 < cognitive age < 12) selected by their regular classroom teachers with the aim of a balanced sample. A lesson plan was personalized for each student, with 3 or 4 work sessions in a row, each lasting 6-12 minutes, and adapted to the computerized gestural interaction platform Tango:H. This lesson plan was repeated for 3 weeks with no changes in the learning resources or strategies. Results show a significant variation in recall between lessons, with a 99.95% confidence level; 100% recall was attained in 33% of the cases. There was no distinction between image- or text-based learning resources in terms of the recall factor; no significant difference in learning outcomes was found between different resource types.

References

  1. D. M. Bayliss, C. Jarrold, D. M. Gunn, and A. D. Baddeley, "The complexities of complex span: Explaining individual differences in working memory in children and adults," J. Exp. Psychol., vol. 132, no. 1, pp. 71--92, 2003.Google ScholarGoogle ScholarCross RefCross Ref
  2. K. Olson and S. A. Sands, "Cognitive training programs for childhood cancer patients and survivors: A critical review and future directions," CHILD Neuropsychol., vol. 22, no. 5, pp. 509--536, Jul. 2016.Google ScholarGoogle ScholarCross RefCross Ref
  3. H. M. Costa, H. R. M. Purser, and M. C. Passolunghi, "Improving working memory abilities in individuals with Down syndrome: a treatment case study," Front. Psychol., vol. 6, p. 1331, 2015.Google ScholarGoogle ScholarCross RefCross Ref
  4. A. Balcázar-Rengifo, C. A. Collazos, F. H. Cerón, and R. Gil-Iranzo, "Interfaz Colaborativa y Emocional para Interpretar el Sentido Común," [Collaborative and emotional interface for interpreting common sense], Lámpsakos, no. 12, pp. 52--61, 2014.Google ScholarGoogle Scholar
  5. L. Esteban, V. Plaza, G. Lopez-Crespo, A. B. Vivas, and A. F. Estevez, "Differential outcomes training improves face recognition memory in children and in adults with Down syndrome," Res. Dev. Disabil., vol. 35, no. 6, pp. 1384--1392, 2014.Google ScholarGoogle ScholarCross RefCross Ref
  6. L. Visu-Petra, O. Benga, I. Tincas, and M. Miclea, "Visual-spatial processing in children and adolescents with Down's syndrome: a computerized assessment of memory skills.," J. Intellect. Disabil. Res., vol. 51, no. 12, p. 942--952 11p, Dec. 2007.Google ScholarGoogle ScholarCross RefCross Ref
  7. K.-A. B. Næss, S.-A. H. Lyster, C. Hulme, and M. Melby-Lervåg, "Language and verbal short-term memory skills in children with Down syndrome: a meta-analytic review.," Res. Dev. Disabil., vol. 32, no. 6, pp. 2225--34, Jan. 2011.Google ScholarGoogle ScholarCross RefCross Ref
  8. C. Jarrold and A. D. Baddeley, "Short-term memory in Down syndrome: applying the working memory model," Downs. Syndr. Res. Pract., vol. 7, no. 1, p. 17, 2001.Google ScholarGoogle ScholarCross RefCross Ref
  9. A. Baddeley and C. Jarrold, "Working memory and Down syndrome," J. Intellect. Disabil. Res., vol. 51, no. 12, pp. 925--931, 2007.Google ScholarGoogle ScholarCross RefCross Ref
  10. M. A. Groen, G. Laws, K. Nation, and D. M. Bishop, "A case of exceptional reading accuracy in a child with Down syndrome: Underlying skills and the relation to reading comprehension," Cogn. Neuropsychol., vol. 23, no. 8, pp. 1190--1214, 2006.Google ScholarGoogle ScholarCross RefCross Ref
  11. Y. C. Wu and S. Coulson, "A Psychometric Measure of Working Memory Capacity for Configured Body Movement," PLoS One, vol. 9, no. 1, p. e84834, Jan. 2014.Google ScholarGoogle ScholarCross RefCross Ref
  12. H. Gardner, Estructuras de la mente: La teoría de las inteligencias múltiples. [Structures of the mind: the theory of multiple intelligences] Mexico: Fondo de Cultura Económica, 2001.Google ScholarGoogle Scholar
  13. M. Bardolph and S. Coulson, "How vertical hand movements impact brain activity elicited by literally and metaphorically related words: an ERP study of embodied metaphor," Front. Hum. Neurosci., vol. 8, p. 1031, Dec. 2014.Google ScholarGoogle ScholarCross RefCross Ref
  14. C. Rousseau, L. Fautrelle, C. Papaxanthis, L. Fadiga, T. Pozzo, and O. White, "Direction-dependent activation of the insular cortex during vertical and horizontal hand movements," Neuroscience, vol. 325, pp. 10--19, Jun. 2016.Google ScholarGoogle ScholarCross RefCross Ref
  15. S. Coulson, "Brain Systems for Action Perception in Understanding Co-Speech Gesture and Signed Languages," Psychophysiology, vol. 52, pp. S17--S18, 2015.Google ScholarGoogle ScholarCross RefCross Ref
  16. B. Muro Haro, P. Santana Mamcilla, and M. García Ruiz, "Uso de interfaces tangibles en la enseñanza de lectura a niños con síndrome de Down," [Use of tangible interfaces in the teaching of reading to children with Down syndrome.] El Hombre y la Máquina, pp. 19--25, 2012.Google ScholarGoogle Scholar
  17. L. Kumin, J. Lazar, and J. Feng, "Expanding job options: potential computer-related employment for adults with Down syndrome," ACM SIGACCESS Accessibility and Computing, no. 103. ACM, p. 14, 2012.Google ScholarGoogle Scholar
  18. J. Feng, J. Lazar, L. Kumin, and A. Ozok, "Computer Usage by Children with Down Syndrome: Challenges and Future Research," ACM Trans. Access. Comput., vol. 2, no. 3, pp. 1--44, 2010.Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. I. T. de E. R. ITER, Tango:H Designer. Manual de usuario. [User's Manual] Santa Cruz de Tenerife - Spain: ITER, 2013.Google ScholarGoogle Scholar
  20. C. S. González-González, P. Toledo-Delgado, M. Padrón, E. Santos, and M. Cairos, "Including gamification techniques in the design of Tango: H Platform," J. Teknol. (Sciences Eng., vol. 63, no. 3, pp. 77--84, 2013.Google ScholarGoogle Scholar
  21. P. Torres-Carrion, C. S. González-González, and A. Mora Carreño, "Methodology of emotional evaluation in education and rehabilitation activities for people with Down syndrome," XV Int. Conf. Hum. Comput. Interact., pp. 12--15, 2014.Google ScholarGoogle Scholar
  22. P. Torres-Carrion and C. Gonzalez-Gonzalez, "Facial Emotion Analysis in Down's syndrome children in classroom," Interacction 2015, no. Interacction 2015, 2015.Google ScholarGoogle Scholar
  23. J. Lazar, J. H. Feng, & H. Hochheiser. Research methods in human-computer interaction. Morgan Kaufmann. 2017Google ScholarGoogle Scholar
  24. R. Ferreiro, Cómo ser Mejor Maestro: el método ELI [How to be a better teacher: the ELI method], vol. 3. Mexico: Trillas, 2012.Google ScholarGoogle Scholar
  25. A. Baddeley, "The Fractionation of Working Memory," Proc. Natl. Acad. Sci. U.S.A., vol. 93, no. 24, pp. 13468--13472, 1996.Google ScholarGoogle ScholarCross RefCross Ref
  26. A. Baddeley, "Working Memory," Science (80-.)., vol. 255, no. 5044, pp. 556--559, 1992.Google ScholarGoogle ScholarCross RefCross Ref
  27. A. Baddeley, "Working memory," Curr. Biol., vol. 20, no. 4, pp. R136--R140, May 2010.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Improving cognitive abilities through gestural interaction

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Other conferences
      REHAB '19: Proceedings of the 5th Workshop on ICTs for improving Patients Rehabilitation Research Techniques
      September 2019
      196 pages
      ISBN:9781450371513
      DOI:10.1145/3364138

      Copyright © 2019 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 29 January 2020

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • short-paper
    • Article Metrics

      • Downloads (Last 12 months)11
      • Downloads (Last 6 weeks)1

      Other Metrics

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader