Abstract
Correctly assessing children’s theory of mind (TOM) is essential to clinical practice. Yet, most tasks heavily rely on language, which is an obstacle for several populations. Langdon and Coltheart’s (Cognition 71(1):43–71, 1999) Picture Sequencing Task (PST), developed for research purposes, avoids this limitation through a minimally-verbal procedure. We thus developed a tablet adaptation of this task for individual application, engaging children’s motivation and allowing response times collection. To assess this tablet-PST, we first tested a large sample of neurotypical children (6–11 years-old, N = 248), whose results confirmed the task’s structural and content validity, and permitted the construction of three standardized clinical indices. In a second experiment, we applied those to previously diagnosed autistic children (N = 23), who were expected to show atypical TOM performance. Children’s outcomes were consistent with what was hypothesized and confirmed the task’s external validity and moderate clinical sensitivity. The tablet-PST thus appears as a suitable tool, providing detailed profiles to inform clinical decisions.
Similar content being viewed by others
Data Availability
Data and analytic code to reproduce the analyses are available upon request to the corresponding author.
Notes
Following Botha et al. ([67]), we use identity-first language to refer to autistic individuals, which is considered less offending and stigmatizing than person-first language (“person with autism”) by the autistic community (e.g., [68]). Note, too, that the adjective “autistic” refers here to the whole autistic spectrum.
Interestingly, response times measures were included in Langdon & Coltheart’s ([34]) original study but were later abandoned, after failing to reveal group difference between high vs. low schizotypal healthy adults. Given that response times have been shown to reveal meaningful effects in autism, we decided to include them on the tablet-PST.
To make sure that grouping together the two control conditions did not hide important effects, we also ran the analyses contrasting TOM, mechanical and social scripts, and report the results in supplementary materials.
In line with Experiment 1, perfect responses (score = 6) were not distributed equally across item types: they represented 39% of responses to TOM items and 70% of the responses to non-TOM items.
References
Premack D, Woodruff G (1978) Does the chimpanzee have a theory of mind? Behav Brain Sci 1(4):515–526. https://doi.org/10.1017/S0140525X00076512
Waytz A, Gray K, Epley N, Wegner DM (2010) Causes and consequences of mind perception. Trends Cogn Sci 14(8):383–388. https://doi.org/10.1016/j.tics.2010.05.006
Frith U, Frith CD (2003) Development and neurophysiology of mentalizing. Philosophical Trans Royal Soc B: Biol Sci 358(1431):459–473. https://doi.org/10.1098/rstb.2002.1218
Bosco FM, Gabbatore I, Tirassa M (2014) A broad assessment of theory of mind in adolescence: the complexity of mindreading. Conscious Cogn 24:84–97. https://doi.org/10.1016/j.concog.2014.01.003
Dennett DC (1978) Beliefs about beliefs. Behav Brain Sci 1(4):568–570. https://doi.org/10.1017/S0140525X00076664
Wimmer H, Perner J (1983) Beliefs about beliefs: representation and constraining function of wrong beliefs in young children’s understanding of deception. Cognition 13:103–128
Wellman HM, Cross D, Watson J (2001) Meta-analysis of theory-of-mind development: the truth about false belief. Child Dev 72(3):655–684. https://doi.org/10.1111/1467-8624.00304
Perner J, Wimmer H (1985) John thinks that Mary thinks that… attribution of second-order beliefs by 5- to 10-year-old children. J Exp Child Psychol 39(3):437–471. https://doi.org/10.1016/0022-0965(85)90051-7
O’Hare AE, Bremner L, Nash M, Happé F, Pettigrew LM (2009) A clinical Assessment Tool for Advanced theory of mind performance in 5 to 12 Year Olds. J Autism Dev Disord 39(6):916–928. https://doi.org/10.1007/s10803-009-0699-2
Beaudoin C, Leblanc É, Gagner C, Beauchamp MH (2020) Systematic review and inventory of theory of mind measures for Young Children. Front Psychol 10:2905. https://doi.org/10.3389/fpsyg.2019.02905
Hayward EO, Homer BD (2017) Reliability and validity of advanced theory-of-mind measures in middle childhood and adolescence. Br J Dev Psychol 35(3):454–462
Blair C, Razza RP (2007) Relating Effortful Control, executive function, and false belief understanding to emerging Math and literacy ability in Kindergarten. Child Dev 78(2):647–663. https://doi.org/10.1111/j.1467-8624.2007.01019.x
Dunn J, Cutting AL, Fisher N (2002) Old friends, New friends: predictors of children’s perspective on their friends at School. Child Dev 73(2):621–635. https://doi.org/10.1111/1467-8624.00427
Fink E, Begeer S, Hunt C, de Rosnay M (2014) False-belief understanding and social preference over the first 2 years of school: a longitudinal study. Child Dev 85:2389. https://doi.org/10.1111/cdev.12302
Maat A, Fett A-K, Derks E (2012) Social cognition and quality of life in schizophrenia. Schizophr Res 137(1):212–218. https://doi.org/10.1016/j.schres.2012.02.017
Bivona U, Formisano R, Laurentiis S, Accetta N, Cosimo M, Massicci R, Ciurli P, Azicnuda E, Silvestro D, Sabatini U, Falletta Caravasso C, Carlesimo G, Caltagirone C, Costa A (2015) Theory of mind impairment after severe traumatic brain injury and its relationship with caregivers’ quality of life. Restor Neurol Neurosci 33:335. https://doi.org/10.3233/RNN-140484
Botting N, Conti-Ramsden G (2008) The role of language, social cognition, and social skill in the functional social outcomes of young adolescents with and without a history of SLI. Br J Dev Psychol 26(2):281–300. https://doi.org/10.1348/026151007X235891
Baron-Cohen S (1997) Mindblindness: an essay on autism and theory of mind. MIT press, Cambridge
Fletcher-Watson S, Happé F (2019) Autism: a new introduction to psychological theory and current debate. Routledge, London
Marocchini E (2023) Impairment or difference? The case of theory of mind abilities and pragmatic competence in the Autism Spectrum. Appl Psycholinguist 44:1–19. https://doi.org/10.1017/S0142716423000024
Senju A (2012) Spontaneous theory of mind and its absence in Autism Spectrum disorders. The Neuroscientist 18(2):108–113. https://doi.org/10.1177/1073858410397208
Baltazar M, Geoffray M, Chatham C, Bouvard M, Martinez Teruel A, Monnet D, Scheid I, Murzi E, Couffin-Cadiergues S, Umbricht D, Murtagh L, Delorme R, Ly Le‐Moal M, Leboyer M, Amestoy A (2021) Reading the mind in the eyes in autistic adults is modulated by Valence and Difficulty: an InFoR Study. Autism Res 14(2):380–388. https://doi.org/10.1002/aur.2390
Livingston LA, Happé F (2017) Conceptualising compensation in neurodevelopmental disorders: reflections from autism spectrum disorder. Neurosci Biobehavioral Reviews 80:729–742. https://doi.org/10.1016/j.neubiorev.2017.06.005
Behrmann M, Avidan G, Leonard GL, Kimchi R, Luna B, Humphreys K, Minshew N (2006) Configural processing in autism and its relationship to face processing. Neuropsychologia 44(1):110–129. https://doi.org/10.1016/j.neuropsychologia.2005.04.002
Livingston LA, Carr B, Shah P (2019) Recent advances and new directions in measuring theory of mind in autistic adults. J Autism Dev Disord 49(4):1738–1744. https://doi.org/10.1007/s10803-018-3823-3
Kaland N, Smith L, Mortensen EL (2007) Response Times of Children and adolescents with Asperger Syndrome on an ‘Advanced’ test of theory of mind. J Autism Dev Disord 37(2):197–209. https://doi.org/10.1007/s10803-006-0152-8
Happé F (1994) An advanced test of theory of mind: understanding of story characters’ thoughts and feelings by able autistic, mentally handicapped, and normal children and adults. J Autism Dev Disord 24(2):129–154. https://doi.org/10.1007/BF02172093
Baron-Cohen S, O’Riordan M, Stone V, Jones R, Plaisted K (1999) Recognition of faux pas by normally developing children and children with Asperger syndrome or high-functioning autism. J Autism Dev Disord 29:407
Baron-Cohen S, Wheelwright S, Hill J, Raste Y, Plumb I (2001) The reading the mind in the eyes test revised version: a study with normal adults, and adults with Asperger syndrome or high-functioning autism. J Child Psychol Psychiat 42(2):241–251
de Villiers J (2007) The interface of language and theory of mind. Lingua 117(11):1858–1878. https://doi.org/10.1016/j.lingua.2006.11.006
Milligan K, Astington JW, Dack LA (2007) Language and Theory of mind: Meta-Analysis of the Relation between Language ability and false-belief understanding. Child Dev 78(2):622–646. https://doi.org/10.1111/j.1467-8624.2007.01018.x
Pyers JE, Senghas A (2009) Language promotes false-belief understanding: evidence from learners of a New sign Language. Psychol Sci 20(7):805–812. https://doi.org/10.1111/j.1467-9280.2009.02377.x
Levy SE, Giarelli E, Lee L-C, Schieve LA, Kirby RS, Cunniff C, Nicholas J, Reaven J, Rice CE (2010) Autism spectrum disorder and co-occurring Developmental, Psychiatric, and medical conditions among children in multiple populations of the United States. J Dev Behav Pediatr 31(4):267. https://doi.org/10.1097/DBP.0b013e3181d5d03b
Langdon R, Coltheart M (1999) Mentalising, schizotypy, and schizophrenia. Cognition 71(1):43–71. https://doi.org/10.1016/S0010-0277(99)00018-9
Payne JM, Porter M, Pride NA, North KN (2016) Theory of mind in children with neurofibromatosis type 1. Neuropsychology 30(4):439–448. https://doi.org/10.1037/neu0000262
Porter MA, Coltheart M, Langdon R (2008) Theory of mind in Williams Syndrome assessed using a Nonverbal Task. J Autism Dev Disord 38(5):806–814. https://doi.org/10.1007/s10803-007-0447-4
Rajkumar AP, Yovan S, Raveendran AL, Russell PSS (2008) Can only intelligent children do mind reading: the relationship between intelligence and theory of mind in 8 to 11 years old. Behav Brain Funct 4(1):51. https://doi.org/10.1186/1744-9081-4-51
Van Rheenen TE, Rossell SL (2013) Picture sequencing task performance indicates theory of mind deficit in bipolar disorder. J Affect Disord 151(3):1132–1134. https://doi.org/10.1016/j.jad.2013.07.009
Piatt C, Coret M, Choi M, Volden J, Bisanz J (2016) Comparing children’s performance on and preference for a number-line estimation Task: Tablet Versus Paper and Pencil. J Psychoeducational Assess 34(3):244–255. https://doi.org/10.1177/0734282915594746
Lane R, Radesky J (2019) Digital Media and Autism Spectrum disorders: review of evidence, theoretical concerns, and opportunities for intervention. J Dev Behav Pediatrics: JDBP 40(5):364–368. https://doi.org/10.1097/DBP.0000000000000664
Bignardi G, Dalmaijer ES, Anwyl-Irvine A, Astle DE (2021) Collecting big data with small screens: group tests of children’s cognition with touchscreen tablets are reliable and valid. Behav Res Methods 53(4):1515–1529. https://doi.org/10.3758/s13428-020-01503-3
Westby C, Robinson L (2014) A developmental perspective for promoting theory of mind. Top Lang Disorders 34(4):362–382
Van Hof ’T, Tisseur M, Van Berckelear-Onnes C, Van Nieuwenhuyzen I, Daniels A, Deen AM, Hoek M, H. W., Ester WA (2021) Age at autism spectrum disorder diagnosis: a systematic review and meta-analysis from 2012 to 2019. Autism 25(4):862–873. https://doi.org/10.1177/1362361320971107
Currie C, Molcho M, Boyce W, Holstein B, Torsheim T, Richter M (2008) Researching health inequalities in adolescents: the development of the Health Behaviour in School-aged children (HBSC) family affluence scale. Soc Sci Med 66(6):1429–1436. https://doi.org/10.1016/j.socscimed.2007.11.024
R Core Team (2022) R: A language and environment for statistical computing [Computer software]. R Foundation for Statistical Computing. https://www.R-project.org/
Rosseel Y (2012) lavaan: An R package for structural equation modeling. J Stat Softw 48(2):1–36. https://doi.org/10.18637/jss.v048.i02
Bates D, Mächler M, Bolker B, Walker S (2015) Fitting Linear mixed-effects models using lme4. J Stat Softw 67(1):1–48. https://doi.org/10.18637/jss.v067.i01
Kuznetsova A, Brockhoff PB, Christensen RH (2017) lmerTest package: tests in linear mixed effects models. J Stat Softw 82:1–26
Lenth R (2022) emmeans: Estimated Marginal Means, aka Least-Squares Means ({R package version 1.8.2}) [Computer software]. https://CRAN.R-project.org/package=emmeans
Crawford JR, Garthwaite PH (2006) Comparing patients’ predicted test scores from a regression equation with their obtained scores: a significance test and point estimate of abnormality with accompanying confidence limits. Neuropsychology 20(3):259–271. https://doi.org/10.1037/0894-4105.20.3.259
Wellman HM (2018) Theory of mind: the state of the art. Eur J Dev Psychol 15(6):728–755. https://doi.org/10.1080/17405629.2018.1435413
Baron-Cohen S (2002) The extreme male brain theory of autism. Trends Cogn Sci 6(6):248–254
Charman T, Ruffman T, Clements W (2002) Is there a gender difference. False Belief Development? Social Development 11(1):1–10. https://doi.org/10.1111/1467-9507.00183
Launay L, Maeder C, Roustit J, Touzin M et al (2018) Évaluation du Langage écrit et du Langage Oral 6-15 ans (EVALEO 6-15). OrthoÉdition 40:43–51
Mercier C, Roche S, Gaillard S, Kassai B, Arzimanoglou A, Herbillon V, Roy P, Rheims S (2016) Partial validation of a French version of the ADHD-rating scale IV on a French population of children with ADHD and Epilepsy. Factorial structure, reliability, and responsiveness. Epilepsy Behav 58:1–6. https://doi.org/10.1016/j.yebeh.2016.02.016
Montemurro S, Daini R, Tagliabue C, Guzzetti S, Gualco G, Mondini S, Arcara G (2022) Cognitive reserve estimated with a life experience questionnaire outperforms education in predicting performance on MoCA: Italian normative data. Curr Psychol. https://doi.org/10.1007/s12144-022-03062-6
Fombonne E (2009) Epidemiology of pervasive developmental disorders. Pediatr Res 65(6):591–598
Baron-Cohen S, Leslie AM, Frith U (1986) Mechanical, behavioural and intentional understanding of picture stories in autistic children. Br J Dev Psychol 4(2):113–125. https://doi.org/10.1111/j.2044-835X.1986.tb01003.x
Binnie L, Williams J (2003) Intuitive psychology and physics among children with autism and typically developing children. Autism 7(2):173–193. https://doi.org/10.1177/1362361303007002005
Baron-Cohen S (2009) Autism: the empathizing–systemizing (E-S) theory. Annals of the New York. Acad Sci 1156(1):68–80. https://doi.org/10.1111/j.1749-6632.2009.04467.x
Zalla T, Labruyere N, Georgieff N (2006) Goal-Directed Action representation in Autism. J Autism Dev Disord 36(4):527–540. https://doi.org/10.1007/s10803-006-0092-3
Chevallier C (2012) Theory of mind and autism: revisiting Baron-Cohen et al.’s Sally-Anne study. Developmental psychology: revisiting the classic studies. Sage Publications Ltd, Thousand Oaks, pp 148–163
Bosco FM, Tirassa M, Gabbatore I (2018) Why pragmatics and theory of mind do not (completely) overlap. Front Psychol. 9https://doi.org/10.3389/fpsyg.2018.01453
Arslan B, Hohenberger A, Verbrugge R (2017) Syntactic recursion facilitates and Working Memory predicts recursive theory of mind. PLoS ONE 12(1):e0169510. https://doi.org/10.1371/journal.pone.0169510
Nilsson KK, De López KJ (2016) Theory of mind in Children with Specific Language Impairment: a systematic review and Meta-analysis. Child Dev 87(1):143–153. https://doi.org/10.1111/cdev.12462
Jurek L, Longuet Y, Baltazar M, Amestoy A, Schmitt V, Desmurget M, Geoffray M-M (2019) How did I get so late so soon? A review of time processing and management in autism. Behav Brain Res 374:112121. https://doi.org/10.1016/j.bbr.2019.112121
Botha M, Hanlon J, Williams GL (2021) Does Language Matter? Identity-first Versus Person-First Language Use in Autism Research: a response to Vivanti. J Autism Dev Disord. https://doi.org/10.1007/s10803-020-04858-w
Bury SM, Jellett R, Spoor JR, Hedley D (2020) “It defines who I am” or “It’s something I have”: What language do [autistic] Australian adults [on the autism spectrum] prefer? J Autism Dev Disord 53:677–687
Acknowledgements
We are to thank all the children who participated to this study, as well as Beynes school (Egletons, France) and Saint-Sacrement school (Lyon, France) which welcomed us despite a COVID context, Caroline Morellet and Isabelle Petit who helped with data collection in Experiment 1, and to Marie-Maude Geoffray as well as to the teams of the Vinatier who helped with the recruitment of the clinical group of Experiment 2. This project was funded by the hospital Le Vinatier and the French Ministry of Health (PHRIP-2018-266).
Funding
This work was supported by funds granted to the first author by the Centre Hospitalier Le Vinatier and the French Ministry of Health (PHRIP-2018-266).
Author information
Authors and Affiliations
Contributions
NP performed conceptualization, funding acquisition, methodology, investigation, analysis, and wrote the original draft. IN performed supervision and writing—review and editing. MB performed writing—review and editing. JP provided resources and performed supervision, writing—review and editing.
Corresponding author
Ethics declarations
Competing Interests
The authors have no competing interests, or other interests that might be perceived to influence the results and/or discussion reported in this paper.
Ethical Approval
All participants of these experiments provided informed consent to participate, as well as their parents. This study was run in accordance with the Declaration of Helsinki and received approval from the local IRB (Comité de Protection des Personnes Sud-Est I, ID RCB 2019-A01721-56).
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Appendix
Appendix
Clinical Vignettes
In order to illustrate how the tablet-PST can be used to provide clinical information, richer than a simple standardized score on a classical task, we extracted three prototypical profiles from our sample.
Participant 1 is a 6-years; 7-months-old boy. His autism diagnosis was confirmed by a positive SCQ and a positive ADOS-2. His level of intelligence functioning was also assessed and is strictly normal. In the tablet-PST, he obtained a GSA of 2.8/6, placing him only at the 1st percentile, given his age and SES. This score indicates that the task itself is not suitable to assess this specific child’s skills. Indeed, the ability of that child to sequence pictures is compromised, maybe due to his young age, to behavioral difficulties and/or to difficulties in sequencing events and representing time which can be observed in certain individuals with autism [66]. If theory of mind must be assessed, it should be done otherwise.
Participant 7 presents a different profile. She is a 7-years; 6-months-old girl, whose autism diagnosis was confirmed by a positive SCQ and a positive ADI-R. Her level of intelligence functioning had not been formally tested, but no difficulties were suspected by the clinicians who follow her, and her language skills were in the normal to normal-superior range. In the tablet-PST, she got a 4.9/6 GSA (71st percentile) but scored 1.5/6 on average on TOM items (3rd percentile). Contrary to participant 1, participant 7 is thus very able to sequence pictures in general, with a GSA that is even in the normal-superior range. However, specific difficulties arise as soon as TOM is involved, where she scores much lower than expected, given her age and her good sequencing abilities. This is indicative of specific difficulties in theory of mind. No particularity was observed in her response times: she answered TOM items in 29 seconds on average, contra 23 seconds for the control items, which places her at percentile 26.
Finally, participant 6 is a 7-years; 6-months-old boy, whose diagnosis was confirmed by a positive ADOS-2 and a positive SCQ. His intelligence was assessed as normal, as well as his language skills. He performed very well with the tablet-PST control items, with a GSA of 5.6/6 (85th percentile), and even better on TOM items with a mean accuracy of 6/6 (94th percentile). This child has no problem in sequencing pictures in general and, given his age and his good GSA, he performs even significantly better than expected with TOM items. However, he took 44 seconds on average to answer items involving false beliefs, contra only 18 seconds on control items: this difference, given his good accuracy, places him only at the 1st percentile. This indicated that participant 6’s good accuracy on TOM items is obtained with unusual effort, in terms of response times, that is specific to items where TOM is involved. This might reflect atypical processing strategies such as compensatory mechanisms specifically associated with mentalizing.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Petit, N., Noveck, I., Baltazar, M. et al. Assessing Theory of Mind in Children: A Tablet-Based Adaptation of a Classic Picture Sequencing Task. Child Psychiatry Hum Dev (2024). https://doi.org/10.1007/s10578-023-01648-0
Accepted:
Published:
DOI: https://doi.org/10.1007/s10578-023-01648-0