Piecing together fragments: Linguistic cohesion mediates the relationship between executive function and metacognition in schizophrenia
Introduction
A cardinal feature of psychosis described by Bleuler (1911) in coining the term “schizophrenia” is a loosening of associations evident in fragmentation of language, thought, and behavior. Language disturbances such as tangentiality, derailment, and illogical speech, often categorized as thought disorder (Andreasen, 1979), have been documented in chronic schizophrenia (Barch and Berenbaum, 1996), early-stage psychosis (Minor et al., 2016), and those at clinical-risk for psychosis (Bearden et al., 2000; Elvevåg et al., 2010). These findings indicate that language disturbances are not purely a function of illness severity and occur across stages of psychosis. Some evidence suggests that impaired executive functioning common to psychotic illness (Heinrichs and Zakzanis, 1998) may hinder the production of cohesive discourse (Kerns and Berenbaum, 2002).
Less is known about how these observable language disturbances relate to interruptions in the ability to synthesize mental experiences and make sense of one's life and challenges. This set of psychological processes, referred to as metacognition, involves an awareness of one's own thoughts and desires and beliefs about other people's mental experiences (Flavell, 1979; Semerari et al., 2003). Metacognitive impairment may be a fundamental source of the disruptive symptoms in psychotic illness (Lysaker and Klion, 2017). Individuals with compromised metacognitive capacity may perceive their thoughts to be disjointed and the actions of others to be random, manifesting in a disorienting existence devoid of agency. Lower metacognitive capacity in psychosis has been associated with greater concurrent and prospective negative symptoms (Hamm et al., 2012), higher levels of anhedonia (Buck et al., 2014), lower levels of functional competence (Lysaker et al., 2011), and a more sedentary lifestyle (Snethen et al., 2014). While the etiology of metacognitive deficits is multifaceted, one potential source is impaired executive functioning. If one is unable to fluidly shift their attention, monitor thoughts and actions, and inhibit inappropriate or irrelevant behaviors, piecing together complex information to form a coherent sense of self may be challenging. Research suggests that executive function deficits may contribute to impairments in metacognition (Lysaker et al., 2008) and related abilities of perspective-taking (Long et al., 2018; Wardlow, 2013) and theory of mind (Wade et al., 2018). However, researchers have yet to examine whether impaired executive function leads to metacognitive deficits in psychosis by way of producing fragmented speech.
One explanation for this knowledge gap is that discourse studies have historically used manual hand-coding systems that are unable to characterize deeper semantic structures. Recent technological advances offer new ways to measure the relationship between language disturbances and metacognition in psychosis. In particular, computational linguistic approaches enable objective and comprehensive depictions of underlying syntactic and semantic cohesion (Cabana et al., 2011; Cohen and Elvevåg, 2014). Studies employing Latent Semantic Analysis (Landauer and Dumais, 1997) and graph theoretic techniques (De Deyne et al., 2013, De Deyne et al., 2016) have found decreased semantic coherence (Elvevåg et al., 2007) and connectedness (Mota et al., 2017) in the discourse of individuals with psychosis relative to healthy individuals. Automatic classification analyses using linguistic indices have accurately distinguished discourse between individuals with schizophrenia and controls (Corcoran et al., 2018; Elvevåg et al., 2007; Mota et al., 2017; Strous et al., 2009; Willits et al., 2018), unaffected first-degree relatives (Elvevåg et al., 2010), and individuals experiencing mania (Mota et al., 2012). Computational linguistic approaches have also accurately predicted psychosis onset (Bedi et al., 2015; Corcoran et al., 2018) as well as explained greater variance and predicted diagnosis better than clinician-rated scales (Minor et al., 2019; Mota et al., 2012). Fine-grained characterization of discourse via automated techniques may aid in revealing semantic structures related to disordered thought and integration of complex information in psychosis.
Computational tool Coh-Metrix (McNamara et al., 2014) produces an array of indices that measure complex discourse structures. One Coh-Metrix study found decreased deep cohesion, or causal and goal-driven connecting phrases, in individuals with schizophrenia compared to an adversity-matched comparison group of HIV positive individuals (Willits et al., 2018). This supports findings of an impaired sense of agency in psychosis (Jeannerod, 2009; Synofzik et al., 2010) given that deep cohesion in part measures one's connections between intentional events and actions. Discourse analyses have also assessed word and theme overlap as a measure of referential cohesion, thought to aid the reader/listener by repeating parts of speech. A Coh-Metrix study found that individuals at ultra-high risk (UHR) for psychosis had reduced referential cohesion in the form of word stem overlap compared to controls (Gupta et al., 2018), aligning with prior work in thought disorder using hand-coded techniques (Harvey, 1983). This reduction in referential cohesion correlated with higher psychotic symptoms and lower verbal learning in the UHR group. Studies have also found reduced lexical diversity, or usage of unique words, in the discourse of individuals with thought disorder compared to controls and patients without thought disorder (Manschreck et al., 1981, Manschreck et al., 1984). Interestingly, however, referential cohesion and lexical diversity are inversely related (McNamara et al., 2014). A potential explanation for findings of impairments in both indices in psychosis across studies is that word repetition due to thought-disordered perseveration may impede effective communication, whereas intentional lexical repetition aids in connecting relevant threads for the listener (Crider, 1997). Collectively, these findings catalyzed our investigation as to whether particular discourse structure abnormalities in psychosis hinder one's ability to integrate thoughts and affect.
In the present study, we assessed the relationship between metacognition, executive function, and linguistic cohesion in individuals with schizophrenia-spectrum disorders. We measured metacognition using the Metacognition Assessment Scale – Abbreviated (MAS-A; Lysaker and Klion, 2017; Lysaker et al., 2019) based on narratives from the Indiana Psychiatric Illness Interview (IPII; Lysaker et al., 2002). We used the Delis-Kaplan Executive Function System (D-KEFS; Delis et al., 2001) to measure executive function and formed sub-components of inhibition, monitoring, and conceptual flexibility (Hecht and Latzman, 2018; Latzman and Markon, 2010). We analyzed linguistic cohesion in the rich discourse sample provided by the IPII with the Coh-Metrix tool (McNamara et al., 2014). Based on prior research outlined above, we selected three linguistic indices that measure logical and intentional connections within speech (deep cohesion), content overlap (referential cohesion), and unique word usage (lexical diversity). For data analysis, we performed correlations followed by path analyses to test whether linguistic cohesion mediated the relationship between executive function and metacognition.
Our central hypothesis was that higher executive function promotes greater metacognitive capacity through altering linguistic cohesion. In other words, we predicted that greater abilities to shift, inhibit, and monitor behavior enable the production of coherent discourse, which in turn supports the integration of complex information about oneself, others, and the world. This prediction is supported in part by evidence suggesting that executive functioning is associated with the ability to form organized and coherent narratives. A meta-analysis examining cognitive impairments in schizophrenia found consistent positive associations between thought disorder and executive function, particularly the abilities to inhibit and maintain goal-relevant content in memory (Kerns and Berenbaum, 2002). Executive function deficits may be particularly related to disjointed speech rather than incorrect language usage in general. This idea is supported by findings that impaired ability to sequence information in individuals with schizophrenia predicted failures to make explicit connections between words or phrases but not the frequency of incorrect or unclear wording (Docherty et al., 2006). Some researchers have posited that reduced working memory capacity in psychosis may lead to distinct types of speech disturbances in different individuals. For example, one study found an inverse relationship between reduced speech production and discourse abnormalities such as tangentiality and derailment in schizophrenia (Barch and Berenbaum, 1997). The authors theorized that reduced working memory resources could either lead an individual to produce less speech yet maintain coherence, or produce more speech but fail to monitor speech content. Developmental evidence in children suggests that the abilities to structure coherent narratives and utilize executive functions support one another over time. In particular, one study found that formation of organized narratives predicted future response inhibition and was predicted by prior attentional capacity (Friend and Bates, 2014). In sum, these findings suggest that capacities to flexibly monitor, inhibit, and update one's thoughts and actions to accomplish tasks promote the maintenance and planning of effective communication.
Additional support for our hypothesis includes preliminary findings that executive function and linguistic cohesion predict metacognitive abilities. One study found that the metacognitive capacity to reflect upon one's own thoughts positively correlated with mental flexibility, whereas awareness of others' thoughts correlated with inhibition (Lysaker et al., 2008). Other studies found positive associations between working memory, inhibition, and switching with perspective-taking, an important facet of metacognition that allows one to distinguish between one's own thoughts and the thoughts of others (Long et al., 2018; Wardlow, 2013). Lastly, studies have found that lexical measures indicative of thought complexity predicted overall metacognitive capacity (Buck et al., 2015; Minor et al., 2019). Overall, we sought to examine whether abilities to flexibly monitor and inhibit behavior (i.e., executive function) support the capacity to derive meaning from mental experiences (i.e., metacognition) by way of increasing coherent speech (i.e., linguistic cohesion) in schizophrenia.
Section snippets
Participants
Data from the present study were collected from 94 outpatients diagnosed with schizophrenia (n = 54) or schizoaffective disorder (n = 40) at a midwestern VA Medical Center. Participants included 12 females and 82 males aged 31–74 years old (mean [M]: 58.28, standard deviation [SD]: 8.6) with 7–18 years of education (M = 12.73, SD = 1.8). Fifty participants identified as African American (53%), 43 as Caucasian (46%), and one participant identified as Hispanic or Latino (1%). Most participants
Descriptive statistics and associations between study variables
Means, standard deviations, and ranges of MAS-A, Coh-Metrix, and D-KEFS raw scores are presented in Table 1. Spearman correlations are presented in Table 2. To summarize, deep cohesion and lexical diversity were weakly to moderately positively correlated with most MAS-A subscales. Deep cohesion was positively correlated with inhibition and monitoring components of executive function, whereas lexical diversity was positively correlated with conceptual flexibility. Referential cohesion negatively
Discussion
Results of this study support the hypothesis that the formation of causal and goal-driven connections and lexical diversity independently mediate the relationship between executive function and metacognition among individuals with schizophrenia-spectrum disorders. In addition, we found that deep cohesion significantly correlated with inhibition and monitoring, whereas lexical diversity correlated with conceptual flexibility. Lastly, we found that referential cohesion did not significantly
Contributors
Dr. Lysaker designed the protocol and oversaw data collection. Ms. Lundin and Dr. Hochheiser conceptualized the hypotheses, conducted statistical analyses, and interpreted the data. Ms. Lundin wrote the first draft of the manuscript. Dr. Minor, Dr. Hetrick, and Dr. Lysaker helped to conceptualize the study, interpret data, and contributed to the manuscript.
Role of funding source
This work was supported in part by an Indiana University Collaborative Research Grant, National Science Foundation Graduate Research Fellowship Program (1342962 to NBL), and National Institutes of Health T32 (MH103213 to WPH and NBL).
Declaration of competing interest
All authors declare that they have no conflicts of interest.
Acknowledgement
We would like to acknowledge and thank the staff and clients at the Roudebush VA Medical Center in Indianapolis, IN.
References (63)
- et al.
The effect of language production manipulations on negative thought disorder and discourse coherence disturbances in schizophrenia
Psychiatry Res.
(1997) - et al.
Anhedonia in prolonged schizophrenia spectrum patients with relatively lower vs. higher levels of depression disorders: associations with deficits in social cognition and metacognition
Conscious. Cogn.
(2014) - et al.
Differential lexical correlates of social cognition and metacognition in schizophrenia; a study of spontaneously-generated life narratives
Compr. Psychiatry
(2015) - et al.
Detecting order–disorder transitions in discourse: implications for schizophrenia
Schizophr. Res.
(2011) - et al.
Schizophrenia and the structure of language: the linguist's view
Schizophr. Res.
(2005) - et al.
Rich semantic networks applied to schizophrenia: a new framework
Schizophr. Res.
(2016) - et al.
Quantifying incoherence in speech: an automated methodology and novel application to schizophrenia
Schizophr. Res.
(2007) - et al.
An automated method to analyze language use in patients with schizophrenia and their first-degree relatives
J. Neurolinguistics
(2010) - et al.
Automated analysis of written narratives reveals abnormalities in referential cohesion in youth at ultra high risk for psychosis
Schizophr. Res.
(2018) - et al.
Individual differences in switching and inhibition predict perspective-taking across the lifespan
Cognition
(2018)
Metacognition and social function in schizophrenia: associations of mastery with functional skills competence
Schizophr. Res.
Evidence of disturbances of deep levels of semantic cohesion within personal narratives in schizophrenia
Schizophr. Res.
Thought, language, and communication disorders: I. Clinical assessment, definition of terms, and evaluation of their reliability
Arch. Gen. Psychiatry
Thought, language, and communication in schizophrenia: diagnosis and prognosis
Schizophr. Bull.
Language production and thought disorder in schizophrenia
J. Abnorm. Psychol.
A prospective cohort study of childhood behavioral deviance and language abnormalities as predictors of adult schizophrenia
Schizophr. Bull.
Automated analysis of free speech predicts psychosis onset in high-risk youths
NPJ Schizophr.
The categorization of thought disorder
J. Psycholinguist. Res.
Dementia Praecox or the Group of Schizophrenias
Automated computerized analysis of speech in psychiatric disorders
Curr. Opin. Psychiatry
Can RDoC help find order in thought disorder?
Schizophr. Bull.
Prediction of psychosis across protocols and risk cohorts using automated language analysis
World Psychiatry
Perseveration in schizophrenia
Schizophr. Bull.
Better explanations of lexical and semantic cognition using networks derived from continued rather than single-word associations
Behav. Res. Methods
Delis-Kaplan Executive Function System
The cognitive origins of specific types of schizophrenic speech disturbances
Am. J. Psychiatry
An examination of the language construct in NIMH’s research domain criteria: time for reconceptualization!
Am. J. Med. Genet. B Neuropsychiatr. Genet.
Structured Clinical Interview for DSM-IV-TR Axis I Disorders, Research Version, Patient Edition (SCID-I/P)
Metacognition and cognitive monitoring: a new area of cognitive–developmental inquiry
Am. Psychol.
The union of narrative and executive function: different but complementary
Front. Psychol.
Coh-Metrix: providing multilevel analyses of text characteristics
Educ. Res.
Cited by (17)
Meta-analysis of the relationship between metacognition and disorganized symptoms in psychosis
2024, Schizophrenia ResearchThe organization of construal networks and functional adaptation
2023, New Ideas in PsychologyLinguistic markers of demoralization improvement in schizophrenia: A pilot study
2023, European Journal of PsychiatryMild vs. moderate: How behavioral speech measures predict metacognitive capacity across different levels of formal thought disorder
2023, Journal of Psychiatric ResearchCitation Excerpt :These indices were chosen based upon a principal components analysis which showed that these five indices accounted for 54% of the variability in a corpus of language arts, social studies, and science texts (Graesser et al., 2011). Deep cohesion and referential cohesion have previously been linked to metacognition (Lundin et al., 2020; Minor et al., 2019). In addition to these indices, a Coh-Metrix composite score was computed by averaging the standardized scores of the five indices.