Skip to main content

PERSPECTIVE article

Front. Psychiatry, 10 October 2022
Sec. Neuroimaging
This article is part of the Research Topic Rising Stars in Neuroimaging and Stimulation 2022 View all 5 articles

Perspectives before incremental trans-disciplinary cross-validation of clinical self-evaluation tools and functional MRI in psychiatry: 10 years later

  • Department of Psychiatry and Medical Psychology and Research Institute, Plovdiv Medical University, Plovdiv, Bulgaria

Translational validity (or trans-disciplinary validity) is defined as one possible approach to achieving incremental validity by combining simultaneous clinical state-dependent measures and functional MRI data acquisition. It is designed under the assumption that the simultaneous administration of the two methods may produce a dataset with enhanced synchronization and concordance. Translational validation aims at “bridging” the explanatory gap by implementing validated psychometric tools clinically in the experimental settings of fMRI and then translating them back to clinical utility. Our studies may have identified common diagnostic task-specific denominators in terms of activations and network modulation. However, those common denominators need further investigation to determine whether they signify disease or syndrome-specific features (signatures), which, at the end of the day, raises one more question about the poverty of current conventional psychiatric classification criteria. We propose herewith a novel algorithm for translational validation based on our explorative findings. The algorithm itself includes pre-selection of a test based on its psychometric characteristics, adaptation to the functional MRI paradigm, exploration of the underpinning whole brain neural correlates in healthy controls as compared to a patient population with certain diagnoses, and finally, investigation of the differences between two or more diagnostic classes.

Introduction

The issue of validity and validation in psychiatry (2013, 2014, and 2015).

The validity of psychiatric diagnosis and nosology was considered a major source of controversy in the past decade (14). The critical approaches to the nosological structure of psychiatry are grounded in epistemological concerns about its conventional origins, whereas most other medical disciplines usually triangulate diagnostic constructs upon molecular, pathophysiological, and imaging biomarkers to co-produce robust criteria to sustain diagnosis at the nosological level (5). The continuous failure of neuroscience and neurobiology to deliver such fingerprints of disease, relatively independent from clinical observations, is seen as one of the possible limitations of the existing classification systems (6). It becomes evident that those nosological systems are highly inconsistent regardless of the number of revisions since 1989 (7). This is further complemented by the replication crisis in the field of functional MRI, both when it comes to normal populations and patient samples. In addition, as a major caveat, it is assumed to be the mono-disciplinary structure of the different evaluation methods emerging in two discrepant fields of knowledge. In other words, research studies are either performed by means of stringent functional MRI experimental tasks or by means of psychometric assessment rating scales separately (8). However, those two groups of methods are essentially divergent, separated by the so-called explanatory gap. They belong to two discrete disciplinary and nomothetic systems, which have limited resources for translation from one to the other. There are minimal attempts to unite them into the same toolkit, as discussed in the next sections.

Trait (state-independent) measures: A case study on TCI-r

State-independent (trait) measures are widespread in psychopathology, especially in the definition and study of the mechanisms underlying endophenotypes. They are convenient, as long as the test-retest stability of the construct measures is established, and are usually performed in independent time slots from neuroimaging studies. Various correlations of such dimensions have been reported, e.g., harm avoidance and self-directedness with fMRI and magnetic resonance spectroscopy (MRS) (911). However, the visual stimuli employed in functional MRI are not derived from the inventory itself but represent visualizations designed for the imaging data acquisition supposedly related indirectly to the trait construct in question.

State-dependent measures: What is clinically relevant?

Despite the advances in the construction of endophenotypes, most of the clinical conditions in psychiatry are state-dependent, with many confounds pertinent to time-of-the-day dynamics, especially for affective disorders (3). This factor has also been acknowledged as a general concern in functional neuroimaging. Hemodynamic response function in the resting state is also influenced by the time-of-the-day fluctuations of the BOLD signal (see Vaisvilaite et al. (12) for more details). Those are certainly even more implicated as a potential caveat in task-related measures. Therefore, one underestimated challenge would be better synchronizing the state-dependent tests with functional MRI data acquisition (13). Nevertheless, the entire field seems to overlook the state-dependent tests as more difficult to adapt and interpret in fMRI paradigms and to provide retest stability to ensure robust replications.

Incremental validity

Another unresolved issue remains incremental validity in psychometric studies (2). There are many conceptual concerns raised about the conventional definitions of validity in mental health disciplines (14). Incremental validity is usually achieved in two ways. Increasing the number of scale items or increasing the Likert scale from 5 to 7 degrees would be examples of intra-correlation. However, it is intra-correlative as long as the reported correlations are measured within the same disciplinary domain, here, the psychometrics domain.

The other way to address incremental validity is by adding external inter-correlative tests, which consistently explore independent indexes from other disciplinary domains (such as functional neuroimaging or sociological measures, for instance), which converge upon a given psychometric construct. On the other hand, neuroimaging studies tend to establish validity in a hypothesis-driven fashion; this suggests that a priori hypothesis about implicated functional brain regions of interest (ROI) (modules, networks) and their modulation are entered as variables into a model to be tested under experimental conditions. More or less naturalistic stimuli (proximal to everyday environmental demand and clinical assessment methods) and contextual factors are ignored to grant control of the experimental settings. This experimental control narrows the validity of the implemented fMRI tasks and produces decontextualized, rigid data with poor replicability and generalizability outside the specific experimental environment. This is a prototype of provisionally speaking, “decremental” validity—the opposite of incremental—which delivers “sterile” results with limited possibilities to translate research findings into clinical practice.

Both contemporary neuroimaging and psychopathology aim at incremental validity within their own disciplinary domains, and any potential cross-validation measures are estimated post-hoc.

Translational validity and fMRI

Translational validity (or trans-disciplinary validity) is defined as one possible approach to incremental validity combining simultaneous clinical state-dependent measures and functional MRI data acquisition (3, 15). It is designed under the assumption that the simultaneous administration of the two methods may produce a dataset with enhanced synchronization and concordance (4). Translational validation aims at “bridging” the explanatory gap by implementing validated psychometric tools clinically in the experimental settings of fMRI and then translating them back to clinical utility. This is required to deliver the meta-language of psychiatry, which may combine and transcend the diverse disciplinary languages involved in psychiatry (3). The sections below outline the contributions of different groups supporting this concept.

Advances in the field from 2010–2020

Studies with cognitive tests in healthy populations: Raven test

Progressive matrices, non-verbal intelligence tests by Raven, were among the first psychometric tools implemented for functional MRI in 2001 (16). More precisely, selected progressive matrices have been adapted as stimuli to yield activations in the dorsolateral prefrontal cortex during reasoning. Without explicit aim at validating Raven's test with fMRI, the authors have discovered by implication specific neuro-correlates that underpin relational complexity (2-relational vs. 1-relational) problems of the Raven matrices. Unfortunately, the sample size was too small (a total of ten subjects) to draw any robust inference from that study. Further studies (17) also reported using Raven's test to assess the involvement of the postero-lateral prefrontal cortex in relational processing from a developmental perspective.

Studies with other cognitive tests in normal populations and disease-specific applications

One successful adaptation of clinically relevant tests to the context of fMRI is the application of the paced auditory serial addition test, initially in normal samples and then in a sample of patients with neurological disorders (18). The test was initially set for auditory stimuli and then adapted to visual for the functional MRI paradigm. Activations include the left prefrontal cortex, bilateral cingulate gyrus, left inferior parietal lobule, among others (in healthy controls), and left supra-marginal gyrus in patients with remitting multiple sclerosis and a certain level of cognitive decline (19, 20). Besides, Forn and his associates also implemented the widely used Symbol-Digit-Modalities test (SDMT), with frontal and parietal areas involved in the performance (21). The same test has many implications for clinical practice, especially in evaluating cognitive deficits in neurodegenerative disorders and multiple sclerosis (22). The Sternberg memory test (23) is also compatible with functional MRI settings.

Studies with affective tests: The Rorschach test and complex social-affective tests

Of the affective tests (a.k.a. projective methods), one of the most commonly used in clinical and expert evaluation is the inkblot test of Rorschach. It has also been adapted to the functional MRI paradigm (2426), with the more explicit goal of revealing the BOLD signal underlying the psychological test responses. Various task-specific regions are reported outside the visual processing and dorsal attention network systems, which are apparently task-non-specific. Interestingly, sub-cortical areas of the limbic system are involved. Compared with neutral pictures, pictures from the thematic-apperception test have also been adapted for functional MRI since 2006, especially in the study of personality disorders (27).

Studies with the word association test by CG Jung

Most interesting studies have emerged since 2013 with attempts to determine the functional MRI patterns behind Carl Gustav Jung's Word Association Test. In the 2018 study by Escalimilla and associates (28), the authors recorded two subsequent sessions with WAT on video. They identified the complex-triggering words on the individual level by evaluating verbal and non-verbal behavior and indexing certain reactions as relevant or signifying unconscious relevance to complexes. Then, the same words were presented during the fMRI session in active blocks, alternating with supposedly neutral blocks from the same word set. Authors have applied the group independent component analysis for the fMRI toolbox and identified two brain circuits that correlate with the “complex” words. Those were named “memory, body, and action (circuit 1) and memory, emotion, language, and meaning (circuit 2) and are activated during the processing of complex-triggering words. The authors followed a predominantly explorative approach without a specific preliminary hypothesis on the regions of interest (ROIs) to set boundaries for their analysis. In this way, they, in fact, followed and managed to replicate earlier studies on WAT by Petckovsky (29, 30).

Our contributions, 2017–2022

Depression scale

Our group has studied the blood-oxygenation-level-dependent (BOLD) signal associated with simultaneous administration of the depression scale by Von Zerssen (31, 32). The scale was selected for various clinical and experimental reasons. The clinical arguments are that it captures in a clear, concise, and condensed form the depressive self-reported symptoms, as opposed to the paranoid syndrome, two of the most common clinical states in clinical practice. The experimental rationale was that the items had a relatively low cognitive load (as compared to the Beck Depression Inventory, for instance) and were, therefore, more likely to correspond to the “phenomenological core” of depression rather than one of its dimensions, namely the cognitive impairment. The items from the scale were constructed in four blocks and alternated against blocks of diagnostically neutral items, thus constituting an interest scale. Those were administered to two groups: patients with a major depressive episode and healthy controls. The results from direct comparison yielded significant residual activation clusters in the middle frontal gyrus after family-wise error correction. This result may indicate that the high depression score in terms of self-evaluation corresponds to a specific pattern of brain activation, which is also related to dysfunctional connectivity of the same region at rest (32, 33).

Paranoid-depression scale (PD-S)

In order to further outline the core depressive symptoms from other common psychopathological conditions, we have expanded the paradigm by including the paranoid items from the paranoid-depressive scale by von Zerssen (3436). The selection of the scale was based on similar assumptions as described above. It was then administered simultaneously with a functional MRI session to two groups of patients: depression and schizophrenia groups. The results demonstrated significant residual activations in the precuneus and angular gyrus areas, which were considered diagnostically relevant (37). Those activations are considered to be in the default mode network, which means that there is essentially an aberrant activation in that system in schizophrenia (32, 33, 38). In such a way, we have attempted to integrate the two methods: the clinical self-assessment scale and functional MRI, with the intention of achieving incremental trans-disciplinary validity of both methods.

Multivariate analysis (MLM) of PD-S; structural and resting-state functional MRI

As a next step, we have a machine learning methodology to investigate brain signatures behind item responses on different scales (3436). There were discovered with the multivariate linear method (MLM) in the same data set whole brain signatures behind the item responses on the scales, identified as “clinical loadings.” The positive load of paranoid and neutral items and negative on depression items were correlated with a brain signature, which was able to predict the clinical diagnosis up to 93% (area under the curve).

IAPS and MLM on IAPS

In other studies of our group, we have identified task-specific activation patterns in the right middle temporal gyrus in patients during the processing of positive compared to neutral images from the International Affective Pictures System (IAPS) (39, 40). Brain signatures were identified using MLM, which can predict with high accuracy the diagnosis. From a certain perspective, IAPS may be considered as a proxy task for projective tests, such as TAT, which is capable of evaluating affectivity in mental disorders (41).

Stroop n-back test

Our group has recently investigated the functional MRI underpinnings of the Stroop n-back color and word test (SCWT) in depression (42). It is designed to capture basic components of attention by measuring the subject's performance while processing congruent and non-congruent color-word stimuli. Attentional deficits are among the common psychopathological features of depression. On a direct comparison of depressed patients with control subjects, there have been reported deactivations of the lingual and fusiform gyrus in patients as the complexity of the task is increased on color versus word conditions.

To summarize our findings in 2008–2022, we have implemented three major groups of clinical evaluation tools in the context of functional neuroimaging: self-evaluation scales, a proxy for projective testing, and a cognitive assessment test. Each of those psychometric tools has produced differential activations or brain signatures, which are illustrated in Figure 1.

FIGURE 1
www.frontiersin.org

Figure 1. A plot of the differential activations under the simultaneous administration of psychometric tools: the depressive Scale (hot), the paranoid Scale (cool), the Stroop Color, and the Word Test (pink).

In turn, those patterns of brain activations and connectivity aberrations may underpin respective translational cross-validation procedures between the two inquiry methods: clinical assessment and functional MRI, as presented in Figure 2.

FIGURE 2
www.frontiersin.org

Figure 2. The main convergent validity (green arrows) and divergent validity (red arrows) are outlined to discriminate on an incremental level between two major prototypes of mental disorders—major depressive episodes and schizophrenic psychosis.

Discussion

From the perspective of translational cross-validation, there are numerous important factors to consider.

The first consideration is the involvement of the non-specific task-positive (effort mode) network (43).

In 2015, Kenneth Hugdahl assumed that there exists a task-non-specific effort-mode network in the brain with fronto-temporo-parietal distribution, including inferior and middle frontal gyrus, inferior temporal gyrus, supplementary motor area, and inferior parietal lobule. However, later, Hugdahl states that this extrinsic-mode network is modulated by the nature of the task, namely the extent of the cognitive effort invested (4446). This hypothesis is further expanded to analyze the dynamic down-regulation of EMN and upregulation of particular regions of the default mode network, such as precuneus, under varying levels of cognitive effort in different psychiatric conditions. As described in the previous sections, the authors do not comment on affective and social-affective tasks, such as Rorschach and TAT. Therefore, their conclusion is limited to cognitive tasks/tests as related, incorporated in fMRI paradigms. In that regard, our results with the depression scale may indicate task-specific modulation of the effort-mode network in terms of up-regulation. This upregulation may well-be explained by the elevated effort invested in the task by the depressed patients. For the paranoid scale, our results may reflect task-specific upregulation of the default mode network in a more complex system of interactions with the salience network that, in effect, leads to aberrant or proximal salience, which can explain most of the positive symptoms in patients with schizophrenia (32, 33). In both measures, the reported effects may be interpreted either as diagnostic-test-specific activations or as modulation effects.

The second consideration comes from the critical paper by the Elliott et al. (47) on the poor test-retest reliability of the common fMRI tasks. In that meta-analysis, pre-defined regions of interest (ROIs), based on an a-priori hypothesis, are regarded as a potential caveat, which may determine stringent results, but with poor replicability and limited generalizability. It is evident from this meta-analysis that no particular localization but distributed network interactions are implicated in the mechanisms of mental disorders. Therefore, whole-brain signatures of disease as an alternative to ROI-reporting are proposed as future directions. (47). We have adopted in our studies precisely a whole-brain reporting approach.

The third consideration, also in line with the same publication, is a movement away from pure “experimental” to rather more naturalistic stimuli and tests with established psychometric utility (47). Currently, use is specifically designed for experimental control “stimuli,” which are far from real-life and clinical settings and contexts. They do not provide any insights or interpretations beyond experimental settings. Therefore, it is difficult to translate them into clinical utility. Instead, we suggest adopting more robust psychometrical tools in fMRI research under the explicit aspiration of trans-disciplinary validation. In this perspective, clinical self-evaluation tools are assumed as proximal measures of diagnostic task-specific whole-brain functional MRI fingerprints/biological signatures of the clinical condition (state, syndrome), where the two methods cross-validate each other.

In fact, psychological tests and fMRI are noisy measures that are not quantifiable on a large scale, with extensive inter-individual and intra-individual variations. There is no commonly defined “gold standard,” no orientation on how you decide which measures are more valid and more realizable in a case when the two happen to be discrepant. By intuition, one may believe that brain imaging measures are more “objective” and thereby more reliable, but they are as biased as the presumably “subjective” psychological rating scales. Therefore, only the intersection or concordance of the two measures may be regarded as possible evidence for their convergent validity.

Besides, social disability and quality of life outcome measures may be considered possible approaches for external validation of clinical evaluation.

A hybrid design is recommended to combine characteristics of clinically relevant scales and tasks tailored to measure meaningful responses in the brain signals with psychological scale items relevant to the phenomenological core of the syndrome repeated from various perspectives to enhance the BOLD signal. This approach resembles the application of a contrast agent to enhance the image in angiography in interventional medicine. At the next level, the multi-scale variables, including several others, e.g., molecular pathway measures, should be integrated to construct a nomothetic network in psychiatry (36).

Conclusion and future directions

Our studies may have identified common diagnostic task-specific denominators in terms of activations and network modulation at the level of fMRI. However, those common denominators need further investigation to determine whether they signify disease or syndrome-specific features (signatures), which, at the end of the day, raises one more question about the poverty of current conventional psychiatric classification criteria (6). In this study, we propose a novel algorithm for translational validation based on our explorative findings.

The algorithm includes five steps, as described in more detail in Figure 3: The first one is the pre-selection of a test based on its psychometric characteristics; this suggests that the tool needs to be valid in terms of its ability to distinguish groups by assessment of relevant states or traits in clinical reality. The next step is the adaptation of the test items to a functional MRI paradigm with standardized digital software (e.g., E: Prime). What is critical at this stage is the construction of contrasting blocks of repeated diagnostic stimuli, which may generate a strong enough BOLD third signal; this step includes exploration of the correlation with the diagnostic item responses (scales) of whole brain neural activations in healthy controls as compared to a patient population with a certain diagnosis. The final step is an investigation of the differences between two or more diagnostic classes.

FIGURE 3
www.frontiersin.org

Figure 3. The algorithm of translational cross-validation.

If we manage to translate a sufficient number of tests from psychometrics to functional MRI, this may provide a potentially powerful toolkit for more reliable diagnosis, prognosis, and management of neuropsychiatric disorders, especially if incorporated into broader nomothetic networks, as mentioned above. Further test-retest independent cross-validation needs to follow these explorative findings.

Data availability statement

The original contributions presented in the study are included in the article/supplementary material, further inquiries can be directed to the corresponding author/s.

Author contributions

The author confirms being the sole contributor of this work and has approved it for publication.

Conflict of interest

The author declares that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

1. Kendler KS, Parnas J. Philosophical Issues in Psychiatry. IV, Classification of psychiatric illness. Oxford: Oxford University Press (2017). doi: 10.1093/med/9780198796022.001.0001

CrossRef Full Text | Google Scholar

2. Zachar P. Is incremental validity too incremental in the long run? A commentary on Stoyanov D, Machamer PK, Schaffner KF. J Evaluat Clin Pract. (2012) 18:149–54 doi: 10.1111/j.1365-2753.2011.01796.x

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Stoyanov D, Stanghellini G, Broome M. Conceptual issues in psychiatric neuroimaging: an update. Curr Top Med Chem. (2012) 12:2348–56. doi: 10.2174/156802612805289836

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Stoyanov DS, Stieglitz RD, Lenz C, Borgwardt S. The translational validation as novel approach to intergration of neuroscience and psychiatry. (2015). Available at: http://edoc.unibas.ch/40574/

Google Scholar

5. Stoyanov D, Machamer P, Schaffner KF. In Quest for Scientific Psychiatry: Toward Bridging the Explanatory Gap. Philoso Psych Psychol. (2013) 20:261–73. doi: 10.1353/ppp.2013.0041

CrossRef Full Text | Google Scholar

6. Vincenzo D, Nicola, Stoyanov, D, Springerlink Online Service. Psychiatry in Crisis: At the Crossroads of Social Sciences, the Humanities, and Neuroscience. Cham: Springer International Publishing, Imprint Springer (2021). doi: 10.1007/978-3-030-55140-7

CrossRef Full Text | Google Scholar

7. Nordgaard J, Jessen K, Sæbye D, Parnas J. Variability in clinical diagnoses during the ICD-8 and ICD-10 era. Social Psychiatry and Psychiatric Epidemiology. (2016) 51:1293–9. doi: 10.1007/s00127-016-1265-9

PubMed Abstract | CrossRef Full Text | Google Scholar

8. St. Stoyanov D, Machamer PK, Schaffner KF. Rendering clinical psychology a evidence-based scientific discipline: a case study. J Eva Clin Pract. (2011) 18:149–54. doi: 10.1111/j.1365-2753.2011.01795.x

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Yoshino A, Okamoto Y, Sumiya Y, Okada G, Takamura M, Ichikawa N, et al. Importance of the habenula for avoidance learning including contextual cues in the human brain: a preliminary fMRI study. Front Human Neurosc. (2020) 14:165. doi: 10.3389/fnhum.2020.00165

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Squarcina L, Delvecchio G, Nobile M, Mauri M, Madonna D, Bonivento C, et al. The assertive brain: anterior cingulate phosphocreatine plus creatine levels correlate with self-directedness in healthy adolescents. Front Psych. (2019) 10:763. doi: 10.3389/fpsyt.2019.00763

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Paulus MP, Rogalsky C, Simmons A, Feinstein JS, Stein MB. Increased activation in the right insula during risk-taking decision making is related to harm avoidance and neuroticism. NeuroImage. (2003) 19:1439–48. doi: 10.1016/S1053-8119(03)00251-9

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Vaisvilaite L, Hushagen V, Grønli J, Sprecht K. Time-of-day effects in resting-state fMRI: changes in effective connectivity and bold signal. Brain Connect. (2021) 54:8571. doi: 10.1101/2020.08.20.258517

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Specht, K. (2020). Current challenges in translational and clinical fMRI and future directions. Front Psychiatry 10:924. doi: 10.3389/fpsyt.2019.00924

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Zachar P, Stoyanov, D, Aragona, M, Zhablenski AV. Alternative Perspectives on Psychiatric Validation: DSM, ICD, RDoC, and beyond. Oxford: Oxford University Press (2015). doi: 10.1093/med/9780199680733.001.0001

CrossRef Full Text | Google Scholar

15. Todeva-Radneva A, Paunova R, Kandilarova, S, Stoyanov, D. The value of neuroimaging techniques in the translation and transdiagnostic validation of psychiatric diagnoses - selective review. Curr Topics Med Chem. (2020) 20:540–53. doi: 10.2174/1568026620666200131095328

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Christoff K, Prabhakaran V, Dorfman J, Zhao Z, Kroger JK, Holyoak KJ, et al. Rostrolateral prefrontal cortex involvement in relational integration during reasoning. NeuroImage. (2001) 14:1136–49. doi: 10.1006/nimg.2001.0922

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Crone EA, Wendelken C, van Leijenhorst L, Honomichl RD, Christoff K, Bunge SA. Neurocognitive development of relational reasoning. Develop Sci. (2009) 12:55–66. doi: 10.1111/j.1467-7687.2008.00743.x

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Audoin B, Ibarrola D, Duong MVA, Pelletier J, Confort-Gouny S, Malikova I, et al. Functional MRI study of PASAT in normal subjects. Mag Res Mat Physics Biol Med. (2005) 18:96–102. doi: 10.1007/s10334-004-0098-9

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Iancheva D, Trenova AG, Terziyski K, Kandilarova S, Mantarova S. Translational validity of PASAT and the effect of fatigue and mood in patients with relapsing remitting MS: a functional MRI study. J Evaluat Clin Pract. (2018) 24:832–838. doi: 10.1111/jep.12913

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Iancheva D, Trenova A, Mantarova S, Terziyski K. functional magnetic resonance imaging correlations between fatigue and cognitive performance in patients with relapsing remitting multiple sclerosis. Front Psych. (2019) 10:754. doi: 10.3389/fpsyt.2019.00754

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Forn C, Belloch V, Bustamante JC, Garbin G, Parcet-Ibar MÀ, Sanjuan A, et al. A Symbol digit modalities test version suitable for functional MRI studies. Neurosci Letters. (2009) 456:11–14. doi: 10.1016/j.neulet.2009.03.081

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Silva PHR, Spedo CT, Barreira AA, Leoni RF. Symbol digit modalities test adaptation for magnetic resonance imaging environment: a systematic review and meta-analysis. Mult Scler Relat. Disord. (2018) 20, 136–143.

PubMed Abstract | Google Scholar

23. Sternberg S. High-speed scanning in human memory. Science. (1966) 153:652–4.

Google Scholar

24. Giromini L, Viglione DJ, Zennaro A, Cauda F. Neural activity during production of rorschach responses: an fMRI study. Psych Res Neuroimag. (2017) 262:25–31. doi: 10.1016/j.pscychresns.2017.02.001

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Vitolo E, Giromini L, Viglione DJ, Cauda F, et al. Complexity and cognitive engagement in the rorschach task: an fMRI study. JJ Personal Assess. (2020) 103:634–44. doi: 10.1080/00223891.2020.1842429

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Ishibashi M, Uchiumi C, Jung M, Aizawa N, Makita K, Nakamura Y, et al. Differences in brain hemodynamics in response to achromatic and chromatic cards of the rorschach. Rorschachiana. (2016) 37:41–57. doi: 10.1027/1192-5604/a000076

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Schnell K, Dietrich T, Schnitker R, Daumann J, Herpertz SC. Processing of autobiographical memory retrieval cues in borderline personality disorder. J Aff Disord. (2006) 97:253–9. doi: 10.1016/j.jad.2006.05.035

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Escamilla M., Sandoval H., Calhoun V., Ramirez M. Brain activation patterns in response to complex triggers in the word association test: results from a new study in the United States. J Anal Psychol. (2018) 63:484–509. doi: 10.1111/1468-5922.12430

CrossRef Full Text | Google Scholar

29. Petchkovsky L, Petchkovsky M, Morris P, Dickson P, Montgomery DT, Dwyer J, et al. Functional brain imagery and jungian analytical psychology: an interesting dance? Neuroimag Struct Funct Mind. (2019) 5:2414. doi: 10.5772/intechopen.82414

CrossRef Full Text | Google Scholar

30. Petchkovsky L, Petchkovsky M, Morris P, Dickson P, Montgomery D, Dwyer J, et al. fMRI responses to Jung's word association test: implications for theory, treatment and research. J Anal Psychol. (2013) 58:409–31. doi: 10.1111/1468-5922.12021

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Stoyanov D, Kandilarova S, Borgwardt S, Stieglitz RD, Hugdahl K, Kostianev S, et al. Psychopathology assessment methods revisited: on translational cross-validation of clinical self-evaluation scale and fMRI. Front Psych. (2018) 9:21. doi: 10.3389/fpsyt.2018.00021

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Aryutova K, Paunova R, Kandilarova S, Todeva-Radneva A, Stoyanov D. Implications from translational cross-validation of clinical assessment tools for diagnosis and treatment in psychiatry. World J Psych. (2021) 11:169.

PubMed Abstract | Google Scholar

33. Aryutova K, Paunova R, Kandilarova S, Stoyanova K, Maes MH, Stoyanov D. Differential aberrant connectivity of precuneus and anterior insula may underpin the diagnosis of schizophrenia and mood disorders. World J Psych. (2021) 11:1274–87. doi: 10.5498/wjp.v11.i12.1274

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Stoyanov D, Kandilarova S, Paunova R, Barranco Garcia J, Latypova A, Kherif F. Cross-validation of functional MRI and paranoid-depressive scale: results from multivariate analysis. Front Psych. (2019) 10:869. doi: 10.3389/fpsyt.2019.00869

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Stoyanov D, Kandilarova S, Arabadzhiev Z, Paunova R, Schmidt A, Borgwardt S, et al. CROSS-validation of paranoid-depressive scale and functional mri: new paradigm for neuroscience informed clinical psychopathology. Front Psych. (2019) 711. doi: 10.3389/fpsyt.2019.00711

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Stoyanov D, Aryutova K, Kandilarova S, Paunova R, Arabadzhiev Z, Todeva-Radneva A. Diagnostic task specific activations in functional MRI and aberrant connectivity of insula with middle frontal gyrus can inform the differential diagnosis of psychosis. Diagnostics. (2021) 11: 95. doi: 10.3390/diagnostics11010095

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Stoyanov D, Kandilarova S, Aryutova K, Paunova R, Todeva-Radneva A, Latypova A, et al. Multivariate analysis of structural and functional neuroimaging can inform psychiatric differential diagnosis. Diagnostics. (2020) 11:19. doi: 10.3390/diagnostics11010019

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Weber S, Johnsen E, Kroken RA, Løberg EM, Kandilarova S, Stoyanov D, et al. Dynamic functional connectivity patterns in schizophrenia and the relationship with hallucinations. Front Psych. (2020) 11:227. doi: 10.3389/fpsyt.2020.00227

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Kandilarova S, Stoyanov D, Popivanov ID, Kostianev S. Application of functional magnetic resonance imaging in psychiatric clinical evaluation: controversies and avenues. J Eval Clin Pract. (2018) 24:807–14. doi: 10.1111/jep.12906

PubMed Abstract | CrossRef Full Text | Google Scholar

40. Kandilarova S, Stoyanov D, Stoeva M, Latypova A, Kherif F. Functional MRI in depression—multivariate analysis of emotional task. J Med Biol Engin. (2020) 40:535–44. doi: 10.1007/s40846-020-00547-2

CrossRef Full Text | Google Scholar

41. Haralanova E, Haralanov S, Beraldi A, Möller HJ, Hennig-Fast K. Subjective emotional over-arousal to neutral social scenes in paranoid schizophrenia. Eu Arc Psych Clin Neurosci. (2012) 262:59–68. doi: 10.1007/s00406-011-0227-1

PubMed Abstract | CrossRef Full Text | Google Scholar

42. Simeonova D, Paunova R, Stoyanova K, Todeva-Radneva A, Kandilarova S, Stoyanov D. Functional MRI correlates of stroop N-back test underpin the diagnosis of major depression. J Int Neurosci. (2022) 21:113. doi: 10.31083/j.jin2104113

PubMed Abstract | CrossRef Full Text | Google Scholar

43. Hugdahl K, Raichle ME, Mitra A, Specht K. On the existence of a generalized non-specific task-dependent network. Front Human Neurosci. (2015) 9:430. doi: 10.3389/fnhum.2015.00430

PubMed Abstract | CrossRef Full Text | Google Scholar

44. Hugdahl K, Kazimierczak K, Beresniewicz J, Kompus K, Westerhausen R, Ersland L, et al. and Specht, K. Dynamic up- and down-regulation of the default (DMN) and extrinsic (EMN) mode networks during alternating task-on and task-off periods. PLoS ONE. (2019) 14:e0218358. doi: 10.1371/journal.pone.0218358

PubMed Abstract | CrossRef Full Text | Google Scholar

45. Riemer F, Grüner R, Beresniewicz J, Kazimierczak K, Ersland L, Hugdahl K. Dynamic switching between intrinsic and extrinsic mode networks as demands change from passive to active processing. Scient Rep. (2020) 10:8579. doi: 10.1038/s41598-020-78579-6

PubMed Abstract | CrossRef Full Text | Google Scholar

46. Weber S, Aleman A, Hugdahl K. Involvement of the default mode network under varying levels of cognitive effort. Scien Rep. (2022) 12:6303. doi: 10.1038/s41598-022-10289-7

PubMed Abstract | CrossRef Full Text | Google Scholar

47. Elliott ML, Knodt AR, Ireland D, Morris ML, Poulton R, Ramrakha S, et al. What is the test-retest reliability of common task-Functional MRI Measures? New empirical evidence and a meta-analysis. Psychol Sci. (2020) 31:792–806. doi: 10.1177/0956797620916786

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: diagnosis, translation, validity, functional neuroimaging, clinical assessment and patient diagnosis

Citation: Stoyanov D (2022) Perspectives before incremental trans-disciplinary cross-validation of clinical self-evaluation tools and functional MRI in psychiatry: 10 years later. Front. Psychiatry 13:999680. doi: 10.3389/fpsyt.2022.999680

Received: 21 July 2022; Accepted: 08 September 2022;
Published: 10 October 2022.

Edited by:

Domenico De Berardis, Mental Health Center (CSM) and Psychiatric Service of Diagnosis and Treatment (SPDC), Italy

Reviewed by:

Carmine Tomasetti, Mental Health Center of Giulianova, Italy

Copyright © 2022 Stoyanov. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Drozdstoy Stoyanov, drozdstoy.stoyanov@mu-plovdiv.bg

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.