Skip to main content
SpringerLink
Log in

Validation of hippocampal volumes measured using a manual method and two automated methods (FreeSurfer and IBASPM) in chronic major depressive disorder

  • Diagnostic Neuroradiology
  • Published:
Neuroradiology Aims and scope Submit manuscript

Abstract

Introduction

To validate the usefulness of the packages available for automated hippocampal volumetry, we measured hippocampal volumes using one manual and two recently developed automated volumetric methods.

Methods

The study included T1-weighted magnetic resonance imaging (MRI) of 21 patients with chronic major depressive disorder (MDD) and 20 normal controls. Using coronal turbo field echo (TFE) MRI with a slice thickness of 1.3 mm, the hippocampal volumes were measured using three methods: manual volumetry, surface-based parcellation using FreeSurfer, and individual atlas-based volumetry using IBASPM. In addition, the intracranial cavity volume (ICV) was measured manually.

Results

The absolute left hippocampal volume of the patients with MDD measured using all three methods was significantly smaller than the left hippocampal volume of the normal controls (manual P = 0.029, FreeSurfer P = 0.035, IBASPM P = 0.018). After controlling for the ICV, except for the right hippocampal volume measured using FreeSurfer, both measured hippocampal volumes of the patients with MDD were significantly smaller than the measured hippocampal volumes of the normal controls (right manual P = 0.019, IBASPM P = 0.012; left manual P = 0.003, FreeSurfer P = 0.010, IBASPM P = 0.002),. In the intrarater reliability test, the intraclass correlation coefficients (ICCs) were all excellent (manual right 0.947, left 0.934; FreeSurfer right 1.000, left 1.000; IBASPM right 1.000, left 1.000). In the test of agreement between the volumetric methods, the ICCs were right 0.846 and left 0.848 (manual and FreeSurfer), and right 0.654 and left 0.717 (manual and IBASPM).

Conclusion

The automated hippocampal volumetric methods showed good agreement with manual hippocampal volumetry, but the volume measured using FreeSurfer was 35% larger and the agreement was questionable with IBASPM. Although the automated methods could detect hippocampal atrophy in the patients with MDD, the results indicate that manual hippocampal volumetry is still the gold standard, while the automated volumetric methods need to be improved.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Geuze E, Vermetten E, Bremner JD (2005) MR-based in vivo hippocampal volumetrics: 2. Findings in neuropsychiatric disorders. Mol Psychiatry 10:160–184

    Article  PubMed  CAS  Google Scholar 

  2. Geuze E, Vermetten E, Bremner JD (2005) MR-based in vivo hippocampal volumetrics: 1. Review of methodologies currently employed. Mol Psychiatry 10:147–159

    Article  PubMed  CAS  Google Scholar 

  3. Alemán-Gómez Y, Melie-García L, Valdés-Hernandez P (2006) IBASPM: toolbox for automatic parcellation of brain structures. Presented at the 12th Annual Meeting of the Organization for Human Brain Mapping, 11–15 June 2006, Florence, Italy. Available on CD-Rom in NeuroImage, vol. 27, no. 1

  4. Carmichael OT, Aizenstein HA, Davis SW, Becker JT, Thompson PM, Meltzer CC, Liu Y (2005) Atlas-based hippocampus segmentation in Alzheimer’s disease and mild cognitive impairment. Neuroimage 27:979–990

    Article  PubMed  Google Scholar 

  5. Chupin M, Mukuna-Bantumbakulu AR, Hasboun D, Bardinet E, Baillet S, Kinkingnehun S, Lemieux L, Dubois B, Garnero L (2007) Anatomically constrained region deformation for the automated segmentation of the hippocampus and the amygdala: method and validation on controls and patients with Alzheimer’s disease. Neuroimage 34:996–1019

    Article  PubMed  Google Scholar 

  6. Csernansky JG, Joshi S, Wang L, Haller JW, Gado M, Miller JP, Grenander U, Miller MI (1998) Hippocampal morphometry in schizophrenia by high dimensional brain mapping. Proc Natl Acad Sci U S A 95:11406–11411

    Article  PubMed  CAS  Google Scholar 

  7. Duchesne S, Pruessner JC, Collins DL (2002) Appearance-based segmentation of medial temporal lobe structures. Neuroimage 17:515–531

    Article  PubMed  CAS  Google Scholar 

  8. Fischl B, Salat DH, Busa E, Albert M, Dieterich M, Haselgrove C, van der Kouwe A, Killiany R, Kennedy D, Klaveness S, Montillo A, Makris N, Rosen B, Dale AM (2002) Whole brain segmentation: automated labeling of neuroanatomical structures in the human brain. Neuron 33:341–355

    Article  PubMed  CAS  Google Scholar 

  9. Ghanei A, Soltanian-Zadeh H, Windham JP (1998) Segmentation of the hippocampus from brain MRI using deformable contours. Comput Med Imaging Graph 22:203–216

    Article  PubMed  CAS  Google Scholar 

  10. Haller JW, Banerjee A, Christensen GE, Gado M, Joshi SC, Miller MI, Sheline YI, Vannier MW, Csernansky JG (1997) Three-dimensional hippocampal MR morphometry with high-dimensional transformation of a neuroanatomical atlas. Radiology 202:504–510

    PubMed  CAS  Google Scholar 

  11. Hsu YY, Schuff N, Du AT, Mark K, Zhu X, Hardin D, Weiner MW (2002) Comparison of automated and manual MRI volumetry of hippocampus in normal aging and dementia. J Magn Reson Imaging 16:305–310

    Article  PubMed  Google Scholar 

  12. Jack CR Jr (1994) MRI-based hippocampal volume measurements in epilepsy. Epilepsia 35 [Suppl 6]:S21–S29

    Article  PubMed  Google Scholar 

  13. Jack CR Jr, Bentley MD, Twomey CK, Zinsmeister AR (1990) MR imaging-based volume measurements of the hippocampal formation and anterior temporal lobe: validation studies. Radiology 176:205–209

    PubMed  Google Scholar 

  14. Jack CR Jr, Sharbrough FW, Twomey CK, Cascino GD, Hirschorn KA, Marsh WR, Zinsmeister AR, Scheithauer B (1990) Temporal lobe seizures: lateralization with MR volume measurements of the hippocampal formation. Radiology 175:423–429

    PubMed  Google Scholar 

  15. Jack CR Jr, Theodore WH, Cook M, McCarthy G (1995) MRI-based hippocampal volumetrics: data acquisition, normal ranges, and optimal protocol. Magn Reson Imaging 13:1057–1064

    Article  PubMed  Google Scholar 

  16. Jack CR Jr, Twomey CK, Zinsmeister AR, Sharbrough FW, Petersen RC, Cascino GD (1989) Anterior temporal lobes and hippocampal formations: normative volumetric measurements from MR images in young adults. Radiology 172:549–554

    PubMed  Google Scholar 

  17. Luft AR, Skale JM, Welte D, Kolb R, Klose U (1996) Reliability and exactness of MRI-based volumetry: a phantom study. J Magn Reson Imaging 6:700–704

    Article  PubMed  CAS  Google Scholar 

  18. Devanand DP, Pradhaban G, Liu X, Khandji A, De Santi S, Segal S, Rusinek H, Pelton GH, Honig LS, Mayeux R, Stern Y, Tabert MH, de Leon MJ (2007) Hippocampal and entorhinal atrophy in mild cognitive impairment: prediction of Alzheimer disease. Neurology 68:828–836

    Article  PubMed  CAS  Google Scholar 

  19. Grundman M, Sencakova D, Jack CR Jr, Petersen RC, Kim HT, Schultz A, Weiner MF, DeCarli C, DeKosky ST, van Dyck C, Thomas RG, Thal LJ (2002) Alzheimer’s Disease Cooperative Study: brain MRI hippocampal volume and prediction of clinical status in a mild cognitive impairment trial. J Mol Neurosci 19:23–27

    Article  PubMed  CAS  Google Scholar 

  20. Jack CR Jr, Petersen RC, Xu YC, O’Brien PC, Smith GE, Ivnik RJ, Boeve BF, Waring SC, Tangalos EG, Kokmen E (1999) Prediction of AD with MRI-based hippocampal volume in mild cognitive impairment. Neurology 52:1397–1403

    PubMed  Google Scholar 

  21. Pantel J, O’Leary DS, Cretsinger K, Bockholt HJ, Keefe H, Magnotta VA, Andreasen NC (2000) A new method for the in vivo volumetric measurement of the human hippocampus with high neuroanatomical accuracy. Hippocampus 10:752–758

    Article  PubMed  CAS  Google Scholar 

  22. Walhovd KB, Fjell AM, Reinvang I, Lundervold A, Dale AM, Eilertsen DE, Quinn BT, Salat D, Makris N, Fischl B (2005) Effects of age on volumes of cortex, white matter and subcortical structures. Neurobiol Aging 26:1261–1270

    Article  PubMed  Google Scholar 

  23. Tzourio-Mazoyer N, Landeau B, Papathanassiou D, Crivello F, Etard O, Delcroix N, Mazoyer B, Joliot M (2002) Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain. Neuroimage 15:273–289

    Article  PubMed  CAS  Google Scholar 

  24. Han X, Fischl B (2007) Atlas renormalization for improved brain MR image segmentation across scanner platforms. IEEE Trans Med Imaging 26:479–486

    Article  PubMed  Google Scholar 

  25. Beck AT, Ward CH, Mendelson M, Mock J, Erbaugh J (1961) An inventory for measuring depression. Arch Gen Psychiatry 4:561–571

    PubMed  CAS  Google Scholar 

  26. Hamilton M (1960) A rating scale for depression. J Neurol Neurosurg Psychiatry 23:56–62

    Article  PubMed  CAS  Google Scholar 

  27. Oldfield RC (1971) The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia 9:97–113

    Article  PubMed  CAS  Google Scholar 

  28. Kruggel F (2006) MRI-based volumetry of head compartments: normative values of healthy adults. Neuroimage 30:1–11

    Article  PubMed  CAS  Google Scholar 

  29. Lemieux L, Hammers A, Mackinnon T, Liu RS (2003) Automatic segmentation of the brain and intracranial cerebrospinal fluid in T1-weighted volume MRI scans of the head, and its application to serial cerebral and intracranial volumetry. Magn Reson Med 49:872–884

    Article  PubMed  Google Scholar 

  30. MacLullich AM, Ferguson KJ, Deary IJ, Seckl JR, Starr JM, Wardlaw JM (2002) Intracranial capacity and brain volumes are associated with cognition in healthy elderly men. Neurology 59:169–174

    PubMed  CAS  Google Scholar 

  31. Wolf H, Kruggel F, Hensel A, Wahlund LO, Arendt T, Gertz HJ (2003) The relationship between head size and intracranial volume in elderly subjects. Brain Res 973:74–80

    Article  PubMed  CAS  Google Scholar 

  32. Eritaia J, Wood SJ, Stuart GW, Bridle N, Dudgeon P, Maruff P, Velakoulis D, Pantelis C (2000) An optimized method for estimating intracranial volume from magnetic resonance images. Magn Reson Med 44:973–977

    Article  PubMed  CAS  Google Scholar 

  33. Chey J, Na DG, Tae WS, Ryoo JW, Hong SB (2006) Medial temporal lobe volume of nondemented elderly individuals with poor cognitive functions. Neurobiol Aging 27:1269–1279

    Article  PubMed  Google Scholar 

  34. Duvernoy HM (1991) The human brain: surface, three-dimensional sectional anatomy, and MRI. Springer-Verlag, New York, NY

  35. Hasboun D, Chantome M, Zouaoui A, Sahel M, Deladoeuille M, Sourour N, Duyme M, Baulac M, Marsault C, Dormont D (1996) MR determination of hippocampal volume: comparison of three methods. AJNR Am J Neuroradiol 17:1091–1098

    PubMed  CAS  Google Scholar 

  36. Arndt S, Swayze V, Cizadlo T, O’Leary D, Cohen G, Yuh WT, Ehrhardt JC, Andreasen NC (1994) Evaluating and validating two methods for estimating brain structure volumes: tessellation and simple pixel counting. Neuroimage 1:191–198

    Article  PubMed  CAS  Google Scholar 

  37. Cronbach LJ (1951) Coefficient alpha and the internal structure of tests. Psychometrika 16:297–334

    Article  Google Scholar 

  38. Bland JM, Altman DG (1986) Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1:307–310

    PubMed  CAS  Google Scholar 

  39. Pitman EJG (1939) A note on normal correlation. Biometrica 31:9–12

    Google Scholar 

  40. Frodl T, Schaub A, Banac S, Charypar M, Jager M, Kummler P, Bottlender R, Zetzsche T, Born C, Leinsinger G, Reiser M, Moller HJ, Meisenzahl EM (2006) Reduced hippocampal volume correlates with executive dysfunctioning in major depression. J Psychiatry Neurosci 31:316–323

    PubMed  Google Scholar 

  41. Hickie I, Naismith S, Ward PB, Turner K, Scott E, Mitchell P, Wilhelm K, Parker G (2005) Reduced hippocampal volumes and memory loss in patients with early- and late-onset depression. Br J Psychiatry 186:197–202

    Article  PubMed  Google Scholar 

  42. Neumeister A, Wood S, Bonne O, Nugent AC, Luckenbaugh DA, Young T, Bain EE, Charney DS, Drevets WC (2005) Reduced hippocampal volume in unmedicated, remitted patients with major depression versus control subjects. Biol Psychiatry 57:935–937

    Article  PubMed  Google Scholar 

  43. O’Brien JT, Lloyd A, McKeith I, Gholkar A, Ferrier N (2004) A longitudinal study of hippocampal volume, cortisol levels, and cognition in older depressed subjects. Am J Psychiatry 161:2081–2090

    Article  PubMed  Google Scholar 

  44. Videbech P, Ravnkilde B (2004) Hippocampal volume and depression: a meta-analysis of MRI studies. Am J Psychiatry 161:1957–1966

    Article  PubMed  Google Scholar 

  45. Li YJ, Ga SN, Huo Y, Li SY, Gao XG (2007) Characteristics of hippocampal volumes in healthy Chinese from MRI. Neurol Res 29:803–806

    Article  PubMed  Google Scholar 

  46. Tae WS, Hong SB (2001) Boundary of amygdala and hippocampus. Am J Psychiatry 158:820–821

    Article  PubMed  CAS  Google Scholar 

  47. Maller JJ, Daskalakis ZJ, Fitzgerald PB (2007) Hippocampal volumetrics in depression: the importance of the posterior tail. Hippocampus 17:1023–1027

    Article  PubMed  Google Scholar 

Download references

Acknowledgement

This study was supported by a research grant from Kangwon National University Hospital.

Conflict of interest statement

We declare that we have no conflict of interest.

Author information

Authors and Affiliations

  1. Neuroscience Research Institute, Kangwon National University College of Medicine, Kangwon, Korea

    Woo Suk Tae, Sam Soo Kim, Kang Uk Lee, Eui-Cheol Nam & Keun Woo Kim

  2. Department of Radiology, Kangwon National University Hospital, 17-1 Hyoja 3-dong, Chuncheon, Kangwon-do, 200-947, Korea

    Sam Soo Kim

Authors
  1. Woo Suk Tae
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sam Soo Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kang Uk Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Eui-Cheol Nam
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Keun Woo Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sam Soo Kim.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Tae, W.S., Kim, S.S., Lee, K.U. et al. Validation of hippocampal volumes measured using a manual method and two automated methods (FreeSurfer and IBASPM) in chronic major depressive disorder. Neuroradiology 50, 569–581 (2008). https://doi.org/10.1007/s00234-008-0383-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00234-008-0383-9

Keywords

Search

Navigation