Retrospective Study Open Access
Copyright ©The Author(s) 2022. Published by Baishideng Publishing Group Inc. All rights reserved.
World J Clin Cases. May 6, 2022; 10(13): 4050-4063
Published online May 6, 2022. doi: 10.12998/wjcc.v10.i13.4050
Three-dimensional echocardiographic assessment of left ventricular volume in different heart diseases using a fully automated quantification software
Chen-Ke Pan, Bo-Wen Zhao, Mei Pan, Yan-Kai Mao, Yuan Yang, Department of Diagnostic Ultrasound and Echocardiography, Sir Run Run Shaw Hospital, Zhejiang University College of Medicine, Hangzhou 310016, Zhejiang Province, China
Chen-Ke Pan, Xuan-Xuan Zhang, Department of Ultrasound, The Fourth Affiliated Hospital of Zhejiang University College of Medicine, Yiwu 322200, Zhejiang Province, China
ORCID number: Chen-Ke Pan (0000-0001-6144-0737); Bo-Wen Zhao (0000-0003-4911-9371); Xuan-Xuan Zhang (0000-0001-6797-3489); Mei Pan (0000-0002-5423-0771); Yan-Kai Mao (0000-0001-7771-8916); Yuan Yang (0000-0001-5023-4065).
Author contributions: Pan CK collected and analyzed the data, wrote the paper; Zhao BW designed and oversight the study; Zhang XX assisted with data analysis; Pan M, Mao YK and Yang Y was involved with data collection; all authors have read and approved the final manuscript.
Institutional review board statement: The study was reviewed and approved by the Institutional Review Boards of Sir Run Run Shaw Institute of Clinical Medicine of Zhejiang University Ethics Committee in China (No. KY20200210-78).
Informed consent statement: Patients were not required to give informed consent to the study because the analysis used anonymous clinical data.
Conflict-of-interest statement: There are no conflicts of interest to report.
Data sharing statement: No additional data are available.
Open-Access: This article is an open-access article that was selected by an in-house editor and fully peer-reviewed by external reviewers. It is distributed in accordance with the Creative Commons Attribution NonCommercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: https://creativecommons.org/Licenses/by-nc/4.0/
Corresponding author: Bo-Wen Zhao, MD, Chief Doctor, Professor, Department of Diagnostic Ultrasound and Echocardiography, Sir Run Run Shaw Hospital, Zhejiang University College of Medicine, No. 3 East Qingchun Road, Hangzhou 310016, Zhejiang Province, China. zbwcjp@zju.edu.cn
Received: September 3, 2021
Peer-review started: September 3, 2021
First decision: December 1, 2021
Revised: December 10, 2021
Accepted: March 14, 2022
Article in press: March 14, 2022
Published online: May 6, 2022

Abstract
BACKGROUND

HeartModel (HM) is a fully automated adaptive quantification software that can quickly quantify left heart volume and left ventricular function. This study used HM to quantify the left ventricular end-diastolic (LVEDV) and end-systolic volumes (LVESV) of patients with dilated cardiomyopathy (DCM), coronary artery heart disease with segmental wall motion abnormality, and hypertrophic cardiomyopathy (HCM) to determine whether there were differences in the feasibility, accuracy, and repeatability of measuring the LVEDV, LVESV, LV ejection fraction (LVEF) and left atrial end-systolic volume (LAESV) and to compare these measurements with those obtained with traditional two-dimensional (2D) and three-dimensional (3D) methods.

AIM

To evaluate the application value of HM in quantifying left heart chamber volume and LVEF in clinical patients.

METHODS

A total of 150 subjects who underwent 2D and 3D echocardiography were divided into 4 groups: (1) 42 patients with normal heart shape and function (control group, Group A); (2) 35 patients with DCM (Group B); (3) 41 patients with LV remodeling after acute myocardial infarction (Group C); and (4) 32 patients with HCM (Group D). The LVEDV, LVESV, LVEF and LAESV obtained by HM with (HM-RE) and without regional endocardial border editing (HM-NE) were compared with those measured by traditional 2D/3D echocardiographic methods to assess the correlation, consistency, and repeatability of all methods.

RESULTS

(1) The parameters measured by HM were significantly different among the groups (P < 0.05 for all). Compared with Groups A, C, and D, Group B had higher LVEDV and LVESV (P < 0.05 for all) and lower LVEF (P < 0.05 for all); (2) HM-NE overestimated LVEDV, LVESV, and LAESV with wide biases and underestimated LVEF with a small bias; contour adjustment reduced the biases and limits of agreement (bias: LVEDV, 28.17 mL, LVESV, 14.92 mL, LAESV, 8.18 mL, LVEF, -0.04%). The correlations between HM-RE and advanced cardiac 3D quantification (3DQA) (rs = 0.91-0.95, P < 0.05 for all) were higher than those between HM-NE (rs = 0.85-0.93, P < 0.05 for all) and the traditional 2D methods. The correlations between HM-RE and 3DQA were good for Groups A, B, and C but remained weak for Group D (LVEDV and LVESV, rs = 0.48-0.54, P < 0.05 for all); and (3) The intraobserver and interobserver variability for the HM-RE measurements were low.

CONCLUSION

HM can be used to quantify the LV volume and LVEF in patients with common heart diseases and sufficient image quality. HM with contour editing is highly reproducible and accurate and may be recommended for clinical practice.

Key Words: HeartModel, Three-dimensional echocardiography, Left ventricular volume, Left ventricular ejection function, Left atrial volume

Core Tip: This was a prospective international trial with 150 patients seeking to evaluate the accuracy and reproducibility of the fully automated quantification software, HeartModel (HM).The results showed that HM can be used to quantify the left ventricular (LV) volume and LV ejection fraction in patients with common heart diseases and may be recommended for clinical practice.



INTRODUCTION

Accurate quantification of the left heart volume and left ventricular ejection fraction (LVEF) is important for patients with heart diseases[1,2]. Dilated cardiomyopathy (DCM), coronary heart disease, and hypertrophic cardiomyopathy (HCM) are some of the most common heart diseases that cause changes in left heart volume and function in clinical studies. Two-dimensional (2D) transthoracic echocardiography is currently the first-line imaging method for the diagnosis of cardiovascular patients and plays an indispensable role in the assessment of hemodynamics, cardiovascular structure size, and cardiac function. The functional evaluation method relies on geometric assumptions; however, there are certain limitations in clinical application. Traditional three-dimensional echocardiography (3DE) does not rely on geometric assumptions and provides true volume data to accurately assess left heart volume and function. Nevertheless, obtaining high-quality 3D volume data depends on the experience and analysis of the operating doctor; furthermore, the process is cumbersome and time-consuming, limiting its routine clinical application[3].

MATERIALS AND METHODS
Patient characteristics

A total of 197 consecutive clinical patients from July 2020 to October 2020 were selected. Forty-seven were excluded for the following reasons: 3 of 17 consecutive myocardial segments were unclear (n = 20); difficulty with holding one’s breath (n = 7); and generation of an incorrect left ventricular mold by automatic quantification software that could not be manually edited and corrected (n = 20). A total of 150 patients were finally enrolled in this study and divided into the following four groups. Group A was the control group (n = 42, 18 males, 24 females), with an average age of 39 ± 12 years and an average body surface area (BSA) of 1.68 ± 0.13 m². Patients were included after ruling out organic heart diseases by evaluating the patient’s medical history and family history and obtaining an electrocardiogram or conventional echocardiogram. Group B was the dilated cardiomyopathy (DCM) group (n = 35, 21 males and 14 females), with an average age of 53 ± 15 years and an average BSA of 1.69 ± 0.16 m²; 4 patients also had atrial fibrillation, and 15 had an implanted pacemaker. Patients were those without significant epicardial coronary artery obstructions but with an enlarged left ventricle and diminished left ventricular wall motion on ultrasound. Group C consisted of patients with ventricular remodeling after acute myocardial infarction (AMI) (n = 41, 28 males and 13 females), with an average age of 63 ± 11 years and an average BSA of 1.67 ± 0.12 m²; 11 patients had a ventricular aneurysm, 9 had atrial fibrillation, 11 were implanted with a pacemaker, and 4 had a history of mitral valve replacement. All patients had a history of AMI and coronary angiography and ultrasound confirmed segmental or diffuse wall motion abnormalities. Group D was the HCM group (n = 32 cases, 22 males and 10 females), with an average age of 55 ± 14 years and an average BSA of 1.73 ± 0.17 m². Five patients had atrial fibrillation. The diagnostic standard for HCM, thickness of at least one myocardial segment ≥ 15 mm that cannot be explained by load alone, was in accordance with the adult standard in the 2014 European Cardiology Association HCM Diagnosis and Treatment Guidelines. The study was approved by the ethics committee of Sir Run Run Shaw Hospital, Zhejiang University College of Medicine, with a wavier for individual consent by the committee owing to the retrospective study design.

Instruments

All patients underwent 2D and 3D transthoracic echocardiographic examination using a Philips EPIQ 7C echocardiography diagnosis instrument with an X5-1 probe (1-5 MHz). The instrument was equipped with the HeartModel (HM) 3D image acquisition mode and the QLab10.5 software package, including a 3D quantification (3DQ) Advance plug-in image analyzer. A senior doctor with more than 10 years of experience in echocardiography was responsible for the image collection; another 2 sonographers who had been engaged in echocardiography for more than 5 years were responsible for processing the data.

M-Mode and 2D echocardiographic study

After placing the subject in the left lateral position, the electrocardiogram leads were connected, and the instrument parameters were adjusted to obtain the best imaging. M-mode echocardiography was used to measure the left ventricular end-diastolic and end-systolic diameters, and the machine calculated the left ventricular volumes and LVEF automatically by the Teichholzholz method. Images from at least 4 cardiac cycles in dynamic apical two-chamber, three-chamber, and four-chamber views were obtained. Using the biplane Simpson method in the instrument, the endocardium was automatically tracked and then manually adjusted if necessary. The measurement results were recorded as the average of the 3 cardiac cycles with the best image quality (IQ).

3D echocardiographic study

After the above steps, the xPlane mode was started, the angle and instrument settings were adjusted, and the frame rate was kept > 18 frames/s. The patient was instructed to maintain a breathhold, at the end of expiration, after which the “HM ACQ” button was clicked to collect 6 consecutive cardiac cycles. Clicking the “HM” button, the system automatically calculated the LV end-diastolic volume (LVEDV), LV end-systolic volume (LVESV), LVEF and left atrial end-systolic volume (LAESV). Using the boundary setting HM80-40, the average of the 3 cardiac cycles with the best IQ was obtained to record the HM data without endocardial boundary editing (HM-NE). Then, the endocardial boundary was manually fine-tuned as needed, and the average of the 3 best-quality cardiac cycles was again obtained to record the HM data with endocardial boundary editing (HM-RE). One week later, the same observer analyzed all the images again, while a second observer analyzed them for the first time (Figure 1).

Figure 1
Figure 1 HeartModel algorithm. The HeartModel algorithm automatically detects three-dimensional end-diastolic and end-systolic endocardial contours of the left ventricle and the left atrium with possibility of further manual adjustments if needed. Right chamber contours are also delineated; however, numerical results are not provided in the current version of the software.

3DQ method: Offline analysis of the 3D images collected in full volume mode was performed using QLab 10.5 software and the 3DQ Advance plug-in to analyze the images acquired in the apical four-chamber and two-chamber views and the left ventricular short axis view, and the plane on the 2D images was manually corrected. The average of the 3 best-quality cardiac cycles was taken as the measurement result, while in the software, the IQ index was calculated; a value above 50% was defined as good IQ, while that below 40% was defined as poor IQ.

Advanced cardiac 3DQ (3DQA) method: The QLab 10.5 software 3DQ plug-in was used to analyze the 3D images collected in full volume mode using the images obtained in three cross-sectional views used for the 3DQA method. After determining the end-diastolic frame, the region of interest was drawn on the four-chamber and two-chamber views of the apical long axis to obtain the left ventricular area model; the steps were repeated for the end-systolic frame. The above steps were repeated, and the average of the 3 best-quality cardiac cycles was taken as the measurement result.

Statistical analysis

SPSS 23.0 software and GraphPad Prism 8 software were used to analyze the data. The mean ± SD is used to represent the measurement data, and depending on the distribution of the data, parameter comparisons between the groups were performed using one-way ANOVA or the matched samples rank-sum test. The correlation and agreement between two sets of measurements were tested by Spearman’s correlation coefficient. Bland-Altman analysis was performed by calculating the bias and the limits of agreement; if more than 90% of the points fell within the 95% confidence interval, the consistency was considered high. Statistical significance was defined as P < 0.05. The intragroup and intergroup repeatability of the different quantitative methods are expressed by the coefficient of variation.

RESULTS
Study population and feasibility

Among all volumetric data collected, 93 patients required manual editing, including 20 patients in group A (47%), 15 in group B (42%), 26 in group C (63%), and 32 patients in group D (100%). Of the cases with a Q-Index > 50%, 45% of the images still needed to be edited again.

Comparison of LV volumes, LVEF, and LAV measured by different methods

The differences in the LVEDV, LVESV, LVEF and LAESV values measured by the different methods in the four groups were statistically significant (P < 0.05 for all), as shown in Table 1. Among them, the LVEDV and LVESV of group B were higher than those of the other groups (P < 0.05 for all), the LVEF of group B was lower than that of the other groups (P < 0.05 for all), and the LVEF of group D was higher than that of the other groups (P < 0.05 for all). In all groups, the measured values of LVEDV, LVESV, LVEF and LAESV obtained by HM-NE and HM-RE were greater than those of the 3DQA and Simpson methods (P < 0.05 for all).

Table 1 Comparison of left ventricular volume and left ventricular ejection fraction measured by the different transthoracic echocardiographic methods in 4 groups (mean ± SD).
Parameter
3DQA
Teichholz
Biplane Simpson
3DQ
HM-NE
HM-RE
Group A (control group, n = 42)
LVEDV (mL)77.5 ± 13.782.5 ± 11.6a70.6 ± 10.9a77.1 ± 15.491.0 ± 17.5a86.3 ± 15.9a
LVESV (mL)25.7 ± 5.327.5 ± 4.924.2 ± 4.5a26.3 ± 6.731.5 ± 6.9a29.6 ± 6.4a
LVEF (%)66.6 ± 4.366.5 ± 4.265.6 ± 3.4a65.8 ± 4.0a65.2 ± 4.2a65.5 ± 3.9a
LAESV (mL)36.8 ± 9.6NS35.2 ± 9.9aNS41.2 ± 10.5a39.8 ± 10.6a
Group B (DCM, n = 35)
LVEDV (mL)147.4 ± 34.7205.7 ± 52.7a162.7 ± 46.6a154.3 ± 38.0a187.5 ± 52.3a186.1 ± 45.8a
LVESV (mL)96.6 ± 30.0132.4 ± 40.4a103.1 ± 36.199.7 ± 32.3a115.6 ± 39.0a119.6 ± 40.4a
LVEF (%)35.1 ± 9.536.2 ± 7.937.3 ± 8.835.9 ± 9.337.9 ± 11.135.9 ± 9.4
LAESV (mL)60.4 ± 26.5NS62.9 ± 33.0NS68.0 ± 34.6a69.4 ± 33.1a
Group C (SWMA, n = 41)
LVEDV (mL)121.4 ± 50.8183.8 ± 73.1a135.1 ± 51.7a124.7 ± 51.9a170.3 ± 57.7a162.5 ± 56.9a
LVESV (mL)74.2 ± 35.6111.6 ± 56.4a79.6 ± 37.275.4 ± 35.394.5 ± 40.4a95.5 ± 40.2a
LVEF (%)40.0 ± 10.241.5 ± 10.142.4 ± 10.240.6 ± 8.445.3 ± 11.8a42.5 ± 8.6a
LAESV (mL)73.2 ± 51.0NS74.4 ± 53.5NS84.9 ± 57.4a82.4 ± 57.8a
Group D (HCM, n = 32)
LVEDV (mL)80.0 ± 21.5104.8 ± 32.2a75.7 ± 21.680.6 ± 22.4112.6 ± 27.1a105.6 ± 31.6a
LVESV (mL)27.8 ± 8.732.3 ± 12.324.7 ± 9.5a28.3 ± 9.547.1 ± 14.8a40.1 ± 14.0a
LVEF (%)65.1 ± 5.669.4 ± 6.4a67.6 ± 7.1a65.0 ± 5.758.3 ± 7.5a62.1 ± 5.6a
LAESV (mL)70.4 ± 30.5NS71.5 ± 38.5NS89.3 ± 45.3a83.1 ± 42.1a
Comparison between HM-NE and HM-RE

Compared with HM-NE, manual adjustment yielded reduced LVEDV, LVESV, and LAESV values in group A, LVEDV, LVEF, and LAESV values in group C, and LVEDV and LVESV values in group D, but the LVEF value of group D was increased. The remaining parameters were not significantly different before and after manual adjustment (P > 0.05) (Table 2). When contour adjustment was performed, group D showed a wide bias, while the bias in group A was the smallest among the four groups. Compared with the measured value of LV volume, the deviation bias of the measured LAESV value of the four groups was smaller (Figure 2).

Figure 2
Figure 2 Bland-Altman analysis for left heart volumes and ejection fraction between HeartModel with and without contour edit. A: Left ventricular end-diastolic volume; B: Left ventricular end-systolic volume; C: Left ventricular ejection fraction; D: Left atrial end-systolic volume. HM-NE: HeartModel without contour edit; HM-RE: HeartModel with contour edit; LVEDV: Left ventricular end-diastolic volume; LVESV: Left ventricular end-systolic volume; LVEF: Left ventricular ejection fraction; LAESV: Left atrial end-systolic volume.
Table 2 Comparison of left ventricular volume and left ventricular ejection fraction measured by HeartModel with and without regional endocardial border editing (mean ± SD).
GroupHM-NE
HM-RE
LVEDV (mL)
LVESV (mL)
LVEF (%)
LAESV (mL)
LVEDV (mL)
LVESV (mL)
LVEF (%)
LAESV (mL)
Group A91.0 ± 17.5a31.5 ± 6.9a65.2 ± 4.241.2 ± 10.5a86.3 ± 15.929.6 ± 6.465.5 ± 3.939.8 ± 10.6
Group B187.5 ± 52.3115.6 ± 39.037.9 ± 11.168.0 ± 34.6186.1 ± 45.8119.6 ± 40.435.9 ± 9.469.4 ± 33.1
Group C170.3 ± 57.7a94.5 ± 40.445.3 ± 11.8a84.9 ± 57.4a162.5 ± 56.995.5 ± 40.242.5 ± 8.682.4 ± 57.8
Group D112.6 ± 27.1a47.1 ± 14.8a58.3 ± 7.5a89.3 ± 45.3105.6 ± 31.640.1 ± 14.062.1 ± 5.683.1 ± 42.1
Correlation and consistency between M-Mode and two- and three-dimensional echocardiography

Compared with those measured by 3DQA, the volume values measured by HM-NE and HM-RE in each group were higher. Among all the methods, the 3DQ measurements had the highest correlation with 3DQA (rs= 0.96-0.98, P < 0.01 for all), and the consistency was good (LVEDV bias = 2.4 mL, LVESV bias = 1.3 mL, LVEF bias = 0.1%). The correlation between the LVEDV, LVESV, LVEF values measured by HM-NE and 3DQA (rs= 0.85-0.90, P < 0.01 for all) was similar to that of the Teichholz method, but the deviation bias (LVEDV, 33.4 mL, LVESV, 15.7 mL, LVEF, 0.2%) was smaller than that of the Teichholz method. After fine-tuning, the correlation (rs= 0.91-0.95, P < 0.01 for all) and consistency (bias: LVEDV, 28.1 mL; LVESV, 14.9 mL; LVEF, 0.0%; LAESV, 8.1 mL) were all increased; the Teichholz method had the lowest correlation with 3DQA (rs= 0.82-0.89, P < 0.01 for all) (Table 3, Figures 2 and 3).

Figure 3
Figure 3 Correlation and Bland-Altman analysis for left heart volumes and ejection fraction between HeartModel without contour edit and advanced cardiac three-dimensional quantification. A and B: Left ventricular end-diastolic volume; C and D: Left ventricular end-systolic volume; E and F: Left ventricular ejection fraction; G and H: Left atrial end-systolic volume. HM-NE: HeartModel without contour edit; 3DQA: Advanced cardiac three-dimensional quantification; LVEDV: Left ventricular end-diastolic volume; LVESV: Left ventricular end-systolic volume; LVEF: Left ventricular ejection fraction; LAESV: Left atrial end-systolic volume.
Table 3 Comparison of left ventricular volume and left ventricular ejection fraction measured by M-mode echocardiography, Biplane Simpson, and HeartModel methods against advanced cardiac three-dimensional quantification.
Parameter
rs
Bias ± LOA
Relative bias (%)
Percentage error (%)
Teichholz (n = 150)
LVEDV (mL)0.8237.3 ± 82.735.166.1
LVESV (mL)0.9120.0 ± 56.235.885.2
LVEF (%)0.891.5 ± 12.33.023.5
Biplane Simpson (n = 150)
LVEDV (mL)0.874.6 ± 46.84.343.0
LVESV (mL)0.941.9 ± 26.93.447.2
LVEF (%)0.911.4 ± 11.82.722.6
LAESV (mL)0.930.7 ± 23.71.239.6
3DQ (n = 150)
LVEDV (mL)0.962.4 ± 21.32.319.8
LVESV (mL)0.981.3 ± 11.22.319.8
LVEF (%)0.980.1 ± 5.20.210.1
HM-NE (n = 150)
LVEDV (mL)0.8533.4 ± 56.431.445.8
LVESV (mL)0.9015.7 ± 33.028.051.6
LVEF (%)0.85-0.2 ± 16.8-0.4-32.5
LAESV (mL)0.9310.2 ± 30.317.247.0
HM-RE (n = 150)
LVEDV (mL)0.9128.1 ± 47.626.439.5
LVESV (mL)0.9314.92 ± 30.926.648.7
LVEF (%)0.95-0.0 ± 9.8-0.0-19.0
LAESV (mL)0.958.1 ± 23.713.737.4

The correlation of left ventricular volume and LVEF between 3DQA and HM-NE in group A (rs= 0.73-0.81, P < 0.01 for all) was slightly lower than that between the Simpson method (rs= 0.83-0.85, P < 0.01 for all), which was manually fine-tuned, and HM-NE. The correlations of these values between the traditional methods and HM-RE were relatively increased (rs= 0.82-0.96, P < 0.01 for all). In group B, the LVEF value of HM-NE had a low correlation with that of 3DQA (rs= 0.46, P < 0.01). After manual fine-tuning, the correlation for LVEDV and LVESV increased slightly, and the correlation for LVEF increased significantly (rs= 0.71, P < 0.01). In group C, the correlation for left ventricular volume and LVEF between HM-NE and 3DQA was higher than that between HM-NE and both the Teichholz method and Simpson method. After manual fine-tuning, the correlation was further improved (rs= 0.80-0.90, P < 0.01 for all). The values measured with HM-NE in group D had a low correlation with those measured with 3DQA (LVESV rs= 0.35, LVEDV rs= 0.46, LVEF rs= 0.63, P < 0.01 for all). After manual fine-tuning, the correlation was slightly improved, but the correlation for LVESV was still low (rs= 0.48, P < 0.01 for all). The measured LAESV values of the two HM methods were highly correlated with those of the 3DQA method (rs= 0.93-0.95, P < 0.01 for all). In group D, the LAESV measured by HM-RE had the highest correlation with the 3DQA LAESV (rs= 0.98, P < 0.01), which was slightly higher than that of group A (rs= 0.97, P < 0.01).

The deviation bias of each HM-NE measurement in groups A and D was the largest among all methods and was significantly reduced after fine-tuning. The LVEF measurement bias of HM-NE in group B had the largest deviation and was reduced after fine-tuning, but the deviation bias of LVEDV, LVESV and LAESV was not significantly reduced after fine-tuning. In group C, the deviation bias of LVEDV and LVESV was the largest with the Teichholz method, and the deviation bias of LVEF and LAESV was the largest with HM-NE. After manual fine-tuning, the deviation bias of the two methods was significantly reduced, with the reduction in the bias of LVEF being the most significant (Table 4, Figure 4).

Figure 4
Figure 4 Correlation and Bland-Altman analysis for left heart volumes and ejection fraction between HeartModel with contour edit and advanced cardiac three-dimensional quantification. A and B: Left ventricular end-diastolic volume; C and D: Left ventricular end-systolic volume; E and F: Left ventricular ejection fraction; G and H: Left atrial end-systolic volume. HM-RE: HeartModel with contour edit; 3DQA: Advanced cardiac three-dimensional quantification; LVEDV: Left ventricular end-diastolic volume; LVESV: Left ventricular end-systolic volume; LVEF: Left ventricular ejection fraction; LAESV: Left atrial end-systolic volume.
Table 4 Comparison of left ventricular volume and left ventricular ejection fraction measured by HeartModel with regional endocardial border editing and advanced cardiac three-dimensional quantification in 4 groups (mean ± SD).
Parameter
HM-RE
3DQA
rs
Bias ± LOA
Relative bias (%)
Percentage error (%)
Group A (control group, n = 42)
LVEDV (mL)86.3 ± 15.9a77.5 ± 13.70.828.8 ± 16.111.310.7
LVESV (mL)29.6 ± 6.4a25.7 ± 5.30.853.8 ± 5.515.114.0
LVEF (%)65.5 ± 3.9a66.6 ± 4.30.96-1.0 ± 2.4-1.5-1.5
LAESV (mL)39.8 ± 10.6a36.8 ± 9.60.972.9 ± 3.98.17.7
Group B (DCM, n = 35)
LVEDV (mL)186.1 ± 45.8a147.4 ± 34.70.8338.6 ± 45.726.223.1
LVESV (mL)119.6 ± 40.4a96.6 ± 30.00.8623.0 ± 39.623.821.3
LVEF (%)35.9 ± 9.435.1 ± 9.50.710.7 ± 12.82.22.2
LAESV (mL)69.4 ± 33.1a60.4 ± 26.50.927.5 ± 27.712.511.8
Group C (SWMA, n = 41)
LVEDV (mL)162.5 ± 56.9a121.4 ± 50.80.9041.0 ± 46.733.828.9
LVESV (mL)95.5 ± 40.2a74.2 ± 35.60.9021.3 ± 31.028.725.1
LVEF (%)42.5 ± 8.6a40.0 ± 10.20.802.5 ± 11.06.26.0
LAESV (mL)82.4 ± 57.8a73.2 ± 51.00.899.2 ± 25.712.611.9
Group D (HCM, n = 32)
LVEDV (mL)105.6 ± 31.6a80.0 ± 21.50.5425.5 ± 46.431.927.5
LVESV (mL)40.1 ± 14.0a27.8 ± 8.70.4812.3 ± 20.926.136.2
LVEF (%)62.1 ± 5.6a65.1 ± 5.60.78-2.9 ± 6.5-5.0-4.6
LAESV (mL)83.1 ± 42.1a70.4 ± 30.50.9812.7 ± 31.118.116.6
Repeatability analysis of the results for the different quantitative methods

Because HM-NE is a fully automatic method, the intraobserver and interobserver coefficients of variation were both zero. Among the other methods, except for the repeatability between the observers for group D, the intraobserver and interobserver repeatability of the HM-RE measurements in the other groups was better than those of the other methods. The intra- and interobserver repeatability of the measured values for the different methods in group D was lower than those of the other groups. The intraobserver repeatability of the HM-RE method was slightly higher than the interobserver repeatability, but the difference was small, and its interobserver repeatability was slightly higher than that of the other methods (Table 5).

Table 5 Intraobserver, and interobserver variability (coefficient of variation) for the HeartModel with regional endocardial border editing in 4 Groups (mean ± SD).
GroupIntraobserver (%)
Interobserver (%)
LVEDV (mL)
LVESV (mL)
LVEF (%)
LAESV (mL)
LVEDV (mL)
LVESV (mL)
LVEF (%)
LAESV (mL)
Group A6.6 ± 5.611.1 ± 10.44.2 ± 3.85.8 ± 5.56.7 ± 3.811.3 ± 7.44.2 ± 2.17.2 ± 6.0
Group B6.6 ± 5.110.2 ± 4.98.4 ± 9.48.4 ± 5.17.8 ± 3.210.4 ± 5.28.7 ± 6.38.5 ± 4.8
Group C9.1 ± 7.510.2 ± 7.37.9 ± 11.97.2 ± 7.39.4 ± 5.810.2 ± 7.18.2 ± 6.28.1 ± 6.0
Group D10.3 ± 4.614.9 ± 5.27.1 ± 1.77.5 ± 5.717.1 ± 7.620.1 ± 7.47.8 ± 5.17.7 ± 5.1
DISCUSSION

The accuracy and repeatability of the assessment of left ventricular volume and LVEF are critical in the diagnosis and treatment of heart diseases[1-2], and changes in these parameters can be used to evaluate the effectiveness of drugs or treatments[4]. At present, many methods are employed for assessing left heart volume and function, such as cavitation, radionuclide imaging, magnetic resonance imaging (MRI), computed tomography, and echocardiography[5-9]. Compared with the previous methods, cardiac ultrasound does not involve additional radiation and contrast agents. Although the accuracy of MRI results is higher, its use is limited in certain patients with a history of metal foreign body implantation[10,11]. Although European and American guidelines have recommended the use of 3DE ultrasound to quantify heart volume[12], due to its cumbersomeness and time-consuming nature, currently, left heart volume and ejection fraction are still assessed using the two-dimensional echocardiography (2DE) biplane modified Simpson method[13]. HM is a fully automatic, quantitative cardiac cavity analysis method developed based on 3D ultrasound. Compared with traditional 3DE, HM is easier to operate and boasts better measurement accuracy and repeatability. At present, few studies have compared HM with traditional 2DE and 3DE methods in evaluating the accuracy of left heart volume and function in common clinical heart diseases.

In this study, 3DQA was used as a reference method in assessing patients with atrial fibrillation, pacemaker implantation history and valve replacement history. The HM method was applied to evaluate the accuracy and repeatability in left ventricular volume and function quantification among patients with different common clinical heart diseases and compared with traditional 2DE and 3DE methods. The results showed that the HM method can accurately assess the left atrial volume of common clinical heart disease patients with a high correlation. In the DCM and segmental wall motion abnormality (SWMA) groups, HM quantified left ventricular volume parameters, obtaining values that were highly correlated and larger than those obtained with 3DQA, consistent with the results of Spitzer et al[14] and Tsang et al[15]. A meta-analysis by Kitano et al[16] also showed that although compared with MRI, the 3DE method underestimates the left ventricular volume, the LVEF value obtained was similar [confidence interval (CI) -0.6% and -1.1%, respectively], and using HM can further improve the accuracy and repeatability of the measurement. The results of this study and those of Feng Cheng et al[17], conducted on 156 subjects, showed that HM is highly correlated with the measured value of 3DQA (r = 0.90-0.97). The accuracy and repeatability of the quantitative measurement of left ventricular volume with HM in the HCM group were lower than those in the other groups, and the correlation could not be improved with manual fine-tuning. These errors arise from the insufficient spatial resolution of 3DE, the further reduced left ventricular systolic volume of HCM patients, and the inability of the software to correctly distinguish the borders of the endocardium, resulting in insufficient reconstruction[18]. Although the accuracy of the quantitative HM-NE and HM-RE measurements of the patients in the DCM group were both high, the LVEF needed to be manually fine-tuned, and the measured values of the left heart obtained by HM-NE and HM-RE were not significantly different (P = 0.05-0.86). In this study, the results obtained in the SWMA group were different from the results of Cai et al[19]. They used HM to quantify the heart parameters of 72 patients with left ventricular remodeling after myocardial infarction and concluded that the LVEF obtained by the three types of HM(HM-NE, HM-GE, HM-RE) were not significantly different from that of the 3DQA method (P = 0.39 and 1.00). The left ventricular parameters obtained by HM-RE had the highest correlation with those obtained by the 3DQA method (r = 0.88-0.93).

The left ventricular volume and LVEF obtained by HM through different methods were different among patients with different cardiovascular diseases. For example, in the DCM group, the difference in the quantitatively measured LAESV by the HM-RE and 3DQA methods was greater than that in the other groups, but the correlation for LVEDV, LVESV and LVEF between the two groups was lower. In the SWMA group, the differences in the values of LVEDV, LVESV and LVEF measured by HM were greater than those of the other groups. Therefore, the morphological changes of the heart cavity and the contour of the endocardial surface directly affect the measurement results of HM. In patients with enlarged hearts, in the process of obtaining 3D images, the increase in scanning angle leads to a decrease in frame rate, which affects IQ. For patients with significantly enlarged hearts, HM is even unable to obtain a complete 3D image for analysis.

A considerable number of heart patients are shown to have atrial fibrillation in routine clinical practice. Therefore, some studies recommend measuring several consecutive cardiac cycles to obtain the average value of the quantitative parameters[20].Guidelines from the American Society of Echocardiography and the European Cardiovascular Imaging Association indicate that the assessment of patients with atrial fibrillation must include at least 5 cardiac cycles[1]. However, the guidelines also indicate that it is feasible to use representative cardiac cycles to obtain quantitative parameters in clinical practice. Otani et al[21] used HM to automatically quantify and manually track the left ventricular volume and LVEF of 88 patients with atrial fibrillation. The results showed that the measurements from HM were highly correlated with those from 3DQA (r = 0.88-0.98), and left ventricular function in particular had high repeatability [coefficient of variability (CV) < 5%], indicating that HM could be used to assess atrial fibrillation. The study also used HM to evaluate the left heart parameters of all patients for 10 consecutive cardiac cycles and found that the LVEF of all patients had the highest variability (36%), indicating that random selection of a cardiac cycle may underestimate or overestimate this parameter. However, there was a good linear correlation between the average quantitative left ventricular parameters obtained through multiple cardiac cycles and the measured values (r = 0.94-0.99) obtained from a single cardiac cycle when a regular normal heart rhythm was used, and the coefficient of variation of the left ventricular quantitative parameters remained low (3.5%-4.8%). This study shows that the repeatability of HM-RE is better than that of traditional 2DE and 3DE, but the coefficient of variation of the retest was lower than that of Otani et al[21].

Limitations

First, the study excluded patients with a poor acoustic window who were unable to perform a breathhold; therefore, the feasibility and accuracy of the study results cannot be extended to all patients. Second, only the traditional 3DQA measurement was used as the standard, and MRI measurements were not used; however, previous studies confirmed that the two measurement methods demonstrate a good correlation. Third, previous studies[22] showed that when the default HM value was 80-40, the intraobserver and interobserver coefficients of variation were low (3%-9%), and the correlation with MRI was above 0.91. However, in patients with severe ventricular dilatation and an LVEF ≤ 50%, the consistency with MRI was higher when the boundary was set to HM90-50, but in this study, we used a preset value of HM80-40 and did not make any comparisons with HM90-50. Further study is required to determine the effect of the two preset values. Finally, the sample size of this study was small and should be further increased in the future to evaluate the application value of HM in all patients with common clinical cardiovascular diseases.

CONCLUSION

HM can conveniently and accurately quantify the left ventricular volume and ejection fraction of patients with common heart diseases. Manual adjustment is highly repeatable and will further improve accuracy; thus, HM with manual adjustment should be popularized and applied in clinical practice.

ARTICLE HIGHLIGHTS
Research background

This study used HeartModel (HM), a new software to quickly quantify the left heart volume and left ventricular function in patients with common heart diseases to determine whether there are differences in the feasibility, accuracy, and repeatability of measuring the left ventricular end-diastolic (LVEDV), LV ejection fraction (LVEF) and left atrial end-systolic volume (LAESV) and to compare these measurements with those obtained with traditional methods.

Research motivation

Compared with traditional three-dimensional echocardiography (3DE), HM is easier to operate and boasts better measurement accuracy and repeatability. At present, the application value of HM in quantifying left heart volume and left ventricular function in patients with common heart diseases remains unclear.

Research objectives

The study aimed to assess the value of HM in quantifying the left heart volume and left ventricular function of patients with common heart diseases.

Research methods

This study retrospectively assessed patients with common heart diseases who were divided into 4 groups: (1) Patients with normal heart shape and function (control group, Group A); (2) patients with dilated cardiomyopathy (DCM) (Group B); (3) patients with LV remodeling after acute myocardial infarction (Group C); and (4) patients with hypertrophic cardiomyopathy (HCM) (Group D). The measurements obtained were assessed.

Research results

HM without regional endocardial border editing (HM-NE) quantified left ventricular volume parameters, obtaining values that were highly correlated and larger than those obtained with advanced cardiac 3D quantification (3DQA) (bias: LVEDV, 28.17 mL; LVESV, 14.92 mL; LAESV, 8.18 mL; LVEF, -0.04%). The correlations between HM without regional endocardial border editing (HM-RE) and 3DQA (rs= 0.91-0.95, P < 0.05 for all) were higher than those between HM-NE (rs= 0.85-0.93, P < 0.05 for all). The correlations of LVEDV and LVESV between HM-RE and 3DQA were good for the control group, dilated cardiomyopathy group and segmental wall motion abnormality group, but remained weak for the HCM group (rs= 0.48-0.54, P < 0.05 for all). The intraobserver and interobserver variability for the HM-RE measurements were low.

Research conclusions

HM can accurately assess the left atrial volume of common clinical heart disease and fibrillation patients with a high correlation.

Research perspectives

Future studies should increase the sample size and are confirm that these findings can be extended to more patients.

ACKNOWLEDGEMENTS

We immensely thank all the patients for their willingness to share clinical data for research.

Footnotes

Provenance and peer review: Unsolicited article; Externally peer reviewed.

Peer-review model: Single blind

Specialty type: Radiology, nuclear medicine and medical imaging

Country/Territory of origin: China

Peer-review report’s scientific quality classification

Grade A (Excellent): 0

Grade B (Very good): 0

Grade C (Good): C

Grade D (Fair): 0

Grade E (Poor): 0

P-Reviewer: Schoenhagen P, United States S-Editor: Chen YL L-Editor: A P-Editor: Chen YL

References
1.  Lang RM, Badano LP, Mor-Avi V, Afilalo J, Armstrong A, Ernande L, Flachskampf FA, Foster E, Goldstein SA, Kuznetsova T, Lancellotti P, Muraru D, Picard MH, Rietzschel ER, Rudski L, Spencer KT, Tsang W, Voigt JU. Recommendations for cardiac chamber quantification by echocardiography in adults: an update from the American Society of Echocardiography and the European Association of Cardiovascular Imaging. Eur Heart J Cardiovasc Imaging. 2015;16:233-270.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 3897]  [Cited by in F6Publishing: 4787]  [Article Influence: 531.9]  [Reference Citation Analysis (0)]
2.  White HD, Norris RM, Brown MA, Brandt PW, Whitlock RM, Wild CJ. Left ventricular end-systolic volume as the major determinant of survival after recovery from myocardial infarction. Circulation. 1987;76:44-51.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 1690]  [Cited by in F6Publishing: 1594]  [Article Influence: 43.1]  [Reference Citation Analysis (0)]
3.  Muraru D, Badano LP, Ermacora D, Piccoli G, Iliceto S. Sources of variation and bias in assessing left ventricular volumes and dyssynchrony using three-dimensional echocardiography. Int J Cardiovasc Imaging. 2012;28:1357-1368.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 25]  [Cited by in F6Publishing: 24]  [Article Influence: 1.8]  [Reference Citation Analysis (0)]
4.  Kalogeropoulos AP, Georgiopoulou VV, Gheorghiade M, Butler J. Echocardiographic evaluation of left ventricular structure and function: new modalities and potential applications in clinical trials. J Card Fail. 2012;18:159-172.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 27]  [Cited by in F6Publishing: 29]  [Article Influence: 2.4]  [Reference Citation Analysis (0)]
5.  Geiser EJ. Three-dimensional echocardiographic reconstruction: how does it stack up? Int J Cardiol. 1985;7:77-81.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 11]  [Cited by in F6Publishing: 11]  [Article Influence: 0.3]  [Reference Citation Analysis (0)]
6.  Dorosz JL, Lezotte DC, Weitzenkamp DA, Allen LA, Salcedo EE. Performance of 3-dimensional echocardiography in measuring left ventricular volumes and ejection fraction: a systematic review and meta-analysis. J Am Coll Cardiol. 2012;59:1799-1808.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 275]  [Cited by in F6Publishing: 274]  [Article Influence: 22.8]  [Reference Citation Analysis (0)]
7.  Acar P, Maunoury C, Antonietti T, Bonnet D, Sidi D, Kachaner J. Left ventricular ejection fraction in children measured by three-dimensional echocardiography using a new transthoracic integrated 3D-probe. A comparison with equilibrium radionuclide angiography. Eur Heart J. 1998;19:1583-1588.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 36]  [Cited by in F6Publishing: 40]  [Article Influence: 1.5]  [Reference Citation Analysis (0)]
8.  Buck T, Hunold P, Wentz KU, Tkalec W, Nesser HJ, Erbel R. Tomographic three-dimensional echocardiographic determination of chamber size and systolic function in patients with left ventricular aneurysm: comparison to magnetic resonance imaging, cineventriculography, and two-dimensional echocardiography. Circulation. 1997;96:4286-4297.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 125]  [Cited by in F6Publishing: 127]  [Article Influence: 4.7]  [Reference Citation Analysis (0)]
9.  Vieira ML, Oliveira WA, Cordovil A, Rodrigues AC, Mônaco CG, Afonso T, Lira Filho EB, Perin M, Fischer CH, Morhy SS. 3D Echo pilot study of geometric left ventricular changes after acute myocardial infarction. Arq Bras Cardiol. 2013;101:43-51.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 4]  [Cited by in F6Publishing: 8]  [Article Influence: 0.7]  [Reference Citation Analysis (0)]
10.  Vieira ML, Nomura CH, Tranchesi B Jr, de Oliveira WA, Naccarato G, Serpa BS, Passos RB, Funari MB, Fischer CH, Morhy SS. Real-time three-dimensional echocardiographic left ventricular systolic assessment: side-by-side comparison with 64-slice multi-detector cardiac computed tomography. Eur J Echocardiogr. 2010;11:257-263.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 6]  [Cited by in F6Publishing: 9]  [Article Influence: 0.6]  [Reference Citation Analysis (0)]
11.  Müller H, Frangos C, Fleury E, Righetti A, Lerch R, Burri H. Measurement of left ventricular ejection fraction by real time 3D echocardiography in patients with severe systolic dysfunction: comparison with radionuclide angiography. Echocardiography. 2010;27:58-63.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 7]  [Cited by in F6Publishing: 8]  [Article Influence: 0.5]  [Reference Citation Analysis (0)]
12.  Lang RM, Badano LP, Tsang W, Adams DH, Agricola E, Buck T, Faletra FF, Franke A, Hung J, de Isla LP, Kamp O, Kasprzak JD, Lancellotti P, Marwick TH, McCulloch ML, Monaghan MJ, Nihoyannopoulos P, Pandian NG, Pellikka PA, Pepi M, Roberson DA, Shernan SK, Shirali GS, Sugeng L, Ten Cate FJ, Vannan MA, Zamorano JL, Zoghbi WA; American Society of Echocardiography;  European Association of Echocardiography. EAE/ASE recommendations for image acquisition and display using three-dimensional echocardiography. Eur Heart J Cardiovasc Imaging. 2012;13:1-46.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 355]  [Cited by in F6Publishing: 352]  [Article Influence: 29.3]  [Reference Citation Analysis (0)]
13.  Ruddox V, Mathisen M, Bækkevar M, Aune E, Edvardsen T, Otterstad JE. Is 3D echocardiography superior to 2D echocardiography in general practice? Int J Cardiol. 2013;168:1306-1315.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 24]  [Cited by in F6Publishing: 27]  [Article Influence: 2.5]  [Reference Citation Analysis (0)]
14.  Spitzer E, Ren B, Soliman OI, Zijlstra F, Van Mieghem NM, Geleijnse ML. Accuracy of an automated transthoracic echocardiographic tool for 3D assessment of left heart chamber volumes. Echocardiography. 2017;34:199-209.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 13]  [Cited by in F6Publishing: 15]  [Article Influence: 2.1]  [Reference Citation Analysis (0)]
15.  Tsang W, Salgo IS, Medvedofsky D, Takeuchi M, Prater D, Weinert L, Yamat M, Mor-Avi V, Patel AR, Lang RM. Transthoracic 3D Echocardiographic Left Heart Chamber Quantification Using an Automated Adaptive Analytics Algorithm. JACC Cardiovasc Imaging. 2016;9:769-782.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 132]  [Cited by in F6Publishing: 145]  [Article Influence: 18.1]  [Reference Citation Analysis (0)]
16.  Kitano T, Nabeshima Y, Otsuji Y, Negishi K, Takeuchi M. Accuracy of Left Ventricular Volumes and Ejection Fraction Measurements by Contemporary Three-Dimensional Echocardiography with Semi- and Fully Automated Software: Systematic Review and Meta-Analysis of 1,881 Subjects. J Am Soc Echocardiogr. 2019;32:1105-1115.e5.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 14]  [Cited by in F6Publishing: 10]  [Article Influence: 2.0]  [Reference Citation Analysis (0)]
17.  Feng C, Chen L, Li J, Wang J, Dong F, Xu J. Three-dimensional echocardiographic measurements using automated quantification software for big data processing. J Xray Sci Technol. 2017;25:313-321.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 2]  [Cited by in F6Publishing: 3]  [Article Influence: 0.4]  [Reference Citation Analysis (0)]
18.  Mor-Avi V, Jenkins C, Kühl HP, Nesser HJ, Marwick T, Franke A, Ebner C, Freed BH, Steringer-Mascherbauer R, Pollard H, Weinert L, Niel J, Sugeng L, Lang RM. Real-time 3-dimensional echocardiographic quantification of left ventricular volumes: multicenter study for validation with magnetic resonance imaging and investigation of sources of error. JACC Cardiovasc Imaging. 2008;1:413-423.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 272]  [Cited by in F6Publishing: 250]  [Article Influence: 16.7]  [Reference Citation Analysis (0)]
19.  Cai Q, Wang J, Li H, Li C, Wu X, Lu X. Measurement of Left Ventricular Volumes and Ejection Fraction in Patients with Regional Wall Motion Abnormalities Using an Automated 3D Quantification Algorithm. Ultrasound Med Biol. 2018;44:2274-2282.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 3]  [Cited by in F6Publishing: 2]  [Article Influence: 0.3]  [Reference Citation Analysis (0)]
20.  Peltier M, Leborgne L, Zoubidi M, Slama M, Tribouilloy CM. Prognostic value of short-deceleration time of mitral inflow E velocity: implications in patients with atrial fibrillation and left-ventricular systolic dysfunction. Arch Cardiovasc Dis. 2008;101:317-325.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 9]  [Cited by in F6Publishing: 9]  [Article Influence: 0.6]  [Reference Citation Analysis (0)]
21.  Otani K, Nakazono A, Salgo IS, Lang RM, Takeuchi M. Three-Dimensional Echocardiographic Assessment of Left Heart Chamber Size and Function with Fully Automated Quantification Software in Patients with Atrial Fibrillation. J Am Soc Echocardiogr. 2016;29:955-965.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 56]  [Cited by in F6Publishing: 43]  [Article Influence: 5.4]  [Reference Citation Analysis (0)]
22.  Levy F, Dan Schouver E, Iacuzio L, Civaia F, Rusek S, Dommerc C, Marechaux S, Dor V, Tribouilloy C, Dreyfus G. Performance of new automated transthoracic three-dimensional echocardiographic software for left ventricular volumes and function assessment in routine clinical practice: Comparison with 3 Tesla cardiac magnetic resonance. Arch Cardiovasc Dis. 2017;110:580-589.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 31]  [Cited by in F6Publishing: 34]  [Article Influence: 4.9]  [Reference Citation Analysis (0)]