http://orcid.org/0000-0002-0676-2116
Figures
Abstract
Purpose
To evaluate the interobserver reproducibility of two-dimensional shear wave elastography (2D-SWE) in measuring liver stiffness (LS) and to investigate factors related to liver 2D-SWE.
Materials and methods
A prospective study was conducted between August 2011 and August 2012 in rheumatoid arthritis patients who had been treated with methotrexate. Interobserver reproducibility of 2D-SWE was evaluated, and the relationship between interobserver difference in LS and related factors was analyzed using linear regression analyses. We considered age, sex, alanine transaminase, cholesterol, body mass index (BMI), and waist circumference as clinical factors, and the mean value of standard deviation (SDM), its difference between two examiners, mean diameter of the regions of interest (ROIM), and its difference in the elasticity map as investigation factors. The cut-off value for significant factors to predict interobserver discrepancies in LS-based fibrosis stage was also inspected.
Results
In total, 176 patients were enrolled. The intraclass correlation coefficient between the two examiners was 0.784. In the univariate analysis, SDM and ROIM were independently associated with interobserver differences in LS as well as BMI, waist circumference, and the difference of ROI, but SDM and ROIM were the only ones significantly related in multivariate analysis (p<0.001 and p = 0.021, respectively). The best cut-off value for SDM in predicting interobserver discrepancy in LS-based fibrosis stage was 1.4.
Citation: Yoon K, Jeong WK, Kim Y, Kim MY, Kim TY, Sohn JH (2017) 2-dimensional shear wave elastography: Interobserver agreement and factors related to interobserver discrepancy. PLoS ONE 12(4): e0175747. https://doi.org/10.1371/journal.pone.0175747
Editor: Antoine Nordez, Universite de Nantes, FRANCE
Received: October 20, 2016; Accepted: March 30, 2017; Published: April 17, 2017
Copyright: © 2017 Yoon et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: The author(s) received no specific funding for this work.
Competing interests: The authors have declared that no competing interests exist.
Abbreviations: 2D-SWE, two-dimensional shear wave elastography; ALT, alanine transaminase; AUC, area under the curve; BMI, body mass index; ICC, intraclass correlation coefficient; LS, liver stiffness; ROC, receiver operating characteristic; ROI, region of interest; ROIM, the mean diameter of regions of interest; SD, standard deviation; SDM, the mean value of standard deviations; US, ultrasonography
Introduction
The measurement of liver stiffness (LS) using ultrasound (US) elastography, widely used for the estimation of hepatic fibrosis by viral hepatitis, is increasingly being used in patients with hepatic injuries from various causes [1, 2]. Although hepatic fibrosis evaluated by histopathologic examination is currently considered the diagnostic method of choice, US elastography was developed as a non-invasive alternative method to overcome the disadvantages of biopsy, including invasiveness, sampling error, and interpretational variability [3]. Transient elastography is on the frontier of US elastography, and is useful for detection of liver cirrhosis, prediction of variceal development, and evaluation of response to anti-viral treatments [4, 5]. The clinical utility of various types of US elastography has been well documented [6, 7].
Two-dimensional shear wave elastography (2D-SWE), which uses shear wave speed to create an elasticity map [8], has some advantages compared with transient elastography: higher accuracy; integration into conventional ultrasound; developed discrimination using a broad bandwidth; and improved diagnostic efficiency using a real-time quantitative elasticity map [9, 10, 11]. Nevertheless, interobserver agreement of 2D-SWE has not been verified, in contrast to transient elastography. Several studies have focused on the reproducibility of LS using 2D-SWE [12, 13, 14], but the study design had some limitations. First, it included only a small number of subjects and all were healthy volunteers. Second, the experience level of the examiners was too variable (range, novice to expert). Third, their result was not about the subjects who underwent elastography for screening of liver fibrosis. Fourth, they did not consider the reliability parameter of a single measurement such as standard deviation (SD) in the region of interest (ROI) associated to the reliability of 2-D elastography.
To clarify these issues, we designed a study to verify the reproducibility of 2D-SWE in a situation similar to clinical practice, such as screening for hepatic fibrosis in patients with long-term administration of methotrexate for the treatment of rheumatoid arthritis. The aims of this prospective study were to evaluate the interobserver reproducibility of 2D-SWE and to assess the clinical and investigation factors related to reproducibility of 2D-SWE in assessing liver elasticity.
Materials and methods
Patients
The present study was a single-center prospective observational study and was approved by the institutional review board of Hanyang University Guri Hospital (2011–039). We studied the prospective cohort of a concurrent study about LS of rheumatoid arthritis patients who had been treated with methotrexate and who provided written informed consent between August 2011 and August 2012 [15]. The inclusion criteria were consecutive patients diagnosed with rheumatoid arthritis, treated with methotrexate. The exclusion criteria were as followings: 2D-SWE examination was not performed by two examiners on the same day, technical failure of 2D-SWE due to artifacts or an unsaturated elasticity map (less than 50% of the color map), lack of patient cooperation, unavailable clinical data, and serum alanine transaminase (ALT) level over 100 U/L, because increased ALT levels suggest the necroinflammation of hepatocytes and may disturb the prediction of fibrosis in the patients treated with methotrexate.
Medical records were reviewed and the following parameters collected for each patient at the time of 2D-SWE examination: age, sex, serum ALT level, serum cholesterol level, body mass index (BMI), and waist circumference.
Liver stiffness measurement
LS measurement by 2D-SWE was performed following conventional liver US. The patients fasted for approximately eight hours before the examination with an US machine equipped with an SWE module (Aixplorer version 3, Supersonic imagine, Aix-en-Provence, France) and a convex broadband probe (SC6-1). Three staff radiologists (W.K.J., Y.K., and M.Y.K.) alternately performed 2D-SWE in pairs each day. The three examiners had more than 9 years of clinical experience in abdominal radiology and each had used 2D-SWE more than 100 times to measure LS. During expiration, a trapezoidal color elasticity map was positioned on the right liver through the intercostal sonic window to enable a good view of the liver parenchyma, and then the round ROI was placed in the elasticity map to measure the mean value and SD of the elasticity (Fig 1). Generally, we kept the following guidelines for liver stiffness measurement: 1) LS is measured by round ROI when the color map is saturated as large as possible; 2) the depth of measurement ranged 2-5cm from the liver capsule to avoid artifact around liver capsule; 3) the diameter of ROI is 20 mm of dimension, but it is changeable to the situation (e.g. the color map is not fully saturated (due to multiple defective areas). The measurement was repeated five times by each examiner, and all were blinded to the results of the other examiners [16]. The median value of the five repetitions was used to represent LS. We also calculated the mean value of SDs (SDM) and mean diameter of the regions of interest (ROIM) in the elasticity map to inspect their relationship with LS.
The trapezoidal colored box shows the distribution of elasticity in liver tissue, and the round ROI (Q-box) is located to measure elasticity. Measured values are displayed on the right side of the screen: Mean is the mean value of elasticity in the ROI; Min is the minimum elasticity; Max is the maximum elasticity; Std Dev is the standard deviation of elasticity in the ROI; and Diam is the diameter of the ROI.
Statistical analysis
We reviewed the distribution of parametric variables, LS, SDM, and ROIM and found that the histograms of these parameters seemed to be skewed left, so these variables were log transformed and validated as having a normal distribution before statistical analysis.
Interobserver agreement of LS, SDM, and ROIM.
We calculated the intraclass correlation coefficient (ICC) to evaluate interobserver reproducibility of mean and median LS, SDM, and ROIM between the first and second observations [17]. The ICC used a variance component analysis for a two-way mixed effects model without interaction variance [e.g. ICC (3, 1)], which was type A ICC using an absolute agreement definition between the measurements. The following scoring system was used: ICC ≥ 0.87, excellent; 0.87 > ICC ≥ 0.71, good; 0.71 > ICC ≥ 0.50, fair; and ICC < 0.5, poor agreement [18].
Factors related to interobserver differences in LS.
To explore interobserver differences, we calculated the absolute difference in LS between two consequent observations. SDM, ROIM, difference in SDM between two observations, difference in ROIM between two observations, and the clinical factors mentioned above were considered as possibly related factors. Univariate linear regression analysis was performed, and variables with a p value < 0.20 during univariate analysis were included in multivariate analysis.
Factors related to interobserver discrepancies in LS-based fibrosis stage.
Liver fibrosis in every patient was staged by two examiners using 2D-SWE on four scales according to the classification system previously suggested by our group: F0-F1 = LS ≤ 8.60 kPa; F2 = 8.60 kPa < LS ≤ 10.46 kPa; F3 = 10.46 kPa < LS ≤ 14.00 kPa; and F4 = LS > 14 kPa [19]. We then investigated which factors among BMI, waist circumference, SDM, and ROIM were related to interobserver discrepancies in liver fibrosis using a stepwise multivariate logistic regression analysis, and mean LS was considered as a covariant to correct the size of discrepancy between high and low levels of the LS. Diagnostic performance was evaluated using receiver operating characteristic (ROC) curve analysis. The optimal cut-off was specified by the maximum Youden’s index.
Statistical analyses were performed using SPSS for Windows (version 23; SPSS Inc. Chicago, IL) and MedCalc for Windows (version 14.12.0; MedCalc Software, Mariakerke, Belgium). A p value of < 0.05 was considered to be statistically significant.
Results
Enrolled subjects
A total of 202 patients (45 men, 157 women; mean age, 54.0 ± 9.5 years; age range, 29–78 years) who met the inclusion criteria were eligible for this study, but 10 patients were examined by only one examiner due to the physicians’ schedules and LS measurements were not obtained for two patients (1.0% of eligible subjects) due to noncooperation or poor image quality. Among the rest, 14 patients were additionally excluded: laboratory data such as serum cholesterol or ALT levels were not available in 10 patients, and four patients had a serum ALT level over 100 U/L. Therefore, 176 patients (87.1%) were subsequently enrolled (Fig 2). Their demographic, clinical, laboratory, and radiologic characteristics at the time of 2D-SWE examination are listed in Table 1. There were 40 males (22.7%) and 136 females (77.3%) with a mean age of 54.2 ± 9.8 years. Among them, 28.4% (n = 50) were elderly (≥ 60 years old). BMI and waist circumference were investigated in only 168 patients, and the mean waist circumference was 80.8 ± 8.8 cm. The proportion of high BMI (≥ 25 kg/m2) was 26.7% (n = 47).
Interobserver reproducibility of 2D-SWE
The single measurement of ICC (3, 1) was 0.725 (95% confidence interval (CI), 0.647–0.788) for median LS; 0.784 (95% CI, 0.720–0.835) for mean LS; 0.521 (95% CI, 0.404–0.622) for SDM (Fig 3); and 0.242 (95% CI, 0.102–0.374) for ROIM, respectively.
The ICC values are 0.783 for liver stiffness and 0.521 for SDM, respectively.
Factors related to interobserver differences in LS
In the univariate linear regression analysis, BMI, waist circumference, SDM, ROIM, and difference of ROIM were associated with interobserver differences in LS (p = 0.020, p = 0.019, p < 0.001, p < 0.001, and p = 0.009, respectively). In multivariate linear regression analysis, however, only SDM and ROIM remained independently associated with the interobserver difference of LS (p < 0.001 and p = 0.021, respectively) (Table 2).
Factors related to interobserver discrepancy in LS-based fibrosis stage
Discordance of at least one stage of fibrosis between both measurements was noted in 15 pairs of measurement (8.52%), discordance of at least two stages was noted in six pairs (1.14%), and discordance of three stages was noted in one pair (0.57%) (S1 Table). Significantly related factors of these discrepancies were waist circumference (p = 0.018) and SDM (p = 0.008) in the multivariate logistic regression analysis. ROC curve analysis was carried out to assess the association between interobserver discrepancy in LS-based fibrosis stage and the waist circumference and SDM. The corresponding area under the ROC curve (AUC) values were 0.798 (95% CI, 0.729 to 0.856) for waist circumference and 0.894 (95% CI, 0.839 to 0.936) for SDM (Table 3). AUC of SDM was significantly higher than the other variables in predicting interobserver discrepancy in liver fibrosis. The differences between these AUC values of waist circumference and SDM were not statistically significant (p = 0.129). Fig 4 shows the ROC curves for waist circumference and SDM for the diagnosis of interobserver discrepancy in liver fibrosis. The data-driven best cut-off value for SDM was 1.4.
Discussion
In this prospective study, we found that some of the parameters during measurement could be related to interobserver agreement of LS. These investigation factors, such as SD of ROI or interquartile range of LS measurements, have been used in elastography as a reliability standard [15, 20, 21, 22, 23]. In a study evaluating interobserver concordance in the assessment of liver fibrosis in human immunodeficiency virus/hepatitis C virus-coinfected patients using transient elastography, interquartile range was associated with the absolute values of the difference between two examiners [21]. High BMI and low-grade fibrosis are also related to lower interobserver concordance [22]. Our study also found that BMI and waist circumstance were significant factors in increasing interobserver differences in the univariate analyses, but not in the multivariate analysis. On the other hand, the investigation factors, SDM and ROIM, were significant in assessing interobserver differences of LS values by 2D-SWE for both the univariate and multivariate analyses. These investigation factors have merit, in that the examiner can immediately recognize and adjust using them during examination of LS measurement.
SD has been proposed as a reliable criterion before. Recently, Thiele and his colleagues introduced SD and coefficient of variation (SD divided by the numerical mean) as objectively reliable criteria [20]. Because the coefficient of variation is widely used to express the precision and repeatability of a chemical assay, they tested new criteria, including SD and coefficient of variation, to evaluate the precision of the diagnosis of liver cirrhosis and clinically significant portal hypertension (≥ 10 mmHg of hepatic venous pressure gradient) and revealed that measurements with lower SD and larger ROI were most accurate for the diagnosis of both. However, they did not address whether these reliable criteria would also be useful to evaluate the repeatability of measurements such as interobserver agreement, so we dealt with this issue in the present study.
Along with SDM, the multivariate analysis indicated that ROIM was also a significant factor that influenced interobserver differences in the measurement of LS. As ROIM increased, interobserver difference of LS decreased. Bilgili et al. also observed an effect of ROI size on interobserver variance [24]. A smaller ROI can make the chances of sampling error increased; on the other hand, a larger ROI is more vulnerable to heterogeneity. However, the examiners generally prefer that the ROI is as large as possible for sufficient sampling. These investigation factors might have some advantages. First, because the SD and ROI diameter are displayed on the monitor along with mean stiffness value as soon as the examiner performs a single measurement, they can help the examiner determine the reliability of the 2D-SWE examination at once, rather than after the end of all measurements (transient elastography requires 10 repetitions to check the reliability of the measurements). Second, they encourage examiners to make a more homogeneous and saturated filling of the color map without any large defects controlling patients’ breathing and changing location of the transducer in the intercostal space. Pellot-Barakat et al. revealed that breathing motion could degrade the data quality of LS including the percent of non-filling in the color map and the LS measurement during an apneic status was superior to that during free breathing [25]. Our data quality was not inferior because we performed LS measurement during an expiratory apneic status.
In ROC curve analysis, we found a significant association between parameters including BMI, waist circumference, and SDM and interobserver discrepancy in LS-based fibrosis stage. Among them, SDM had the largest AUC value, and the best cut-off value for SDM was 1.4 (86.67% sensitivity, 85.09% specificity). As the AUC value of a factor increases, that factor may more precisely predict over- or under-staging. As a result, an SDM higher than 1.4 increased the risk of discordance in LS-based fibrosis stage by 2D-SWE. Patients with BMI higher than 23.8 kg/m2 and a waist circumference larger than 84 cm also risked interobserver discrepancy in liver fibrosis. Among them, the SDM was the best parameter, but there was no statistically significant difference based on waist circumference or BMI.
An important caveat in the results of the present study is that these values should be applied in patients with less severe degrees of fibrosis, not cirrhosis, because our patients had a relatively mild form of hepatic fibrosis from long-term administration of methotrexate for the treatment of rheumatoid arthritis. Microscopically, fibrotic structures in cirrhosis are heterogeneous, increasing the SD of a single measurement of elastography. Accordingly, SD would not be applied as a parameter for interobserver variability in cirrhotic patients, and additional study is needed for that setting.
We found that 2D-SWE was a reproducible and noninvasive method for LS measurement. Good interobserver agreement for LS measurement was shown, and most cases (91%) were concordant in classifying LS-based fibrosis stage. Interobserver agreement for SDM was considered fair. Ferraioli et al. [12] assessed intraobserver and interobserver reproducibility of SWE in 42 healthy volunteers without analyzing clinical factors. In contrast, the present study evaluated interobserver agreement of 2D-SWE for screening of hepatic fibrosis in a larger number of patients with long-term medication of the hepatotoxic drug methotrexate.
Nevertheless, our study had several limitations. First, we were unable to consider some factors possibly relating to LS measurement, such as thickness of the subcutaneous fat layer [26]. Second, three radiologists alternated performing 2D-SWE in pairs each day based on random allocation. Because their experience levels were not exactly the same, there could potentially be an interobserver variability depending on the combination differences of the pairs of examiners (e.g. examiner A & B; B & C; C & A).
Conclusions
Interobserver reproducibility of 2D-SWE in measuring LS in non-cirrhotic liver was good. SDM and ROIM were associated with interobserver differences of LS, and SDM offers a reference factor for the examiner to minimize discordance in LS-based fibrosis stage.
Supporting information
S1 Table. LS-based fibrosis stage by two examiners using cutoff values of liver stiffness with 2D-SWE.
Fifteen cases (8.52%) were discordant between two examiners. Cutoff values for LS-based fibrosis stage were referred from [19].
https://doi.org/10.1371/journal.pone.0175747.s001
(DOC)
S1 Dataset. All laboratory, liver stiffness, standard deviation, and ROI diameters are included.
https://doi.org/10.1371/journal.pone.0175747.s002
(XLSX)
Acknowledgments
The authors had full responsibility for the design of the study, the analysis and interpretation of the data, and the writing of the manuscript.
Author Contributions
- Conceptualization: WKJ.
- Data curation: KY.
- Formal analysis: WKJ.
- Investigation: WKJ YK MYK.
- Methodology: WKJ KY.
- Project administration: KY.
- Resources: WKJ YK MYK.
- Supervision: WKJ.
- Visualization: KY WKJ.
- Writing – original draft: KY WKJ.
- Writing – review & editing: TYK JHS.
References
- 1. Arena U, Stasi C, Mannoni A, Benucci M, Maddali-Bongi S, Cammelli D, et al. Liver stiffness correlates with methotrexate cumulative dose in patients with rheumatoid arthritis. Dig Liver Dis. 2012; 44(2): 149–53. pmid:21930442
- 2. Janssens F, de Suray N, Piessevaux H, Horsmans Y, de Timary P, Stärkel P. Can transient elastography replace liver histology for determination of advanced fibrosis in alcoholic patients: a real-life study. J Clin Gastroenterol. 2010; 44(8): 575–82. pmid:20104185
- 3. Kim SU, Kim JK, Park YN, Han KH. Discordance between liver biopsy and Fibroscan® in assessing liver fibrosis in chronic hepatitis b: risk factors and influence of necroinflammation. PLoS One. 2012; 7(2): e32233. pmid:22384189
- 4. Wong GL, Espinosa WZ, Wong VW. Personalized management of cirrhosis by non-invasive tests of liver fibrosis. Clin Mol Hepatol. 2015; 21(3): 200–11. pmid:26523265
- 5. Jung KS, Kim SU. Clinical applications of transient elastography. Clin Mol Hepatol. 2012; 18(2): 163–73. pmid:22893866
- 6. Jiang T, Tian G, Zhao Q, Kong D, Cheng C, Zhong L, et al. Diagnostic Accuracy of 2D-Shear Wave Elastography for Liver Fibrosis Severity: A Meta-Analysis. PLoS One. 2016; 11(6): e0157219. pmid:27300569
- 7. Bota S, Herkner H, Sporea I, Salzl P, Sirli R, Neghina Am, et al. Meta-analysis: ARFI elastography versus transient elastography for the evaluation of liver fibrosis. Liver Int. 2013; 33(8): 1138–47. pmid:23859217
- 8. Jeong WK, Lim HK, Lee HK, Jo JM, Kim Y. Principles and clinical application of ultrasound elastography for diffuse liver disease. Ultrasonography. 2014; 33(3): 149–60. pmid:25038804
- 9. Ferraioli G, Tinelli C, Bello BD, Micchetti M, Filice G, Filice C. Accuracy of real-time shear wave elastography for assessing liver fibrosis in chronic hepatitis C: a pilot study. Hepatology. 2012; 56(6): 2125–33. pmid:22767302
- 10. Bavu E, Gennisson JL, Couade M, Bercoff J, Mallet V, Fink M, et al. Noninvasive in vivo liver fibrosis evaluation using supersonic shear imaging: a clinical study on 113 hepatitis C virus patients. Ultrasound Med Biol. 2011; 37(9): 1361–73. pmid:21775051
- 11. Cassinotto C, Lapuyade B, Mouries A, Hiriart JB, Vergniol J, Gaye D, et al. Non-invasive assessment of liver fibrosis with impulse elastography: comparison of Supersonic Shear Imaging with ARFI and FibroScan®. J Hepatol. 2014; 61(3): 550–7. pmid:24815876
- 12. Ferraioli G, Tinelli C, Zicchetti M, Above E, Poma G, Gregorio MD, et al. Reproducibility of real-time shear wave elastography in the evaluation of liver elasticity. Eur J Radiol. 2012; 81(11): 3102–6. pmid:22749107
- 13. Hudson JM, Milot L, Parry C, Williams R, Burns PN. Inter-and intra-operator reliability and repeatability of shear wave elastography in the liver: a study in healthy volunteers. Ultrasound Med Biol. 2013; 39(6): 950–5. pmid:23453379
- 14. Woo H, Lee JY, Yoon JH, Kim W, Cho B, Choi BI. Comparison of the reliability of acoustic radiation force impulse imaging and supersonic shear imaging in measurement of liver stiffness. Radiology 2015; 277(3): 881–6. pmid:26147680
- 15. Kim TY, Kim JY, Sohn JH, Lee HS, Bang SY, Kim Y, et al. Assessment of Substantial Liver Fibrosis by Real-time Shear Wave Elastography in Methotrexate-Treated Patients With Rheumatoid Arthritis. J Ultrasound Med. 2015; 34(9): 1621–30. pmid:26269292
- 16. Choi SH, Jeong WK, Kim Y, Lim S, Kwon JW, Kim TY, et al. How many times should we repeat measuring liver stiffness using shear wave elastography?: 5-repetition versus 10-repetition protocols. Ultrasonics. 2016; 72: 158–64. pmid:27529140
- 17. Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979; 86(2): 420–8. pmid:18839484
- 18. Rousselet MC, Michalak S, Dupré F, Croué A, Bedossa P, Saint-André JP, et al. Sources of variability in histological scoring of chronic viral hepatitis. Hepatology. 2005; 41(2): 257–64. pmid:15660389
- 19. Jeong JY, Kim TY, Sohn JH, Kim Y, Jeoung WK, Oh YH, et al. Real time shear wave elastography in chronic liver diseases: accuracy for predicting liver fibrosis, in comparison with serum markers. World J Gastroenterol. 2014; 20(38): 13920–9. pmid:25320528
- 20. Thiele M, Madsen BS, Procopet B, Hansen JF, Møller LM, Detlefsen S, et al. Reliability Criteria for Liver Stiffness Measurements with Real-Time 2D Shear Wave Elastography in Different Clinical Scenarios of Chronic Liver Disease. Ultraschall Med. 2016 Jun 7
- 21. Neukam K, Recio E, Camacho A, Macias J, Rivero A, Mira JA, et al. Interobserver concordance in the assessment of liver fibrosis in HIV/HCV-coinfected patients using transient elastometry. Eur J Gastroenterol Hepatology. 2010; 22(7): 801–7.
- 22. Fraquelli M, Rigamonti C, Casazza G, Conte D, Donato MF, Ronchi G, et al. Reproducibility of transient elastography in the evaluation of liver fibrosis in patients with chronic liver disease. Gut. 2007; 56(7): 968–73. pmid:17255218
- 23. Hollerieth K, Gaßmann B, Wagenpfeil S, Moog P, Vo-Cong MT, Heemann U, et al. Preclinical evaluation of acoustic radiation force impulse measurements in regions of heterogeneous elasticity. Ultrasonography. 2016; 35(4): 345–52. pmid:27599889
- 24. Bilgili Y, Unal B. Effect of region of interest on interobserver variance in apparent diffusion coefficient measures. Am J Neuroradiol. 2004; 25(1): 108–11. pmid:14729538
- 25. Pellot-Barakat C, Chami L, Correas JM, Lefort M, Lucidarme O. Does motion affect liver stiffness estimates in shear wave elastography? Phantom and clinical study. Eur J Radiol. 2016; 85(9): 1645–50. pmid:27501901
- 26. Staugaard B, Christensen PB, Mössner B, Hansen JF, Madsen BS, Søholm J, et al. Feasibility of transient elastography versus real-time two-dimensional shear wave elastography in difficult-to-scan patients. Scand J Gastroenterol. 2016; 51(11): 1354–59. pmid:27310486