1
|
El Mathari S, Bhoera RA, Hopman LHGA, Heidendael J, Malekzadeh A, Nederveen A, van Ooij P, Götte MJW, Kluin J. Disparities in quantification of mitral valve regurgitation between cardiovascular magnetic resonance imaging and trans-thoracic echocardiography: a systematic review. THE INTERNATIONAL JOURNAL OF CARDIOVASCULAR IMAGING 2024:10.1007/s10554-024-03280-y. [PMID: 39499451 DOI: 10.1007/s10554-024-03280-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/31/2024] [Accepted: 10/27/2024] [Indexed: 11/07/2024]
Abstract
Primary mitral regurgitation (MR) is a prevalent valvular heart disease. Therapy stratification for MR depends on accurate assessment of MR severity and left ventricular (LV) dimensions. While trans-thoracic echocardiography (TTE) has been the standard/preferred assessment method, cardiovascular magnetic resonance imaging (CMR) has gained recognition for its superior assessment of LV dimensions and MR severity. Both imaging modalities have their own advantages and limitation for therapy guidance. However, the differences between the two modalities for assessing/grade severity and clinical impact of MR remains unclear. This systematic review aims to evaluate the differences between TTE and CMR in quantifying MR severity and LV dimensions, providing insights for optimal clinical management. A literature search was performed from inception up to March 21st 2023. This resulted in 2,728 articles. After screening, 22 articles were deemed eligible for inclusion in the meta-analysis. The included study variables were, mitral valve regurgitation volume (MRVOL), regurgitation fraction (MRFRAC), LV end-diastolic volume (LVEDV), LV end-systolic volume (LVESV), LV stroke volume (LVSV), and LV ejection fraction (LVEF). TTE showed a significant higher MRVOL (10.4 ml, I2 = 88%, p = 0.002) and MRFRAC (6.3%, I2 = 51%, p = 0.05) compared to CMR, while CMR demonstrated a higher LVEDV (21.9 ml, I2 = 66%, p = < 0.001) and LVESV (16.8 ml, I2 = 0%, p = < 0.001) compared to TTE. Our findings demonstrate substantial disparities in TTE and CMR derived measurements for parameters that play a pivotal role in the clinical stratification guidelines. This discrepancy prompts a critical question regarding the prognostic value of both imaging modalities, which warrants future research.
Collapse
Affiliation(s)
- Sulayman El Mathari
- Department of Cardiothoracic Surgery, Amsterdam University Medical Center, Amsterdam, The Netherlands.
| | - Rahul A Bhoera
- Department of Cardiothoracic Surgery, Amsterdam University Medical Center, Amsterdam, The Netherlands
| | - Luuk H G A Hopman
- Department of Cardiology, Amsterdam University Medical Center, Room D3-221, Meibergdreef 9, 1105 AZ, Amsterdam, The Netherlands
| | - Josephine Heidendael
- Department of Cardiology, Amsterdam University Medical Center, Room D3-221, Meibergdreef 9, 1105 AZ, Amsterdam, The Netherlands
| | - Arjan Malekzadeh
- Medical Library, Amsterdam University Medical Center, Amsterdam, The Netherlands
| | - Aart Nederveen
- Department of Radiology and Nuclear Medicine, Amsterdam University Medical Center, Amsterdam, The Netherlands
| | - Pim van Ooij
- Department of Radiology and Nuclear Medicine, Amsterdam University Medical Center, Amsterdam, The Netherlands
| | - Marco J W Götte
- Department of Cardiology, Amsterdam University Medical Center, Room D3-221, Meibergdreef 9, 1105 AZ, Amsterdam, The Netherlands
| | - Jolanda Kluin
- Department of Cardiothoracic Surgery, Erasmus University Medical Center, Rotterdam, The Netherlands
| |
Collapse
|
2
|
Altes A, Vermes E, Levy F, Vancraeynest D, Pasquet A, Vincentelli A, Gerber BL, Tribouilloy C, Maréchaux S. Quantification of primary mitral regurgitation by echocardiography: A practical appraisal. Front Cardiovasc Med 2023; 10:1107724. [PMID: 36970355 PMCID: PMC10036770 DOI: 10.3389/fcvm.2023.1107724] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2022] [Accepted: 02/20/2023] [Indexed: 03/12/2023] Open
Abstract
The accurate quantification of primary mitral regurgitation (MR) and its consequences on cardiac remodeling is of paramount importance to determine the best timing for surgery in these patients. The recommended echocardiographic grading of primary MR severity relies on an integrated multiparametric approach. It is expected that the large number of echocardiographic parameters collected would offer the possibility to check the measured values regarding their congruence in order to conclude reliably on MR severity. However, the use of multiple parameters to grade MR can result in potential discrepancies between one or more of them. Importantly, many factors beyond MR severity impact the values obtained for these parameters including technical settings, anatomic and hemodynamic considerations, patient's characteristics and echocardiographer' skills. Hence, clinicians involved in valvular diseases should be well aware of the respective strengths and pitfalls of each of MR grading methods by echocardiography. Recent literature highlighted the need for a reappraisal of the severity of primary MR from a hemodynamic perspective. The estimation of MR regurgitation fraction by indirect quantitative methods, whenever possible, should be central when grading the severity of these patients. The assessment of the MR effective regurgitant orifice area by the proximal flow convergence method should be used in a semi-quantitative manner. Furthermore, it is crucial to acknowledge specific clinical situations in MR at risk of misevaluation when grading severity such as late-systolic MR, bi-leaflet prolapse with multiple jets or extensive leak, wall-constrained eccentric jet or in older patients with complex MR mechanism. Finally, it is debatable whether the 4-grades classification of MR severity would be still relevant nowadays, since the indication for mitral valve (MV) surgery is discussed in clinical practice for patients with 3+ and 4+ primary MR based on symptoms, specific markers of adverse outcome and MV repair probability. Primary MR grading should be seen as a continuum integrating both quantification of MR and its consequences, even for patients with presumed "moderate" MR.
Collapse
Affiliation(s)
- Alexandre Altes
- GCS-Groupement des Hôpitaux de l’Institut Catholique de Lille/Lille Catholic Hospitals, Heart Valve Center, Cardiology Department, ETHICS EA 7446, Lille Catholic University, Lille, France
- Division of Cardiology, Department of Cardiovascular Diseases, Cliniques Universitaires St. Luc, Pôle de Recherche Cardiovasculaire (CARD), Institut de Recherche Expérimentale et Clinique (IREC), Université Catholique de Louvain, Brussels, Belgium
| | | | - Franck Levy
- Department of Cardiology, Center Cardio-Thoracique de Monaco, Monaco, Monaco
| | - David Vancraeynest
- Division of Cardiology, Department of Cardiovascular Diseases, Cliniques Universitaires St. Luc, Pôle de Recherche Cardiovasculaire (CARD), Institut de Recherche Expérimentale et Clinique (IREC), Université Catholique de Louvain, Brussels, Belgium
| | - Agnès Pasquet
- Division of Cardiology, Department of Cardiovascular Diseases, Cliniques Universitaires St. Luc, Pôle de Recherche Cardiovasculaire (CARD), Institut de Recherche Expérimentale et Clinique (IREC), Université Catholique de Louvain, Brussels, Belgium
| | - André Vincentelli
- Cardiac Surgery Department, Centre Hospitalier Régional et Universitaire de Lille, Lille, France
| | - Bernhard L. Gerber
- Division of Cardiology, Department of Cardiovascular Diseases, Cliniques Universitaires St. Luc, Pôle de Recherche Cardiovasculaire (CARD), Institut de Recherche Expérimentale et Clinique (IREC), Université Catholique de Louvain, Brussels, Belgium
| | | | - Sylvestre Maréchaux
- GCS-Groupement des Hôpitaux de l’Institut Catholique de Lille/Lille Catholic Hospitals, Heart Valve Center, Cardiology Department, ETHICS EA 7446, Lille Catholic University, Lille, France
| |
Collapse
|
3
|
Abstract
Mitral regurgitation (MR) is a common valvular heart disease and is the second most frequent indication for heart valve surgery in Western countries. Echocardiography is the recommended first-line test for the assessment of valvular heart disease, but cardiovascular magnetic resonance imaging (CMR) provides complementary information, especially for assessing MR severity and to plan the timing of intervention. As new CMR techniques for the assessment of MR have arisen, standardizing CMR protocols for research and clinical studies has become important in order to optimize diagnostic utility and support the wider use of CMR for the clinical assessment of MR. In this Consensus Statement, we provide a detailed description of the current evidence on the use of CMR for MR assessment, highlight its current clinical utility, and recommend a standardized CMR protocol and report for MR assessment. In this Consensus Statement, Garg and colleagues describe the current evidence on the use of cardiovascular magnetic resonance imaging for the assessment of mitral regurgitation, highlight its current clinical utility, and recommend a standardized imaging protocol and report.
Collapse
|
4
|
Quantification of mitral valve regurgitation by 2D and 3D echocardiography compared with cardiac magnetic resonance a systematic review and meta-analysis. Int J Cardiovasc Imaging 2019; 36:279-289. [DOI: 10.1007/s10554-019-01713-7] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/11/2019] [Accepted: 10/04/2019] [Indexed: 10/25/2022]
|
5
|
Liu B, Edwards NC, Pennell D, Steeds RP. The evolving role of cardiac magnetic resonance in primary mitral regurgitation: ready for prime time? Eur Heart J Cardiovasc Imaging 2019; 20:123-130. [PMID: 30364971 PMCID: PMC6343082 DOI: 10.1093/ehjci/jey147] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/19/2018] [Accepted: 09/16/2018] [Indexed: 12/26/2022] Open
Abstract
A fifth of patients with primary degenerative mitral regurgitation continue to present with de novo ventricular dysfunction following surgery and higher rates of heart failure, morbidity, and mortality. This raises questions as to why the left ventricle (LV) might fail to recover and has led to support for better LV characterization; cardiac magnetic resonance (CMR) may play a role in this regard, pending further research and outcome data. CMR has widely acknowledged advantages, particularly in repeatability of measurements of volume and ejection fraction, yet recent guidelines relegate its use to cases where there is discordant information or poor-quality imaging from echocardiography because of the lack of data regarding the CMR-based ejection fraction threshold for surgery and CMR-based outcome data. This article reviews the current evidence regarding the role of CMR in an integrated surveillance and surgical timing programme.
Collapse
Affiliation(s)
- Boyang Liu
- Department of Cardiology, University Hospital Birmingham and Institute of Cardiovascular Science, University of Birmingham, Edgbaston, Birmingham, UK
| | - Nicola C Edwards
- Department of Cardiology, University Hospital Birmingham and Institute of Cardiovascular Science, University of Birmingham, Edgbaston, Birmingham, UK
| | - Dudley Pennell
- CMR Unit, Royal Brompton Hospital, Sydney Street, London, UK
| | - Richard P Steeds
- Department of Cardiology, University Hospital Birmingham and Institute of Cardiovascular Science, University of Birmingham, Edgbaston, Birmingham, UK
| |
Collapse
|
6
|
Nolan MT, Thavendiranathan P. Automated Quantification in Echocardiography. JACC Cardiovasc Imaging 2019; 12:1073-1092. [DOI: 10.1016/j.jcmg.2018.11.038] [Citation(s) in RCA: 29] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/07/2018] [Revised: 11/25/2018] [Accepted: 11/29/2018] [Indexed: 12/19/2022]
|
7
|
Hao GW, Liu Y, Ma GG, Hou JY, Zhu DM, Liu L, Zhang Y, Liu H, Zhuang YM, Luo Z, Tu GW, Yang XM, Chen HY. Reliability of three-dimensional color flow Doppler and two-dimensional pulse wave Doppler transthoracic echocardiography for estimating cardiac output after cardiac surgery. Cardiovasc Ultrasound 2019; 17:5. [PMID: 30944001 PMCID: PMC6448273 DOI: 10.1186/s12947-019-0155-1] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/08/2018] [Accepted: 03/01/2019] [Indexed: 02/07/2023] Open
Abstract
BACKGROUND Three-dimensional color flow Doppler (3DCF) is a new convenient technique for cardiac output (CO) measurement. However, to date, no one has evaluated the accuracy of 3DCF echocardiography for CO measurement after cardiac surgery. Therefore, this single-center, prospective study was designed to evaluate the reliability of three-dimensional color flow and two-dimensional pulse wave Doppler (2D-PWD) transthoracic echocardiography for estimating cardiac output after cardiac surgery. METHODS Post-cardiac surgical patients with a good acoustic window and a low dose or no dose of vasoactive drugs (norepinephrine < 0.05 μg/kg/min) were enrolled for CO estimation. Three different methods (third generation FloTrac/Vigileo™ [FT/V] system as the reference method, 3DCF, and 2D-PWD) were used to estimate CO before and after interventions (baseline, after volume expansion, and after a dobutamine test). RESULTS A total of 20 patients were enrolled in this study, and 59 pairs of CO measurements were collected (one pair was not included because of increasing drainage after the dobutamine test). Pearson's coefficients were 0.260 between the CO-FT/V and CO-PWD measurements and 0.729 between the CO-FT/V and CO-3DCF measurements. Bland-Altman analysis showed the bias between the absolute values of CO-FT/V and CO-PWD measurements was - 0.6 L/min with limits of agreement between - 3.3 L/min and 2.2 L/min, with a percentage error (PE) of 61.3%. The bias between CO-FT/V and CO-3DCF was - 0.14 L/min with limits of agreement between - 1.42 L /min and 1.14 L/min, with a PE of 29.9%. Four-quadrant plot analysis showed the concordance rate between ΔCO-PWD and ΔCO-3FT/V was 93.3%. CONCLUSIONS In a comparison with the FT/V system, 3DCF transthoracic echocardiography could accurately estimate CO in post-cardiac surgical patients, and the two methods could be considered interchangeable. Although 2D-PWD echocardiography was not as accurate as the 3D technique, its ability to track directional changes was reliable.
Collapse
Affiliation(s)
- Guang-Wei Hao
- Department of Critical Care Medicine, Zhongshan Hospital, Fudan University, No. 180 Fenglin Road, Xuhui District, Shanghai, 200032, People's Republic of China
| | - Yang Liu
- Department of Echocardiography, Zhongshan Hospital, Fudan University, No. 180 Fenglin Road, Xuhui District, Shanghai, 200032, People's Republic of China
| | - Guo-Guang Ma
- Department of Critical Care Medicine, Zhongshan Hospital, Fudan University, No. 180 Fenglin Road, Xuhui District, Shanghai, 200032, People's Republic of China
| | - Jun-Yi Hou
- Department of Critical Care Medicine, Zhongshan Hospital, Fudan University, No. 180 Fenglin Road, Xuhui District, Shanghai, 200032, People's Republic of China
| | - Du-Ming Zhu
- Department of Critical Care Medicine, Zhongshan Hospital, Fudan University, No. 180 Fenglin Road, Xuhui District, Shanghai, 200032, People's Republic of China
| | - Lan Liu
- Department of Critical Care Medicine, Zhongshan Hospital, Fudan University, No. 180 Fenglin Road, Xuhui District, Shanghai, 200032, People's Republic of China
| | - Ying Zhang
- Department of Critical Care Medicine, Zhongshan Hospital, Fudan University, No. 180 Fenglin Road, Xuhui District, Shanghai, 200032, People's Republic of China
| | - Hua Liu
- Department of Critical Care Medicine, Zhongshan Hospital, Fudan University, No. 180 Fenglin Road, Xuhui District, Shanghai, 200032, People's Republic of China
| | - Ya-Min Zhuang
- Department of Critical Care Medicine, Zhongshan Hospital, Fudan University, No. 180 Fenglin Road, Xuhui District, Shanghai, 200032, People's Republic of China
| | - Zhe Luo
- Department of Critical Care Medicine, Zhongshan Hospital, Fudan University, No. 180 Fenglin Road, Xuhui District, Shanghai, 200032, People's Republic of China
| | - Guo-Wei Tu
- Department of Critical Care Medicine, Zhongshan Hospital, Fudan University, No. 180 Fenglin Road, Xuhui District, Shanghai, 200032, People's Republic of China
| | - Xiao-Mei Yang
- Department of Critical Care Medicine, Zhongshan Hospital, Fudan University, No. 180 Fenglin Road, Xuhui District, Shanghai, 200032, People's Republic of China.
| | - Hai-Yan Chen
- Department of Echocardiography, Zhongshan Hospital, Fudan University, No. 180 Fenglin Road, Xuhui District, Shanghai, 200032, People's Republic of China.
| |
Collapse
|
8
|
Simple and easy quantitation of functional mitral valve area using novel automated flow measurement technique with real-time 3-D color Doppler echocardiography. J Echocardiogr 2018; 16:189-191. [PMID: 29922918 DOI: 10.1007/s12574-018-0384-6] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2018] [Revised: 05/21/2018] [Accepted: 06/14/2018] [Indexed: 10/28/2022]
|
9
|
Kato A, Sandoval JP, Mroczek D, Chaturvedi R, Houle H, Georgescu B, Yoo SJ, Benson LN, Lee KJ. Automated 3-Dimensional Single-Beat Real-Time Volume Colour Flow Doppler Echocardiography in Children: A Validation Study of Right and Left Heart Flows. Can J Cardiol 2018; 34:726-735. [DOI: 10.1016/j.cjca.2018.03.001] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2018] [Revised: 02/26/2018] [Accepted: 03/04/2018] [Indexed: 10/17/2022] Open
|
10
|
Jang JY, Kang JW, Yang DH, Lee S, Sun BJ, Kim DH, Song JM, Kang DH, Song JK. Impact of a Geometric Correction for Proximal Flow Constraint on the Assessment of Mitral Regurgitation Severity Using the Proximal Flow Convergence Method. J Cardiovasc Ultrasound 2018; 26:33-39. [PMID: 29629022 PMCID: PMC5881082 DOI: 10.4250/jcu.2018.26.1.33] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2018] [Revised: 02/25/2018] [Accepted: 02/26/2018] [Indexed: 11/22/2022] Open
Abstract
Background Overestimation of the severity of mitral regurgitation (MR) by the proximal isovelocity surface area (PISA) method has been reported. We sought to test whether angle correction (AC) of the constrained flow field is helpful to eliminate overestimation in patients with eccentric MR. Methods In a total of 33 patients with MR due to prolapse or flail mitral valve, both echocardiography and cardiac magnetic resonance image (CMR) were performed to calculate regurgitant volume (RV). In addition to RV by conventional PISA (RVPISA), convergence angle (α) was measured from 2-dimensional Doppler color flow maps and RV was corrected by multiplying by α/180 (RVAC). RV measured by CMR (RVCMR) was used as a gold standard, which was calculated by the difference between total stroke volume measured by planimetry of the short axis slices and aortic stroke volume by phase-contrast image. Results The correlation between RVCMR and RV by echocardiography was modest [RVCMR vs. RVPISA (r = 0.712, p < 0.001) and RVCMR vs. RVAC (r = 0.766, p < 0.001)]. However, RVPISA showed significant overestimation (RVPISA - RVCMR = 50.6 ± 40.6 mL vs. RVAC - RVCMR = 7.7 ± 23.4 mL, p < 0.001). The overall accuracy of RVPISA for diagnosis of severe MR, defined as RV ≥ 60 mL, was 57.6% (19/33), whereas it increased to 84.8% (28/33) by using RVAC (p = 0.028). Conclusion Conventional PISA method tends to provide falsely large RV in patients with eccentric MR and a simple geometric AC of the proximal constraint flow largely eliminates overestimation.
Collapse
Affiliation(s)
- Jeong Yoon Jang
- Division of Cardiology, Department of Internal Medicine, Gyeongsang National University School of Medicine, Gyeongsang National University Changwon Hospital, Changwon, Korea
| | - Joon-Won Kang
- Cardiac Imaging Center, Asan Medical Center Heart Institute, University of Ulsan College of Medicine, Seoul, Korea
| | - Dong Hyun Yang
- Cardiac Imaging Center, Asan Medical Center Heart Institute, University of Ulsan College of Medicine, Seoul, Korea
| | - Sahmin Lee
- Cardiac Imaging Center, Asan Medical Center Heart Institute, University of Ulsan College of Medicine, Seoul, Korea
| | - Byung Joo Sun
- Division of Cardiology, Department of Internal Medicine, Chungnam National University Hospital, Daejeon, Korea
| | - Dae-Hee Kim
- Cardiac Imaging Center, Asan Medical Center Heart Institute, University of Ulsan College of Medicine, Seoul, Korea
| | - Jong-Min Song
- Cardiac Imaging Center, Asan Medical Center Heart Institute, University of Ulsan College of Medicine, Seoul, Korea
| | - Duk-Hyun Kang
- Cardiac Imaging Center, Asan Medical Center Heart Institute, University of Ulsan College of Medicine, Seoul, Korea
| | - Jae-Kwan Song
- Cardiac Imaging Center, Asan Medical Center Heart Institute, University of Ulsan College of Medicine, Seoul, Korea
| |
Collapse
|
11
|
Tracy E, Zhu M, Streiff C, Sahn DJ, Ashraf M. Quantification of the area and shunt volume of multiple, circular, and noncircular ventricular septal defects: A 2D/3D echocardiography comparison and real time 3D color Doppler feasibility determination study. Echocardiography 2017; 35:90-99. [PMID: 29082558 DOI: 10.1111/echo.13742] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022] Open
Abstract
BACKGROUND Quantification of defect size and shunt flow is an important aspect of ventricular septal defect (VSD) evaluation. This study compared three-dimensional echocardiography (3DE) with the current clinical standard two-dimensional echocardiography (2DE) for quantifying defect area and tested the feasibility of real time 3D color Doppler echocardiography (RT3D-CDE) for quantifying shunt volume of irregular shaped and multiple VSDs. METHODS Latex balloons were sutured into the ventricles of 32 freshly harvested porcine hearts and were connected with tubing placed in septal perforations. Tubing was varied in area (0.13-5.22 cm²), number (1-3), and shape (circle, oval, crescent, triangle). A pulsatile pump was used to pump "blood" through the VSD (LV to RV) at stroke volumes of 30-70 mL with a stroke rate of 60 bpm. Two-dimensional echocardiography (2DE), 3DE, and RT3D-CDE images were acquired from the right side of the phantom. RESULTS For circular VSDs, both 2DE and 3DE area measurements were consistent with the actual areas (R² = 0.98 vs 0.99). For noncircular/multiple VSDs, 3DE correlated with the actual area more closely than 2DE (R² = 0.99 vs 0.44). Shunt volumes obtained using RT3D-CDE positively correlated with pumped stroke volumes (R² = 0.96). CONCLUSIONS Three-dimensional echocardiography (3DE) is a feasible method for determining VSD area and is more accurate than 2DE for evaluating the area of multiple or noncircular VSDs. Real-time 3D color Doppler echocardiography (RT3D-CDE) is a feasible method for quantifying the shunt volume of multiple or noncircular VSDs.
Collapse
Affiliation(s)
- Evan Tracy
- Department of Pediatrics, Division of Cardiology, Oregon Health & Science University, Portland, Oregon
| | - Meihua Zhu
- Department of Pediatrics, Division of Cardiology, Oregon Health & Science University, Portland, Oregon
| | - Cole Streiff
- Department of Pediatrics, Division of Cardiology, Oregon Health & Science University, Portland, Oregon
| | - David J Sahn
- Department of Pediatrics, Division of Cardiology, Oregon Health & Science University, Portland, Oregon
| | - Muhammad Ashraf
- Department of Pediatrics, Division of Cardiology, Oregon Health & Science University, Portland, Oregon
| |
Collapse
|
12
|
Buck T, Bösche L, Plicht B. [Real-time 3D echocardiography for estimation of severity in valvular heart disease : Impact on current guidelines]. Herz 2017; 42:241-254. [PMID: 28229203 DOI: 10.1007/s00059-017-4540-y] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/25/2022]
Abstract
Besides providing spatial anatomic information on heart valves, real-time three-dimensional echocardiography (3DE) combined with color Doppler has the potential to overcome the limitations of flow quantification inherent to conventional 2D color Doppler methods. Recent studies validated the application of color Doppler 3DE (cD-3DE) for the quantification of regurgitation flow based on the vena contracta area (VCA) and the proximal isovelocity surface area (PISA) methods. Particularly the assessment of VCA by cD-3DE led to a change of paradigm by understanding of the VCA as being strongly asymmetric in the majority of patients and etiologies. This review provides a comprehensive description of the different concepts of cD-3DE-based flow quantification in the setting of different valvular heart diseases and their presentation in recent guidelines.
Collapse
Affiliation(s)
- T Buck
- Medizinische Klinik III, Klinik für Kardiologie, Klinikum Westfalen, Am Knappschaftskrankenhaus 1, 44309, Dortmund, Deutschland.
| | - L Bösche
- Medizinische Universitätsklinik II - Kardiologie und Angiologie, Berufsgenossenschaftliches Universitätsklinikum Bergmannsheil, Bochum, Deutschland
| | - B Plicht
- Medizinische Klinik III, Klinik für Kardiologie, Klinikum Westfalen, Am Knappschaftskrankenhaus 1, 44309, Dortmund, Deutschland
| |
Collapse
|
13
|
Heo R, Son JW, ó Hartaigh B, Chang HJ, Kim YJ, Datta S, Cho IJ, Shim CY, Hong GR, Ha JW, Chung N. Clinical Implications of Three-Dimensional Real-Time Color Doppler Transthoracic Echocardiography in Quantifying Mitral Regurgitation: A Comparison with Conventional Two-Dimensional Methods. J Am Soc Echocardiogr 2017; 30:393-403.e7. [DOI: 10.1016/j.echo.2016.12.010] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/10/2016] [Indexed: 10/20/2022]
|
14
|
Krieger EV, Lee J, Branch KR, Hamilton-Craig C. Quantitation of mitral regurgitation with cardiac magnetic resonance imaging: a systematic review. Heart 2016; 102:1864-1870. [PMID: 27733535 DOI: 10.1136/heartjnl-2015-309054] [Citation(s) in RCA: 41] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/20/2016] [Revised: 07/12/2016] [Accepted: 08/01/2016] [Indexed: 11/04/2022] Open
Abstract
In this review discuss the application of cardiac magnetic resonance (CMR) to the evaluation and quantification of mitral regurgitation and provide a systematic literature review for comparisons with echocardiography. Using the 2015 Preferred Reporting Items for Systematic Reviews and Meta-Analyses methodology, we searched Medline and PubMed for original research articles published since 2000 that provided data on the quantification of mitral regurgitation by CMR. We identified 220 articles of which 33 were included. Four main techniques of mitral regurgitation quantification were identified. Reproducibility varied substantially between papers but was high overall for all techniques. However, quantification differed between the techniques studied. When compared with two-dimensional echocardiography, mitral regurgitation fraction and regurgitant volume measured by CMR were comparable but typically lower. CMR has high reproducibility for the quantification of mitral regurgitation in experienced centres, but further technological refinement is needed. An integrated and standardised approach that combines multiple techniques is recommended for optimal reproducibility and precise mitral regurgitation quantification. Definitive outcome studies using CMR as a basis for treatment are lacking but needed.
Collapse
Affiliation(s)
- Eric V Krieger
- Division of Cardiology, Department of Medicine, University of Washington, Seattle, Washington, USA.,Seattle Adult Congenital Heart Service, University of Washington School of Medicine, Seattle, Washington, USA
| | - James Lee
- Division of Cardiology, Department of Medicine, University of Washington, Seattle, Washington, USA
| | - Kelley R Branch
- Division of Cardiology, Department of Medicine, University of Washington, Seattle, Washington, USA
| | - Christian Hamilton-Craig
- Division of Cardiology, Department of Medicine, University of Washington, Seattle, Washington, USA.,Department of Cardiology, University of Queensland, Brisbane, Queensland, Australia.,Department of Cardiology, Heart & Lung Institute, The Prince Charles Hospital, Brisbane, Queensland, Australia
| |
Collapse
|
15
|
Innovations in Perioperative Cardiac Imaging. J Am Soc Echocardiogr 2016; 29:A27-A28. [PMID: 27712808 DOI: 10.1016/j.echo.2016.08.010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
|
16
|
Zhou X, Vannan MA, Lancellotti P. Quantitative Three-Dimensional Color Flow Echocardiography of Chronic Mitral Regurgitation: New Methods, New Perspectives, New Challenges. J Am Soc Echocardiogr 2016; 29:935-937. [DOI: 10.1016/j.echo.2016.08.004] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
17
|
Bertelsen L, Svendsen JH, Køber L, Haugan K, Højberg S, Thomsen C, Vejlstrup N. Flow measurement at the aortic root - impact of location of through-plane phase contrast velocity mapping. J Cardiovasc Magn Reson 2016; 18:55. [PMID: 27599727 PMCID: PMC5013573 DOI: 10.1186/s12968-016-0277-7] [Citation(s) in RCA: 23] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2016] [Accepted: 08/25/2016] [Indexed: 12/20/2022] Open
Abstract
BACKGROUND Cardiovascular magnetic resonance (CMR) is considered the gold standard of cardiac volumetric measurements. Flow in the aortic root is often measured at the sinotubular junction, even though placing the slice just above valve level may be more precise. It is unknown how much flow measurements vary at different levels in the aortic root and which level corresponds best to left ventricle volumetry. METHODS All patients were older than 70 years presenting with at least one of the following diagnoses: diabetes, hypertension, prior stroke and/or heart failure. Patients with arrhythmias during CMR and aortic stenosis were excluded from the analyses. Stroke volumes were measured volumetrically (SVref) from steady-state free precision short axis images covering the entire left ventricle, excluding the papillary muscles and including the left ventricular outflow tract. Flow sequences (through-plane phase contrast velocity mapping) were obtained at valve level (SVV) and at the sinotubular junction (SVST). Firstly, SVV and SVST were compared to each other and secondly, after excluding patients with mitral regurgitations to ensure that stroke volumes measured volumetrically would theoretically be equal to flow measurements, SVV and SVST were compared to SVref. RESULTS Initially, 152 patients were included. 22 were excluded because of arrhythmias during scans and 9 were excluded for aortic stenosis. Accordingly, data from 121 patients were analysed and of these 63 had visually evident mitral regurgitation on cine images. On average, stroke volumes measured with flow at the sinotubular junction was 13-16 % lower than when measured at valve level (70.0 mL ±13.8 vs. 81.8 mL ±15.5). This was in excess of the expected difference caused by the outflow to the coronary arteries. In the 58 patients with no valvulopathy, stroke volumes measured at valve level (79.0 mL ±12.4) was closest to the volumetric measurement (85.4 mL ±12.0) but still significantly lower (p < 0.001). Flow measured at the ST-junction (68.1 mL ±11.6) was significantly lower than at valve level and the volumetric measurements. The mean difference between SVref-SVV (6.4 mL) and SVref-SVST (18.2 mL) showed similar variances (SD 7.4 vs. 8.1 respectively) and hence equal accuracy. CONCLUSIONS Aortic flow measured at valve level corresponded best with volumetric measurements and on average flow measured at the sinotubular junction underestimated flow approximately 15 % compared to valve level. TRIAL REGISTRATION ClinicalTrials.gov identifier: NCT02036450 . Registered 08/01/2014.
Collapse
Affiliation(s)
- Litten Bertelsen
- Department of Cardiology, The Heart Centre, Rigshospitalet, University of Copenhagen, Copenhagen, Denmark
| | - Jesper Hastrup Svendsen
- Department of Cardiology, The Heart Centre, Rigshospitalet, University of Copenhagen, Copenhagen, Denmark
- Danish National Research Foundation Centre for Cardiac Arrhythmia (DARC), Copenhagen, Denmark
- Department of Clinical Medicine, Faculty of Health and Medical Sciences, University of Copenhagen, Copenhagen, Denmark
| | - Lars Køber
- Department of Cardiology, The Heart Centre, Rigshospitalet, University of Copenhagen, Copenhagen, Denmark
| | - Ketil Haugan
- Department of Cardiology, Roskilde Hospital, Roskilde, Denmark
| | - Søren Højberg
- Department of Cardiology Y, Bispebjerg Hospital, Copenhagen, Denmark
| | - Carsten Thomsen
- Department of Radiology, The Diagnostic Centre, Rigshospitalet, University of Copenhagen, Copenhagen, Denmark
- Department of Clinical Medicine, Faculty of Health and Medical Sciences, University of Copenhagen, Copenhagen, Denmark
| | - Niels Vejlstrup
- Department of Cardiology, The Heart Centre, Rigshospitalet, University of Copenhagen, Copenhagen, Denmark
| |
Collapse
|
18
|
Zhu M, Ashraf M, Tam L, Streiff C, Kimura S, Shimada E, Sahn DJ. Quantification of Shunt Volume Through Ventricular Septal Defect by Real-Time 3-D Color Doppler Echocardiography: An in Vitro Study. ULTRASOUND IN MEDICINE & BIOLOGY 2016; 42:1193-1200. [PMID: 26850842 DOI: 10.1016/j.ultrasmedbio.2015.12.017] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/28/2015] [Revised: 11/10/2015] [Accepted: 12/07/2015] [Indexed: 06/05/2023]
Abstract
Quantification of shunt volume is important for ventricular septal defects (VSDs). The aim of the in vitro study described here was to test the feasibility of using real-time 3-D color Doppler echocardiography (RT3-D-CDE) to quantify shunt volume through a modeled VSD. Eight porcine heart phantoms with VSDs ranging in diameter from 3 to 25 mm were studied. Each phantom was passively driven at five different stroke volumes from 30 to 70 mL and two stroke rates, 60 and 120 strokes/min. RT3-D-CDE full volumes were obtained at color Doppler volume rates of 15, 20 and 27 volumes/s. Shunt flow derived from RT3-D-CDE was linearly correlated with pump-driven stroke volume (R = 0.982). RT3-D-CDE-derived shunt volumes from three color Doppler flow rate settings and two stroke rate acquisitions did not differ (p > 0.05). The use of RT3-D-CDE to determine shunt volume though VSDs is feasible. Different color volume rates/heart rates under clinically/physiologically relevant range have no effect on VSD 3-D shunt volume determination.
Collapse
Affiliation(s)
- Meihua Zhu
- Division of Pediatric Cardiology, Oregon Health & Science University, Portland, Oregon, USA
| | - Muhammad Ashraf
- Division of Pediatric Cardiology, Oregon Health & Science University, Portland, Oregon, USA
| | - Lydia Tam
- Division of Pediatric Cardiology, Oregon Health & Science University, Portland, Oregon, USA
| | - Cole Streiff
- Division of Pediatric Cardiology, Oregon Health & Science University, Portland, Oregon, USA
| | - Sumito Kimura
- Division of Pediatric Cardiology, Oregon Health & Science University, Portland, Oregon, USA
| | - Eriko Shimada
- Division of Pediatric Cardiology, Oregon Health & Science University, Portland, Oregon, USA
| | - David J Sahn
- Division of Pediatric Cardiology, Oregon Health & Science University, Portland, Oregon, USA.
| |
Collapse
|
19
|
Emerging from Two-Dimensional Shadows, the Value of Added Dimensions in the Accurate Assessment of Mitral Regurgitation. J Am Soc Echocardiogr 2016; 29:A26-7. [DOI: 10.1016/j.echo.2015.11.004] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
20
|
Sargent J, Connolly DJ, Watts V, Mõtsküla P, Volk HA, Lamb CR, Luis Fuentes V. Assessment of mitral regurgitation in dogs: comparison of results of echocardiography with magnetic resonance imaging. J Small Anim Pract 2015; 56:641-50. [DOI: 10.1111/jsap.12410] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2014] [Revised: 07/29/2015] [Accepted: 09/03/2015] [Indexed: 11/28/2022]
Affiliation(s)
- J. Sargent
- The Royal Veterinary College; University of London; Herts AL9 7TA
| | - D. J. Connolly
- The Royal Veterinary College; University of London; Herts AL9 7TA
| | - V. Watts
- The Royal Veterinary College; University of London; Herts AL9 7TA
| | - P. Mõtsküla
- The Royal Veterinary College; University of London; Herts AL9 7TA
| | - H. A. Volk
- The Royal Veterinary College; University of London; Herts AL9 7TA
| | - C. R. Lamb
- The Royal Veterinary College; University of London; Herts AL9 7TA
| | - V. Luis Fuentes
- The Royal Veterinary College; University of London; Herts AL9 7TA
| |
Collapse
|
21
|
Choi J, Hong GR, Kim M, Cho IJ, Shim CY, Chang HJ, Mancina J, Ha JW, Chung N. Automatic quantification of aortic regurgitation using 3D full volume color doppler echocardiography: a validation study with cardiac magnetic resonance imaging. Int J Cardiovasc Imaging 2015; 31:1379-89. [PMID: 26164059 DOI: 10.1007/s10554-015-0707-x] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/25/2015] [Accepted: 07/06/2015] [Indexed: 12/26/2022]
Abstract
Recent advances in real-time three-dimensional (3D) echocardiography provide the automated measurement of mitral inflow and aortic stroke volume without the need to assume the geometry of the heart. The aim of this study is to explore the ability of 3D full volume color Doppler echocardiography (FVCDE) to quantify aortic regurgitation (AR). Thirty-two patients with more than a moderate degree of AR were enrolled. AR volume was measured by (1) two-dimensional-CDE, using the proximal isovelocity surface area (PISA) and (2) real-time 3D-FVCDE with (3) phase-contrast cardiac magnetic resonance imaging (PC-CMR) as the reference method. Automated AR quantification using 3D-FVCDE was feasible in 30 of the 32 patients. 2D-PISA underestimated the AR volume compared to 3D-FVCDE and PC-CMR (38.6 ± 9.9 mL by 2D-PISA; 49.5 ± 10.2 mL by 3D-FVCDE; 52.3 ± 12.6 mL by PC-CMR). The AR volume assessed by 3D-FVCDE showed better correlation and agreement with PC-CMR (r = 0.93, p < 0.001, 2SD: 9.5 mL) than did 2D-PISA (r = 0.76, p < 0.001, 2SD: 15.7 mL). When used to classify AR severity, 3D-FVCDE agreed better with PC-CMR (k = 0.94) than did 2D-PISA (k = 0.53). In patients with eccentric jets, only 30% were correctly graded by 2D-PISA. Conversely, almost all patients with eccentric jets (86.7%) were correctly graded by 3D-FVCDE. In patients with multiple jets, only 3 out of 10 were correctly graded by 2D-PISA, while 3D-FVCDE correctly graded 9 out of 10 of these patients. Automated quantification of AR using the 3D-FVCDE method is clinically feasible and more accurate than the current 2D-based method. AR quantification by 2D-PISA significantly misclassified AR grade in patients with eccentric or multiple jets. This study demonstrates that 3D-FVCDE is a valuable tool to accurately measure AR volume regardless of AR characteristics.
Collapse
Affiliation(s)
- Jaehuk Choi
- Division of Cardiology, College of Medicine, Hangang Sacred Heart Hospital, Hallym University, Chuncheon, South Korea
| | - Geu-Ru Hong
- Division of Cardiology, Severance Cardiovascular Hospital, Yonsei University Health System, 50 Yonsei-ro, Seodaemun-gu, Seoul, 120-752, South Korea.
| | - Minji Kim
- School of Medicine, University of Queensland, Herston, QLD, Australia
| | - In Jeong Cho
- Division of Cardiology, Severance Cardiovascular Hospital, Yonsei University Health System, 50 Yonsei-ro, Seodaemun-gu, Seoul, 120-752, South Korea
| | - Chi Young Shim
- Division of Cardiology, Severance Cardiovascular Hospital, Yonsei University Health System, 50 Yonsei-ro, Seodaemun-gu, Seoul, 120-752, South Korea
| | - Hyuk-Jae Chang
- Division of Cardiology, Severance Cardiovascular Hospital, Yonsei University Health System, 50 Yonsei-ro, Seodaemun-gu, Seoul, 120-752, South Korea
| | - Joel Mancina
- Ultrasound Division, Siemens Medical Solutions USA Inc., Mountain View, CA, USA
| | - Jong-Won Ha
- Division of Cardiology, Severance Cardiovascular Hospital, Yonsei University Health System, 50 Yonsei-ro, Seodaemun-gu, Seoul, 120-752, South Korea
| | - Namsik Chung
- Division of Cardiology, Severance Cardiovascular Hospital, Yonsei University Health System, 50 Yonsei-ro, Seodaemun-gu, Seoul, 120-752, South Korea
| |
Collapse
|
22
|
Shimada E, Zhu M, Kimura S, Streiff C, Houle H, Datta S, Sahn DJ, Ashraf M. Quantitative assessment of mitral inflow and aortic outflow stroke volumes by 3-dimensional real-time full-volume color flow doppler transthoracic echocardiography: an in vivo study. JOURNAL OF ULTRASOUND IN MEDICINE : OFFICIAL JOURNAL OF THE AMERICAN INSTITUTE OF ULTRASOUND IN MEDICINE 2015; 34:95-103. [PMID: 25542944 DOI: 10.7863/ultra.34.1.95] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/04/2023]
Abstract
OBJECTIVES Noninvasive quantification of left ventricular (LV) stroke volumes has an important clinical role in assessing circulation and monitoring therapeutic interventions for cardiac disease. This study validated the accuracy of a real-time 3-dimensional (3D) color flow Doppler method performed during transthoracic echocardiography (TTE) for quantifying volume flows through the mitral and aortic valves using a dedicated offline 3D flow computation program compared to LV sonomicrometry in an open-chest animal model. METHODS Forty-six different hemodynamic states in 5 open-chest pigs were studied. Three-dimensional color flow Doppler TTE and 2-dimensional (2D) TTE were performed by epicardial scanning. The dedicated software was used to compute flow volumes at the mitral annulus and the left ventricular outflow tract (LVOT) with the 3D color flow Doppler method. Stroke volumes by 2D TTE were computed in the conventional manner. Stroke volumes derived from sonomicrometry were used as reference values. RESULTS Mitral inflow and LVOT outflow derived from the 3D color flow Doppler method correlated well with stroke volumes by sonomicrometry (R = 0.96 and 0.96, respectively), whereas correlation coefficients for mitral inflow and LVOT outflow computed by 2D TTE and stroke volumes by sonomicrometry were R = 0.84 and 0.86. Compared to 2D TTE, the 3D method showed a smaller bias and narrower limits of agreement in both mitral inflow (mean ± SD: 3D, 2.36 ± 2.86 mL; 2D, 10.22 ± 8.46 mL) and LVOT outflow (3D, 1.99 ± 2.95 mL; 2D, 4.12 ± 6.32 mL). CONCLUSIONS Real-time 3D color flow Doppler quantification is feasible and accurate for measurement of mitral inflow and LVOT outflow stroke volumes over a range of hemodynamic conditions.
Collapse
Affiliation(s)
- Eriko Shimada
- Oregon Health and Science University, Portland, Oregon USA (E.S., M.Z., S.K., C.S., D.J.S., M.A.); and Siemens Medical Solutions USA, Inc, Mountain View, California USA (H.H., S.D.)
| | - Meihua Zhu
- Oregon Health and Science University, Portland, Oregon USA (E.S., M.Z., S.K., C.S., D.J.S., M.A.); and Siemens Medical Solutions USA, Inc, Mountain View, California USA (H.H., S.D.)
| | - Sumito Kimura
- Oregon Health and Science University, Portland, Oregon USA (E.S., M.Z., S.K., C.S., D.J.S., M.A.); and Siemens Medical Solutions USA, Inc, Mountain View, California USA (H.H., S.D.)
| | - Cole Streiff
- Oregon Health and Science University, Portland, Oregon USA (E.S., M.Z., S.K., C.S., D.J.S., M.A.); and Siemens Medical Solutions USA, Inc, Mountain View, California USA (H.H., S.D.)
| | - Helene Houle
- Oregon Health and Science University, Portland, Oregon USA (E.S., M.Z., S.K., C.S., D.J.S., M.A.); and Siemens Medical Solutions USA, Inc, Mountain View, California USA (H.H., S.D.)
| | - Saurabh Datta
- Oregon Health and Science University, Portland, Oregon USA (E.S., M.Z., S.K., C.S., D.J.S., M.A.); and Siemens Medical Solutions USA, Inc, Mountain View, California USA (H.H., S.D.)
| | - David J Sahn
- Oregon Health and Science University, Portland, Oregon USA (E.S., M.Z., S.K., C.S., D.J.S., M.A.); and Siemens Medical Solutions USA, Inc, Mountain View, California USA (H.H., S.D.).
| | - Muhammad Ashraf
- Oregon Health and Science University, Portland, Oregon USA (E.S., M.Z., S.K., C.S., D.J.S., M.A.); and Siemens Medical Solutions USA, Inc, Mountain View, California USA (H.H., S.D.)
| |
Collapse
|
23
|
Real-Time Three-Dimensional Echocardiographic Flow Quantification in Valvular Heart Disease. CURRENT CARDIOVASCULAR IMAGING REPORTS 2014. [DOI: 10.1007/s12410-014-9298-5] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
|