1
|
van Maanen R, la Roi-Teeuw HM, Rutten FH, Nierman M, Klok FA, Huisman MV, Egbers T, Blom J, Moons K, Geersing GJ. YEARS clinical decision rule for diagnosing pulmonary embolism: a prospective diagnostic cohort follow-up study in primary care. BMJ Open 2025; 15:e091543. [PMID: 39915029 PMCID: PMC11800211 DOI: 10.1136/bmjopen-2024-091543] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/23/2024] [Accepted: 01/08/2025] [Indexed: 02/09/2025] Open
Abstract
OBJECTIVES The Wells rule is often used in primary care to rule out pulmonary embolism (PE), but its efficiency is low as many referred patients do not have PE. In this study, we evaluated in primary care an alternative and potentially more efficient diagnostic strategy-the YEARS algorithm; a simplified three-item version of the Wells rule combined with a pretest probability adjusted D-dimer interpretation. DESIGN In this comprehensive prospective diagnostic validation study, primary care patients suspected of PE were enrolled by their general practitioner. All three YEARS items were collected in addition to D-dimer results, and patients were followed for 3 months to establish the final diagnosis. SETTING Primary care in the Netherlands. PARTICIPANTS 753 patients with suspected acute PE were included. Five patients (0.7%) were lost to follow-up. MAIN OUTCOME MEASURES Failure rate (number of PE cases among patients classified by the algorithm as 'PE ruled-out') and efficiency (fraction of patients classified as 'PE probable/further imaging needed'). RESULTS Prevalence of PE was 5.5% (41/748 patients). In total, 603 patients were classified as 'PE ruled-out' by the YEARS algorithm (532 with zero YEARS items and a D-dimer<1000 ng/mL and 71 with≥1 positive YEARS item and a D-dimer<500 ng/mL), resulting in an efficiency of 80.6% (603/748 patients, 95% CI 77.6% to 83.4%). Of these patients, three patients had a diagnosis of non-fatal PE during 3 months follow-up, all three with zero YEARS items and D-dimer between 500 and 1000 ng/mL, resulting in an overall diagnostic failure rate of 0.50% (3/603 patients, 95% CI 0.13% to 1.57%). In the patients categorised as 'imaging needed' (n=145), a total of 38 (26.2%) were indeed diagnosed with PE. CONCLUSIONS Our study suggests that acute PE can be safely ruled out in 80% of patients by the YEARS algorithm in a primary care setting, while only 20% of patients required referral to hospital care for imaging tests. In those classified as 'imaging needed', PE was present in about one in every four patients, demonstrating a high detection proportion.
Collapse
Affiliation(s)
- Rosanne van Maanen
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Hannah M la Roi-Teeuw
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Frans H Rutten
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Melchior Nierman
- Department of Thrombosis, Atalmedial Medical Diagnostics Centers, Amsterdam, The Netherlands
| | - Frederikus A Klok
- Department of Thrombosis and Hemostasis, Leiden University Medical Center, Leiden, The Netherlands
- Center for Thrombosis and Hemostasis (CTH), Johannes Gutenberg University Mainz, Mainz, Germany
| | - Menno V Huisman
- Department of Thrombosis and Hemostasis, Leiden University Medical Center, Leiden, The Netherlands
| | - Tuur Egbers
- Department of General Practice and Nursing Science, Utrecht University, Utrecht, The Netherlands
| | - Jeanet Blom
- Leiden University Medical Center, Leiden, The Netherlands
| | - Karel Moons
- Department of Epidemiology, Julius Center for Health Sciences and Primary Care, Utrecht, The Netherlands
| | - Geert-Jan Geersing
- Department of General Practice and Nursing Science, Utrecht University, Utrecht, The Netherlands
| |
Collapse
|
2
|
la Roi-Teeuw HM, van Royen FS, de Hond A, Zahra A, de Vries S, Bartels R, Carriero AJ, van Doorn S, Dunias ZS, Kant I, Leeuwenberg T, Peters R, Veerhoek L, van Smeden M, Luijken K. Don't be misled: 3 misconceptions about external validation of clinical prediction models. J Clin Epidemiol 2024; 172:111387. [PMID: 38729274 DOI: 10.1016/j.jclinepi.2024.111387] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2024] [Revised: 04/24/2024] [Accepted: 05/02/2024] [Indexed: 05/12/2024]
Abstract
Clinical prediction models provide risks of health outcomes that can inform patients and support medical decisions. However, most models never make it to actual implementation in practice. A commonly heard reason for this lack of implementation is that prediction models are often not externally validated. While we generally encourage external validation, we argue that an external validation is often neither sufficient nor required as an essential step before implementation. As such, any available external validation should not be perceived as a license for model implementation. We clarify this argument by discussing 3 common misconceptions about external validation. We argue that there is not one type of recommended validation design, not always a necessity for external validation, and sometimes a need for multiple external validations. The insights from this paper can help readers to consider, design, interpret, and appreciate external validation studies.
Collapse
Affiliation(s)
- Hannah M la Roi-Teeuw
- Department of General Practice and Nursing Science, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Heidelberglaan 100, 3584CX, Utrecht, The Netherlands.
| | - Florien S van Royen
- Department of General Practice and Nursing Science, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Heidelberglaan 100, 3584CX, Utrecht, The Netherlands
| | - Anne de Hond
- Department of Epidemiology and Health Economics, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Heidelberglaan 100, 3584CX, Utrecht, The Netherlands
| | - Anum Zahra
- Department of Epidemiology and Health Economics, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Heidelberglaan 100, 3584CX, Utrecht, The Netherlands
| | - Sjoerd de Vries
- Department of Digital Health, University Medical Center Utrecht, Heidelberglaan 100, 3584CX, Utrecht, The Netherlands; Department of Information and Computing Sciences, Utrecht University, Princetonplein 5, 3584 CC, Utrecht, The Netherlands
| | - Richard Bartels
- Department of Digital Health, University Medical Center Utrecht, Heidelberglaan 100, 3584CX, Utrecht, The Netherlands; Department of Data Science and Biostatistics, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Heidelberglaan 100, 3584CX, Utrecht, The Netherlands
| | - Alex J Carriero
- Department of Epidemiology and Health Economics, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Heidelberglaan 100, 3584CX, Utrecht, The Netherlands
| | - Sander van Doorn
- Department of General Practice and Nursing Science, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Heidelberglaan 100, 3584CX, Utrecht, The Netherlands
| | - Zoë S Dunias
- Department of Epidemiology and Health Economics, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Heidelberglaan 100, 3584CX, Utrecht, The Netherlands
| | - Ilse Kant
- Department of Digital Health, University Medical Center Utrecht, Heidelberglaan 100, 3584CX, Utrecht, The Netherlands
| | - Tuur Leeuwenberg
- Department of Epidemiology and Health Economics, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Heidelberglaan 100, 3584CX, Utrecht, The Netherlands
| | - Ruben Peters
- Department of Digital Health, University Medical Center Utrecht, Heidelberglaan 100, 3584CX, Utrecht, The Netherlands
| | - Laura Veerhoek
- Department of Digital Health, University Medical Center Utrecht, Heidelberglaan 100, 3584CX, Utrecht, The Netherlands
| | - Maarten van Smeden
- Department of Epidemiology and Health Economics, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Heidelberglaan 100, 3584CX, Utrecht, The Netherlands; Department of Data Science and Biostatistics, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Heidelberglaan 100, 3584CX, Utrecht, The Netherlands
| | - Kim Luijken
- Department of Epidemiology and Health Economics, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Heidelberglaan 100, 3584CX, Utrecht, The Netherlands
| |
Collapse
|
3
|
van Maanen R, Martens ESL, Takada T, Roy PM, de Wit K, Parpia S, Kraaijpoel N, Huisman MV, Wells PS, Le Gal G, Righini M, Freund Y, Galipienzo J, van Es N, Blom JW, Moons KGM, Rutten FH, van Smeden M, Klok FA, Geersing GJ, Luijken K. Accuracy of physicians' intuitive risk estimation in the diagnostic management of pulmonary embolism: an individual patient data meta-analysis. J Thromb Haemost 2023; 21:2873-2883. [PMID: 37263381 DOI: 10.1016/j.jtha.2023.05.023] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2023] [Revised: 05/04/2023] [Accepted: 05/23/2023] [Indexed: 06/03/2023]
Abstract
BACKGROUND In patients clinically suspected of having pulmonary embolism (PE), physicians often rely on intuitive estimation ("gestalt") of PE presence. Although shown to be predictive, gestalt is criticized for its assumed variation across physicians and lack of standardization. OBJECTIVES To assess the diagnostic accuracy of gestalt in the diagnosis of PE and gain insight into its possible variation. METHODS We performed an individual patient data meta-analysis including patients suspected of having PE. The primary outcome was diagnostic accuracy of gestalt for the diagnosis of PE, quantified as risk ratio (RR) between gestalt and PE based on 2-stage random-effect log-binomial meta-analysis regression as well as gestalts' sensitivity and specificity. The variability of these measures was explored across different health care settings, publication period, PE prevalence, patient subgroups (sex, heart failure, chronic lung disease, and items of the Wells score other than gestalt), and age. RESULTS We analyzed 20 770 patients suspected of having PE from 16 original studies. The prevalence of PE in patients with and without a positive gestalt was 28.8% vs 9.1%, respectively. The overall RR was 3.02 (95% CI, 2.35-3.87), and the overall sensitivity and specificity were 74% (95% CI, 68%-79%) and 61% (95% CI, 53%-68%), respectively. Although variation was observed across individual studies (I2, 90.63%), the diagnostic accuracy was consistent across all subgroups and health care settings. CONCLUSION A positive gestalt was associated with a 3-fold increased risk of PE in suspected patients. Although variation was observed across studies, the RR of gestalt was similar across prespecified subgroups and health care settings, exemplifying its diagnostic value for all patients suspected of having PE.
Collapse
Affiliation(s)
- Rosanne van Maanen
- Department of General Practice, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, the Netherlands.
| | - Emily S L Martens
- Department of Thrombosis and Hemostasis, Leiden University Medical Center, Leiden, the Netherlands. https://twitter.com/ESLmartens
| | - Toshihiko Takada
- Department of General Medicine, Shirakawa Satellite for Teaching And Research (STAR), Fukushima Medical University, Fukushima, Japan
| | - Pierre-Marie Roy
- Department of Emergency Medicine, Angers University Hospital; MitoVasc UMR CNRS 6015 - INSERM 1083, Université Angers, Angers; and French Clinical Research Infrastructure (F-CRIN) Network, INvestigation Network On Venous Thrombo-Embolism (INNOVTE), Saint-Etienne, France
| | - Kerstin de Wit
- Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Canada; Department of Emergency Medicine, Queen's University, Kingston, Canada
| | - Sameer Parpia
- Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Canada; Department of Oncology, McMaster University, Hamilton, Canada
| | - Noémie Kraaijpoel
- Department of Medicine, Amsterdam University Medical Center, Amsterdam Cardiovascular Sciences, Amsterdam, the Netherlands
| | - Menno V Huisman
- Department of Thrombosis and Hemostasis, Leiden University Medical Center, Leiden, the Netherlands
| | - Philip S Wells
- Department of Medicine, University of Ottawa, Ottawa Hospital Research Institute, Ottawa, Canada
| | - Grégoire Le Gal
- Department of Medicine, University of Ottawa, Ottawa Hospital Research Institute, Ottawa, Canada
| | - Marc Righini
- Division of Angiology and Hemostasis, Geneva University Hospitals and Faculty of Medicine, Geneva, Switzerland
| | - Yonathan Freund
- Sorbonne University, Emergency Department, Hopital Pitie-Salpêtrière, Assistance Publique-Hopitaux de Paris, Paris, France
| | - Javier Galipienzo
- Service of Anesthesiology, MD Anderson Cancer Center Madrid, Madrid, Spain
| | - Nick van Es
- Amsterdam UMC location University of Amsterdam, Department of Vascular Medicine, Meibergdreef 9, Amsterdam, the Netherlands; Amsterdam Cardiovascular Sciences, Pulmonary Hypertension & Thrombosis, Amsterdam, the Netherlands
| | - Jeanet W Blom
- Department of General Practice, Leiden University Medical Center, Leiden, the Netherlands
| | - Karel G M Moons
- Department of Epidemiology, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, the Netherlands
| | - Frans H Rutten
- Department of General Practice, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, the Netherlands
| | - Maarten van Smeden
- Department of Epidemiology, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, the Netherlands
| | - Frederikus A Klok
- Department of Thrombosis and Hemostasis, Leiden University Medical Center, Leiden, the Netherlands
| | - Geert-Jan Geersing
- Department of General Practice, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, the Netherlands
| | - Kim Luijken
- Department of Epidemiology, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, the Netherlands
| |
Collapse
|
4
|
van Es N, Takada T, Kraaijpoel N, Klok FA, Stals MAM, Büller HR, Courtney DM, Freund Y, Galipienzo J, Le Gal G, Ghanima W, Huisman MV, Kline JA, Moons KGM, Parpia S, Perrier A, Righini M, Robert-Ebadi H, Roy PM, Wells PS, de Wit K, van Smeden M, Geersing GJ. Diagnostic management of acute pulmonary embolism: a prediction model based on a patient data meta-analysis. Eur Heart J 2023; 44:3073-3081. [PMID: 37452732 PMCID: PMC10917087 DOI: 10.1093/eurheartj/ehad417] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/11/2023] [Revised: 04/25/2023] [Accepted: 06/13/2023] [Indexed: 07/18/2023] Open
Abstract
AIMS Risk stratification is used for decisions regarding need for imaging in patients with clinically suspected acute pulmonary embolism (PE). The aim was to develop a clinical prediction model that provides an individualized, accurate probability estimate for the presence of acute PE in patients with suspected disease based on readily available clinical items and D-dimer concentrations. METHODS AND RESULTS An individual patient data meta-analysis was performed based on sixteen cross-sectional or prospective studies with data from 28 305 adult patients with clinically suspected PE from various clinical settings, including primary care, emergency care, hospitalized and nursing home patients. A multilevel logistic regression model was built and validated including ten a priori defined objective candidate predictors to predict objectively confirmed PE at baseline or venous thromboembolism (VTE) during follow-up of 30 to 90 days. Multiple imputation was used for missing data. Backward elimination was performed with a P-value <0.10. Discrimination (c-statistic with 95% confidence intervals [CI] and prediction intervals [PI]) and calibration (outcome:expected [O:E] ratio and calibration plot) were evaluated based on internal-external cross-validation. The accuracy of the model was subsequently compared with algorithms based on the Wells score and D-dimer testing. The final model included age (in years), sex, previous VTE, recent surgery or immobilization, haemoptysis, cancer, clinical signs of deep vein thrombosis, inpatient status, D-dimer (in µg/L), and an interaction term between age and D-dimer. The pooled c-statistic was 0.87 (95% CI, 0.85-0.89; 95% PI, 0.77-0.93) and overall calibration was very good (pooled O:E ratio, 0.99; 95% CI, 0.87-1.14; 95% PI, 0.55-1.79). The model slightly overestimated VTE probability in the lower range of estimated probabilities. Discrimination of the current model in the validation data sets was better than that of the Wells score combined with a D-dimer threshold based on age (c-statistic 0.73; 95% CI, 0.70-0.75) or structured clinical pretest probability (c-statistic 0.79; 95% CI, 0.76-0.81). CONCLUSION The present model provides an absolute, individualized probability of PE presence in a broad population of patients with suspected PE, with very good discrimination and calibration. Its clinical utility needs to be evaluated in a prospective management or impact study. REGISTRATION PROSPERO ID 89366.
Collapse
Affiliation(s)
- Nick van Es
- Amsterdam University Medical Center, Department of Vascular Medicine, University of Amsterdam, Amsterdam, Meibergdreef 9, 1105 AZ, Amsterdam, The Netherlands
- Amsterdam Cardiovascular Sciences, Pulmonary Hypertension & Thrombosis, Meibergdreef 9, 1105 AZ, Amsterdam, The Netherlands
| | - Toshihiko Takada
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Universiteitsweg 100, 3584 CG, Utrecht, The Netherlands
- Department of General Medicine, Shirakawa Satellite for Teaching And Research (STAR), Fukushima Medical University, 1 Hikarigaoka, Fukushima, 960-1247, Japan
| | - Noémie Kraaijpoel
- Amsterdam University Medical Center, Department of Vascular Medicine, University of Amsterdam, Amsterdam, Meibergdreef 9, 1105 AZ, Amsterdam, The Netherlands
- Amsterdam Cardiovascular Sciences, Pulmonary Hypertension & Thrombosis, Meibergdreef 9, 1105 AZ, Amsterdam, The Netherlands
| | - Frederikus A Klok
- Department of Medicine, Thrombosis and Hemostasis, Leiden University Medical Center, Albinusdreef 2, 2333 ZA, Leiden, Zuid-Holland, The Netherlands
| | - Milou A M Stals
- Department of Medicine, Thrombosis and Hemostasis, Leiden University Medical Center, Albinusdreef 2, 2333 ZA, Leiden, Zuid-Holland, The Netherlands
| | - Harry R Büller
- Amsterdam University Medical Center, Department of Vascular Medicine, University of Amsterdam, Amsterdam, Meibergdreef 9, 1105 AZ, Amsterdam, The Netherlands
- Amsterdam Cardiovascular Sciences, Pulmonary Hypertension & Thrombosis, Meibergdreef 9, 1105 AZ, Amsterdam, The Netherlands
| | - D Mark Courtney
- Department of Emergency Medicine, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Dallas, TX 75390, USA
| | - Yonathan Freund
- Emergency Department, Sorbonne University, Hôpital Pitié-Salpêtrière, Assistance Publique-Hôpitaux de Paris, 47-83 Bd de l'Hôpital, 75013 Paris, France
| | - Javier Galipienzo
- Service of Anesthesiology, MD Anderson Cancer Center Madrid, C. de Arturo Soria, 270, 28033 Madrid, Spain
| | - Grégoire Le Gal
- Department of Medicine, University of Ottawa, and the Ottawa Hospital Research Institute, 725 Parkdale Ave, Ottawa, ON K1Y 4E9, Canada
| | - Waleed Ghanima
- Departments of Hemato-oncology and Research, Østfold hospital, Kalnesveien 300, 1714 Grålum, Norway
- Institute of Clinical Medicine, University of Oslo, Klaus Torgårds vei 3, 0372 Oslo, Oslo, Norway
| | - Menno V Huisman
- Department of Medicine, Thrombosis and Hemostasis, Leiden University Medical Center, Albinusdreef 2, 2333 ZA, Leiden, Zuid-Holland, The Netherlands
| | - Jeffrey A Kline
- Department of Emergency Medicine, Wayne State University School of Medicine, 540 E Canfield St, Detroit, MI 4820, USA
| | - Karel G M Moons
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Universiteitsweg 100, 3584 CG, Utrecht, The Netherlands
| | - Sameer Parpia
- Department of Health Research Methods, Evidence, & Impact, McMaster University, 1200 Main St W, Hamilton, ON L8N 3Z5, Canada
- Department of Oncology, McMaster University, Juravinski Cancer Centre, 699 Concession St. Suite 4-204, Hamilton, Ontario, Canada
| | - Arnaud Perrier
- Division of Angiology and Hemostasis, Geneva University Hospitals and Faculty of Medicine, Rue Michel-Servet 1, 1206 Genève, Switzerland
| | - Marc Righini
- Division of Angiology and Hemostasis, Geneva University Hospitals and Faculty of Medicine, Rue Michel-Servet 1, 1206 Genève, Switzerland
| | - Helia Robert-Ebadi
- Division of Angiology and Hemostasis, Geneva University Hospitals and Faculty of Medicine, Rue Michel-Servet 1, 1206 Genève, Switzerland
| | - Pierre-Marie Roy
- Emergency Department, CHU Angers, UNIV Angers, 4 Rue Larrey, 49100 Angers, Maine-et-Loire, France
| | - Phil S Wells
- Department of Medicine, University of Ottawa, and the Ottawa Hospital Research Institute, 725 Parkdale Ave, Ottawa, ON K1Y 4E9, Canada
| | - Kerstin de Wit
- Department of Emergency Medicine, Queen's University, 76 Stuart Street, Kingston ON K7L 2V7, Canada
- Department of Medicine, McMaster University, McMaster Children's Hospital, 1200 Main Street West, Hamilton, L8N 3Z5 Ontario, Canada
- Department of Health Evidence and Impact, McMaster University, 1200 Main St W, Hamilton, ON L8N 3Z5, Canada
| | - Maarten van Smeden
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Universiteitsweg 100, 3584 CG, Utrecht, The Netherlands
| | - Geert-Jan Geersing
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Universiteitsweg 100, 3584 CG, Utrecht, The Netherlands
| |
Collapse
|
5
|
Ashburn NP, Snavely AC, Paradee BE, O'Neill JC, Stopyra JP, Mahler SA. Age differences in the safety and effectiveness of the HEART Pathway accelerated diagnostic protocol for acute chest pain. J Am Geriatr Soc 2022; 70:2246-2257. [PMID: 35383887 PMCID: PMC9378522 DOI: 10.1111/jgs.17777] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2021] [Revised: 03/17/2022] [Accepted: 03/22/2022] [Indexed: 01/11/2023]
Abstract
BACKGROUND The HEART Pathway is a validated protocol for risk stratifying emergency department (ED) patients with possible acute coronary syndrome (ACS). Its performance in different age groups is unknown. The objective of this study is to evaluate its safety and effectiveness among older adults. METHODS A pre-planned subgroup analysis of the HEART Pathway implementation study was conducted. This prospective interrupted time series accrued adult ED patients with possible ACS who were without ST-elevation across three US sites from 11/2013-01/2016. After implementation, providers prospectively used the HEART Pathway to stratify patients as low-risk or non-low-risk. Patients were classified as older adults (≥65 years), middle-aged (46-64 years), and young (21-45 years). Primary safety and effectiveness outcomes were 30-day death or MI and hospitalization at 30 days, determined from health records, insurance claims, and death index data. Fisher's exact test compared low-risk proportions between groups. Sensitivity for 30-day death or MI and adjusted odds ratios (aORs) for hospitalization and objective cardiac testing were calculated. RESULTS The HEART Pathway implementation study accrued 8474 patients, of which 26.9% (2281/8474) were older adults, 45.5% (3862/8474) middle-aged, and 27.5% (2331/8474) were young. The HEART Pathway identified 7.4% (97/1303) of older adults, 32.0% (683/2131) of middle-aged, and 51.4% (681/1326) of young patients as low-risk (p < 0.001). The HEART Pathway was 98.8% (95% CI 97.1-100) sensitive for 30-day death or MI among older adults. Following implementation, the rate of 30-day hospitalization was similar among older adults (aOR 1.25, 95% CI 1.00-1.55) and cardiac testing increased (aOR 1.25, 95% CI 1.04-1.51). CONCLUSION The HEART Pathway identified fewer older adults as low-risk and did not decrease hospitalizations in this age group.
Collapse
Affiliation(s)
- Nicklaus P. Ashburn
- Department of Emergency MedicineWake Forest School of MedicineWinston‐SalemNorth CarolinaUSA,Section on Cardiovascular Medicine, Department of Internal MedicineWake Forest School of MedicineWinston‐SalemNorth CarolinaUSA
| | - Anna C. Snavely
- Department of Emergency MedicineWake Forest School of MedicineWinston‐SalemNorth CarolinaUSA,Department of Biostatistics and Data ScienceWake Forest School of MedicineWinston‐SalemNorth CarolinaUSA
| | - Brennan E. Paradee
- Department of Emergency MedicineWake Forest School of MedicineWinston‐SalemNorth CarolinaUSA
| | - James C. O'Neill
- Department of Emergency MedicineWake Forest School of MedicineWinston‐SalemNorth CarolinaUSA
| | - Jason P. Stopyra
- Department of Emergency MedicineWake Forest School of MedicineWinston‐SalemNorth CarolinaUSA
| | - Simon A. Mahler
- Department of Emergency MedicineWake Forest School of MedicineWinston‐SalemNorth CarolinaUSA,Department of Epidemiology and PreventionWake Forest School of MedicineWinston‐SalemNorth CarolinaUSA,Department of Implementation ScienceWake Forest School of MedicineWinston‐SalemNorth CarolinaUSA
| |
Collapse
|
6
|
Stals MAM, Takada T, Kraaijpoel N, van Es N, Büller HR, Courtney DM, Freund Y, Galipienzo J, Le Gal G, Ghanima W, Huisman MV, Kline JA, Moons KGM, Parpia S, Perrier A, Righini M, Robert-Ebadi H, Roy PM, van Smeden M, Wells PS, de Wit K, Geersing GJ, Klok FA. Safety and Efficiency of Diagnostic Strategies for Ruling Out Pulmonary Embolism in Clinically Relevant Patient Subgroups : A Systematic Review and Individual-Patient Data Meta-analysis. Ann Intern Med 2022; 175:244-255. [PMID: 34904857 DOI: 10.7326/m21-2625] [Citation(s) in RCA: 26] [Impact Index Per Article: 8.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
BACKGROUND How diagnostic strategies for suspected pulmonary embolism (PE) perform in relevant patient subgroups defined by sex, age, cancer, and previous venous thromboembolism (VTE) is unknown. PURPOSE To evaluate the safety and efficiency of the Wells and revised Geneva scores combined with fixed and adapted D-dimer thresholds, as well as the YEARS algorithm, for ruling out acute PE in these subgroups. DATA SOURCES MEDLINE from 1 January 1995 until 1 January 2021. STUDY SELECTION 16 studies assessing at least 1 diagnostic strategy. DATA EXTRACTION Individual-patient data from 20 553 patients. DATA SYNTHESIS Safety was defined as the diagnostic failure rate (the predicted 3-month VTE incidence after exclusion of PE without imaging at baseline). Efficiency was defined as the proportion of individuals classified by the strategy as "PE considered excluded" without imaging tests. Across all strategies, efficiency was highest in patients younger than 40 years (47% to 68%) and lowest in patients aged 80 years or older (6.0% to 23%) or patients with cancer (9.6% to 26%). However, efficiency improved considerably in these subgroups when pretest probability-dependent D-dimer thresholds were applied. Predicted failure rates were highest for strategies with adapted D-dimer thresholds, with failure rates varying between 2% and 4% in the predefined patient subgroups. LIMITATIONS Between-study differences in scoring predictor items and D-dimer assays, as well as the presence of differential verification bias, in particular for classifying fatal events and subsegmental PE cases, all of which may have led to an overestimation of the predicted failure rates of adapted D-dimer thresholds. CONCLUSION Overall, all strategies showed acceptable safety, with pretest probability-dependent D-dimer thresholds having not only the highest efficiency but also the highest predicted failure rate. From an efficiency perspective, this individual-patient data meta-analysis supports application of adapted D-dimer thresholds. PRIMARY FUNDING SOURCE Dutch Research Council. (PROSPERO: CRD42018089366).
Collapse
Affiliation(s)
- Milou A M Stals
- Department of Thrombosis and Hemostasis, Leiden University Medical Center, Leiden, the Netherlands (M.A.M.S., M.V.H., F.A.K.)
| | - Toshihiko Takada
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, the Netherlands, and Department of General Medicine, Shirakawa Satellite for Teaching and Research (STAR), Fukushima Medical University, Fukushima, Japan (T.T.)
| | - Noémie Kraaijpoel
- Department of Vascular Medicine, Amsterdam University Medical Center, location AMC, Amsterdam Cardiovascular Sciences, Amsterdam, the Netherlands (N.K., N.v.E., H.R.B.)
| | - Nick van Es
- Department of Vascular Medicine, Amsterdam University Medical Center, location AMC, Amsterdam Cardiovascular Sciences, Amsterdam, the Netherlands (N.K., N.v.E., H.R.B.)
| | - Harry R Büller
- Department of Vascular Medicine, Amsterdam University Medical Center, location AMC, Amsterdam Cardiovascular Sciences, Amsterdam, the Netherlands (N.K., N.v.E., H.R.B.)
| | - D Mark Courtney
- Department of Emergency Medicine, The University of Texas Southwestern Medical Center, Dallas, Texas (D.M.C.)
| | - Yonathan Freund
- Department of Emergency Medicine, Pitié-Salpêtrière University Hospital, Assistance Publique-Hôpitaux de Paris, Paris, France (Y.F.)
| | - Javier Galipienzo
- Service of Anesthesiology, Hospital MD Anderson Cancer Center, Madrid, Spain (J.G.)
| | - Grégoire Le Gal
- Department of Medicine, University of Ottawa, Ottawa Hospital Research Institute, Thrombosis Research Group, Ottawa, Ontario, Canada (G.L.G., P.S.W.)
| | - Waleed Ghanima
- Department of Medicine, Østfold Hospital Trust and Institute of Clinical Medicine, University of Oslo, Oslo, Norway (W.G.)
| | - Menno V Huisman
- Department of Thrombosis and Hemostasis, Leiden University Medical Center, Leiden, the Netherlands (M.A.M.S., M.V.H., F.A.K.)
| | - Jeffrey A Kline
- Department of Emergency Medicine, Indiana University School of Medicine, Indianapolis, Indiana (J.A.K.)
| | - Karel G M Moons
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, the Netherlands (K.G.M.M., M.v.S., G.J.G.)
| | - Sameer Parpia
- Department of Oncology, McMaster University, Hamilton, Ontario, Canada (S.P.)
| | - Arnaud Perrier
- Division of Angiology and Hemostasis, Department of Medical Specialties, Geneva University Hospital and Faculty of Medicine, Geneva, Switzerland (A.P., M.R., H.R.E.)
| | - Marc Righini
- Division of Angiology and Hemostasis, Department of Medical Specialties, Geneva University Hospital and Faculty of Medicine, Geneva, Switzerland (A.P., M.R., H.R.E.)
| | - Helia Robert-Ebadi
- Division of Angiology and Hemostasis, Department of Medical Specialties, Geneva University Hospital and Faculty of Medicine, Geneva, Switzerland (A.P., M.R., H.R.E.)
| | - Pierre-Marie Roy
- Department of Emergency Medicine, University of Angers, Angers, France (P.M.R.)
| | - Maarten van Smeden
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, the Netherlands (K.G.M.M., M.v.S., G.J.G.)
| | - Phil S Wells
- Department of Medicine, University of Ottawa, Ottawa Hospital Research Institute, Thrombosis Research Group, Ottawa, Ontario, Canada (G.L.G., P.S.W.)
| | - Kerstin de Wit
- Department of Emergency Medicine, Queen's University, Kingston, and Departments of Medicine and Health Research Methods, Evidence, and Impact (HEI), McMaster University, Hamilton, Ontario, Canada (K.d.W.)
| | - Geert-Jan Geersing
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, the Netherlands (K.G.M.M., M.v.S., G.J.G.)
| | - Frederikus A Klok
- Department of Thrombosis and Hemostasis, Leiden University Medical Center, Leiden, the Netherlands (M.A.M.S., M.V.H., F.A.K.)
| |
Collapse
|
7
|
Heerink JS, Gemen E, Oudega R, Geersing GJ, Hopstaken R, Kusters R. Performance of C-Reactive Protein, Procalcitonin, TAT Complex, and Factor VIII in Addition to D-Dimer in the Exclusion of Venous Thromboembolism in Primary Care Patients. J Appl Lab Med 2021; 7:444-455. [PMID: 34597379 DOI: 10.1093/jalm/jfab094] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2021] [Accepted: 06/28/2021] [Indexed: 11/14/2022]
Abstract
BACKGROUND In primary care, D-dimer-combined with a clinical assessment-is recommended for ruling-out venous thromboembolism (VTE). However, D-dimer testing frequently yields false-positive results, notably in the elderly, and the search for novel biomarkers thus continues. We assessed the added diagnostic value of 4 promising laboratory tests. METHODS Plasma samples from 256 primary care patients suspected of VTE were collected. We explored added value (beyond D-dimer) of C-reactive protein (CRP), procalcitonin (PCT), thrombin-antithrombin III complex (TAT-c), and factor VIII (FVIII). Diagnostic performance of these biomarkers was assessed univariably and by estimating their area under the receiver operating curve (AUC). Added diagnostic potential beyond D-dimer testing was assessed using multivariable logistic regression. RESULTS Plasma samples of 237 VTE-suspected patients were available for analysis-36 patients (25%) confirmed deep vein thrombosis, 11 patients (12%) pulmonary embolism. Apart from D-dimer, only CRP, and FVIII levels appeared to be higher in patients with VTE compared to patients without VTE. The AUCs for these 3 markers were 0.76 (95% CI: 0.69-0.84) and 0.75 (95% CI: 0.68-0.83), respectively, whereas the AUC for D-dimer was 0.90 (95% CI: 0.86-0.94). Combining these biomarkers in a multivariable logistic model with D-dimer did not improve these AUCs meaningfully. CONCLUSIONS In our dataset, we were unable to demonstrate any added diagnostic performance beyond D-dimer testing of novel biomarkers in patients suspected of VTE in primary care. As such, D-dimer testing appears to remain the best choice in the exclusion of clinically suspected VTE in this setting. TRIAL REGISTRATION Netherlands Trial Register NL5974. (METC protocol number: 16-356/M; NL56475.041.16.).
Collapse
Affiliation(s)
- Jorn S Heerink
- Department of Clinical Chemistry and Haematology, Jeroen Bosch Hospital, 's-Hertogenbosch, the Netherlands.,Department of Health Technology and Services Research, Technical Medical Centre, University of Twente, Enschede, the Netherlands
| | - Eugenie Gemen
- Department of Clinical Chemistry and Haematology, Jeroen Bosch Hospital, 's-Hertogenbosch, the Netherlands
| | - Ruud Oudega
- Department of Clinical Chemistry and Haematology, Jeroen Bosch Hospital, 's-Hertogenbosch, the Netherlands.,Julius Centre for Health Sciences and General Practice, University Medical Centre Utrecht, the Netherlands
| | - Geert-Jan Geersing
- Julius Centre for Health Sciences and General Practice, University Medical Centre Utrecht, the Netherlands
| | | | - Ron Kusters
- Department of Clinical Chemistry and Haematology, Jeroen Bosch Hospital, 's-Hertogenbosch, the Netherlands.,Department of Health Technology and Services Research, Technical Medical Centre, University of Twente, Enschede, the Netherlands
| |
Collapse
|
8
|
van Maanen R, Kingma AEC, Oudega R, Rutten FH, Moons K, Geersing GJ. Real-life impact of clinical prediction rules for venous thromboembolism in primary care: a cross-sectional cohort study. BMJ Open 2020; 10:e039913. [PMID: 33372074 PMCID: PMC7772307 DOI: 10.1136/bmjopen-2020-039913] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/14/2020] [Revised: 10/22/2020] [Accepted: 11/17/2020] [Indexed: 11/04/2022] Open
Abstract
OBJECTIVE Clinical prediction rules (CPRs) followed by D-dimer testing were shown to safely rule out venous thromboembolism (VTE) in about half of all suspected patients in controlled and experienced study settings. Yet, its real-life impact in primary care is unknown. The aim of this study was to determine the real-life impact of CPRs for suspected VTE in primary care. DESIGN Cross-sectional cohort study. SETTING Primary care in the Netherlands. PARTICIPANTS Patients with suspected deep venous thrombosis (n=993) and suspected pulmonary embolism (n=484). INTERVENTIONS General practitioners received an educational instruction on how to use CPRs in suspected VTE. We did not rectify incorrect application of the CPR in order to mimic daily clinical care. MAIN OUTCOME MEASURES Primary outcomes were the diagnostic failure rate, defined as the 3-month incidence of VTE in the non-referred group, and the efficiency, defined as the proportion of non-referred patients in the total study population. Secondary outcomes were determinants for and consequences of incorrect application of the CPRs. RESULTS In 267 of the included 1477 patients, VTE was confirmed. When CPRs were correctly applied, the failure rate was 1.51% (95% CI 0.77 to 2.86), and the efficiency was 58.1% (95% CI 55.2 to 61.0). However, the CPRs were incorrectly applied in 339 patients, which resulted in an increased failure rate of 3.31% (95% CI 1.07 to 8.76) and a decreased efficiency of 35.7% (95% CI 30.6 to 41.1). The presence of concurrent heart failure increased the likelihood of incorrect application (adjusted OR 3.26; 95% CI 1.47 to 7.21). CONCLUSIONS Correct application of CPRs for VTE in primary care is associated with an acceptable low failure rate at a high efficiency. Importantly, in nearly a quarter of patients, the CPRs were incorrectly applied that resulted in a higher failure rate and a considerably lower efficiency.
Collapse
Affiliation(s)
- Rosanne van Maanen
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
| | - Annelieke E C Kingma
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
| | - Ruud Oudega
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
| | - Frans H Rutten
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
| | - Karel Moons
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
| | - Geert-Jan Geersing
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
| |
Collapse
|
9
|
Point-of-Care Testing for D-Dimer in the Diagnosis of Venous Thromboembolism in Primary Care: A Narrative Review. Cardiol Ther 2020; 10:27-40. [PMID: 33263839 PMCID: PMC8126530 DOI: 10.1007/s40119-020-00206-2] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2020] [Indexed: 11/02/2022] Open
Abstract
Venous thromboembolism (VTE) is regarded as a significant cause of mortality and disability, affecting 1-2 per 1000 people annually, presenting with a relatively wide range of symptoms, which can pose a diagnostic challenge. Historically, people in whom VTE is suspected will have been taken to hospital for diagnosis and treatment; however, a high proportion of patients are found not to have VTE. Concerns have been expressed about potential delays in treatment, with the risk of additional morbidity and disability, and death. Diagnostic strategies are typically based on the use of a clinical prediction rule to determine the pre-test probability, complemented with a measurement of D-dimer, with confirmation by imaging assessment. This narrative review explores the literature on the use of point-of-care testing (POCT) for the measurement of D-dimer, as part of a clinical decision rule, for the diagnosis of deep vein thrombosis (DVT) and pulmonary embolism (PE) in the primary care setting. In the two main prospective management (validation) studies that included D-dimer POCT or similar technologies, with a total cohort of 1600 participants, DVT was ruled out in 49% of patients, with a false negative rate of 1.4%, whereas PE was ruled out in 45% of patients, with a false negative rate of 1.5%. This suggests that uptake of POCT D-dimer in primary care has the potential to reduce the number of referrals to hospitals for imaging confirmatory investigation, with consequent cost savings. Thus, adopting POCT for D-dimer in primary care can offer clinical and cost benefits, particularly when quantitative POCT assays are being used. Furthermore, POCT should be undertaken in collaboration with the local laboratories to ensure the harmonisation of D-dimer methods and quality assurance to improve the diagnosis of VTE.
Collapse
|
10
|
Konstantinides S, Meyer G. Management of acute pulmonary embolism 2019: what is new in the updated European guidelines? Intern Emerg Med 2020; 15:957-966. [PMID: 32458205 PMCID: PMC7467952 DOI: 10.1007/s11739-020-02340-0] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/07/2019] [Accepted: 04/08/2020] [Indexed: 12/11/2022]
Abstract
Pulmonary embolism (PE) is the third most frequent acute cardiovascular syndrome. Annual PE incidence and PE-related mortality rates rise exponentially with age, and consequently, the disease burden imposed by PE on the society continues to rise as the population ages worldwide. Recently published landmark trials provided the basis for new or changed recommendations included in the 2019 update of the European Society of Cardiology Guidelines (developed in cooperation with the European Respiratory Society). Refinements in diagnostic algorithms were proposed and validated, increasing the specificity of pre-test clinical probability and D-dimer testing, and thus helping to avoid unnecessary pulmonary angiograms. Improved diagnostic strategies were also successfully tested in pregnant women with suspected PE. Non-vitamin K antagonist oral anticoagulants (NOACs) are now the preferred agents for treating the majority of patients with PE, both in the acute phase (with or without a brief lead-in period of parenteral heparin or fondaparinux) and over the long term. Primary reperfusion is reserved for haemodynamically unstable patients. Besides, the 2019 Guidelines endorse multidisciplinary teams for coordinating the acute-phase management of high-risk and (in selected cases) intermediate-risk PE. For normotensive patients, physicians are advised to include the assessment of the right ventricle on top of clinical severity scores in further risk stratification, especially if early discharge of the patient is envisaged. Further important updates include guidance (1) on extended anticoagulation after PE, taking into account the improved safety profile of NOACs; and (2) on the overall care and follow-up of patients who have suffered PE, with the aim to prevent, detect and treat late sequelae of venous thromboembolism.
Collapse
Affiliation(s)
- Stavros Konstantinides
- Center for Thrombosis and Hemostasis (CTH), University Medical Center Mainz, Langenbeckstrasse 1, Bldg. 403, 55131 Mainz, Germany
- Department of Cardiology, Democritus University of Thrace, Komotini, Greece
| | - Guy Meyer
- Respiratory Medicine Department, Hôpital Européen Georges Pompidou, APHP, Paris, France
- Université Paris Descartes, 75006 Paris, France
| |
Collapse
|
11
|
van Maanen R, Rutten FH, Klok FA, Huisman MV, Blom JW, Moons KGM, Geersing GJ. Validation and impact of a simplified clinical decision rule for diagnosing pulmonary embolism in primary care: design of the PECAN prospective diagnostic cohort management study. BMJ Open 2019; 9:e031639. [PMID: 31601598 PMCID: PMC6797359 DOI: 10.1136/bmjopen-2019-031639] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/02/2023] Open
Abstract
INTRODUCTION Combined with patient history and physical examination, a negative D-dimer can safely rule-out pulmonary embolism (PE). However, the D-dimer test is frequently false positive, leading to many (with hindsight) 'unneeded' referrals to secondary care. Recently, the novel YEARS algorithm, incorporating flexible D-dimer thresholds depending on pretest risk, was developed and validated, showing its ability to safely exclude PE in the hospital environment. Importantly, this was accompanied with 14% fewer computed tomographic pulmonary angiography than the standard, fixed D-dimer threshold. Although promising, in primary care this algorithm has not been validated yet. METHODS AND ANALYSIS The PECAN (Diagnosing Pulmonary Embolism in the context of Common Alternative diagNoses in primary care) study is a prospective diagnostic study performed in Dutch primary care. Included patients with suspected acute PE will be managed by their general practitioner according to the YEARS diagnostic algorithm and followed up in primary care for 3 months to establish the final diagnosis. To study the impact of the use of the YEARS algorithm, the primary endpoints are the safety and efficiency of the YEARS algorithm in primary care. Safety is defined as the proportion of false-negative test results in those not referred. Efficiency denotes the proportion of patients classified in this non-referred category. Additionally, we quantify whether C reactive protein measurement has added diagnostic value to the YEARS algorithm, using multivariable logistic and polytomous regression modelling. Furthermore, we will investigate which factors contribute to the subjective YEARS item 'PE most likely diagnosis'. ETHICS AND DISSEMINATION The study protocol was approved by the Medical Ethical Committee Utrecht, the Netherlands. Patients eligible for inclusion will be asked for their consent. Results will be disseminated by publication in peer-reviewed journals and presented at (inter)national meetings and congresses. TRIAL REGISTRATION NTR 7431.
Collapse
Affiliation(s)
- Rosanne van Maanen
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
| | - Frans H Rutten
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
| | - Frederikus A Klok
- Department of Thrombosis and Hemostasis, Leiden University Medical Center, Leiden, The Netherlands
| | - Menno V Huisman
- Department of Thrombosis and Hemostasis, Leiden University Medical Center, Leiden, The Netherlands
| | - Jeanet W Blom
- Department of Public Health and Primary Care, Leiden University Medical Center, Leiden, The Netherlands
| | - Karel G M Moons
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
| | - Geert-Jan Geersing
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
| |
Collapse
|
12
|
Prentice D, Wipke-Tevis DD. Diagnosis of pulmonary embolism: Following the evidence from suspicion to certainty. JOURNAL OF VASCULAR NURSING 2019; 37:28-42. [PMID: 30954195 DOI: 10.1016/j.jvn.2018.10.007] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2018] [Revised: 09/23/2018] [Accepted: 10/02/2018] [Indexed: 12/16/2022]
Abstract
Accurate, timely and cost-effective identification of pulmonary embolism remains a diagnostic challenge. This article reviews the pulmonary embolism diagnostic process with a focus on the best practice advice from the American College of Physicians. Benefits and risks of each diagnostic step are discussed. Emerging diagnostic tools, not included in the algorithm, are briefly reviewed.
Collapse
Affiliation(s)
- Donna Prentice
- Clinical Nurse Specialist, Barnes-Jewish Hospital, St. Louis, MO; PhD Candidate, Sinclair School of Nursing, University of Missouri, Columbia, MO.
| | - Deidre D Wipke-Tevis
- Associate Professor and PhD Program Director, Sinclair School of Nursing, University of Missouri, Columbia, MO
| |
Collapse
|
13
|
Belzile D, Jacquet S, Bertoletti L, Lacasse Y, Lambert C, Lega JC, Provencher S. Outcomes following a negative computed tomography pulmonary angiography according to pulmonary embolism prevalence: a meta-analysis of the management outcome studies. J Thromb Haemost 2018; 16:1107-1120. [PMID: 29645405 DOI: 10.1111/jth.14021] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2017] [Indexed: 12/01/2022]
Abstract
Essentials Computed tomographic pulmonary angiography (CTPA) is used to exclude pulmonary embolism. This meta-analysis explores the occurrence of venous thromboembolic events (VTE) after a CTPA. Occurrence of VTE after a negative CTPA is ˜8% in study subgroups with a prevalence of PE ≥ 40%. CTPA may be insufficient to safely rule out VTE as a stand-alone diagnostic test for this subgroup. SUMMARY Background Outcome studies have reported the safety of computed tomographic pulmonary angiography (CTPA) as a stand-alone imaging technique to rule out pulmonary embolism (PE). Whether this can be applied to all clinical probabilities remains controversial. Objectives We performed a meta-analysis to determine the proportion of patients with venous thromboembolic events (VTE) despite a negative CTPA according to pretest PE prevalence. Methods We searched MEDLINE, EMBASE and the Cochrane Library (January 1990 to May 2017) for outcome studies recruiting patients with suspected PE using CTPA as a diagnostic strategy. The primary outcome was the cumulative occurrence of VTE at 3 months following a negative CTPA. Results Twenty-two different studies were identified. VTE was confirmed in 2.4% of patients (95% CI, 1.3-3.8%) either at the time of the index event or in the 3 months follow-up. Subgroup analyses suggested that the cumulative occurrence of VTE was related to pretest prevalence of PE, as VTE occurred in 1.8% (95% CI, 0.5-3.7%), 1.4% (95% CI, 0.7-2.3%), 1.0% (95% CI, 0.5-1.8%) and 8.1% (95% CI, 3.5-14.5%) of subgroups of patients with a PE prevalence < 20%, 20-29%, 30-39% and ≥ 40%, respectively. This was further confirmed using meta-regression analysis. Conclusions The negative predictive value of CTPA for VTE varies according to pretest prevalence of PE, and is likely to be insufficient to safely rule out VTE as a stand-alone diagnostic test amongst patients at the highest pretest probability of VTE. Prospective studies are required to validate the appropriate diagnostic algorithm for this subgroup of patients.
Collapse
Affiliation(s)
- D Belzile
- Institut Universitaire de Cardiologie et de Pneumologie de Québec Research Center, Laval University, Quebec City, Canada
| | - S Jacquet
- Institut Universitaire de Cardiologie et de Pneumologie de Québec Research Center, Laval University, Quebec City, Canada
| | - L Bertoletti
- Service de Médecine Vasculaire et Thérapeutique, CHU de St-Etienne, Saint-Etienne, France
- INSERM, UMR1059, Equipe Dysfonction Vasculaire et Hémostase, Université Jean-Monnet, Saint-Etienne, France
- INSERM, CIC-1408, CHU Saint-Etienne, Saint-Etienne, France
| | - Y Lacasse
- Institut Universitaire de Cardiologie et de Pneumologie de Québec Research Center, Laval University, Quebec City, Canada
- Department of Medicine, Université Laval, Québec, Canada
| | - C Lambert
- Institut Universitaire de Cardiologie et de Pneumologie de Québec Research Center, Laval University, Quebec City, Canada
| | - J C Lega
- Université Lyon, UMR 5558, Laboratoire de Biométrie et Biologie Évolutive, CNRS, Université Claude-Bernard, Lyon 1, Lyon, France
- Service de Médecine Interne-Pathologie Vasculaire, Hospices Civils de Lyon, Centre Hospitalier Lyon Sud, Pierre-Bénite Cedex, France
| | - S Provencher
- Institut Universitaire de Cardiologie et de Pneumologie de Québec Research Center, Laval University, Quebec City, Canada
- Department of Medicine, Université Laval, Québec, Canada
| |
Collapse
|
14
|
|
15
|
Schols AMR, Stakenborg JPG, Dinant GJ, Willemsen RTA, Cals JWL. Point-of-care testing in primary care patients with acute cardiopulmonary symptoms: a systematic review. Fam Pract 2018; 35:4-12. [PMID: 28985344 DOI: 10.1093/fampra/cmx066] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/08/2023] Open
Abstract
BACKGROUND Point-of-care tests (POCT) can assist general practitioners (GPs) in diagnosing and treating patients with acute cardiopulmonary symptoms, but it is currently unknown if POCT impact relevant clinical outcomes in these patients. OBJECTIVE To assess whether using POCT in primary care patients with acute cardiopulmonary symptoms leads to more accurate diagnosis and impacts clinical management. METHODS We performed a systematic review in four bibliographic databases. Articles published before February 2016 were screened by two reviewers. Studies evaluating the effect of GP use of POCT on clinical diagnostic accuracy and/or effect on treatment and referral rate in patients with cardiopulmonary symptoms were included. RESULTS Our search yielded nine papers describing data from seven studies, on the clinical diagnostic accuracy of POCT in a total of 2277 primary care patients with acute cardiopulmonary symptoms. Four papers showed data on GP use of D-dimer POCT in pulmonary embolism (two studies); two studies on Troponin T in acute coronary syndrome; one on heart-type fatty acid-binding protein (H-FABP) in acute coronary syndrome; one on B-type natriuretic peptide (BNP) in heart failure; one on 3-in-1 POCT (Troponin T, BNP, D-dimer) in acute coronary syndrome, heart failure and/or pulmonary embolism. Only one study assessed the effect of GP use of POCT on treatment initiation and one on actual referral rates. CONCLUSION There is currently limited and inconclusive evidence that actual GP use of POCT in primary care patients with acute cardiopulmonary symptoms leads to more accurate diagnosis and affects clinical management. However, some studies show promising results, especially when a POCT is combined with a clinical decision rule.
Collapse
Affiliation(s)
- Angel M R Schols
- Department of Family Medicine, School for Public Health and Primary Care (CAPHRI), Maastricht University, Maastricht, The Netherlands
| | - Jacqueline P G Stakenborg
- Department of Family Medicine, School for Public Health and Primary Care (CAPHRI), Maastricht University, Maastricht, The Netherlands
| | - Geert-Jan Dinant
- Department of Family Medicine, School for Public Health and Primary Care (CAPHRI), Maastricht University, Maastricht, The Netherlands
| | - Robert T A Willemsen
- Department of Family Medicine, School for Public Health and Primary Care (CAPHRI), Maastricht University, Maastricht, The Netherlands
| | - Jochen W L Cals
- Department of Family Medicine, School for Public Health and Primary Care (CAPHRI), Maastricht University, Maastricht, The Netherlands
| |
Collapse
|
16
|
Wang Y, Hafeez A, Meng F, Zhang R, Wang X, Chen X, Kong Q, Du H, Ma X. The correlation of D-dimer levels with patient outcomes in acute ischemic cerebrovascular disease complicating coronary heart disease. Neurol Res 2017; 38:524-32. [PMID: 27320247 DOI: 10.1080/01616412.2016.1187829] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Abstract
OBJECTIVE To investigate the correlation between nerve function defect, their degree of recovery, and D-dimer levels in patients with acute ischemic cerebrovascular disease (AICVD) complicating coronary heart disease (CHD) in winter. METHODS From 1 October, 2014 to 31 December, 2014, we enrolled patients in a consecutive manner with AICVD who were hospitalized in the Department of Neurology, Beijing Luhe hospital, Capital Medical University. The patients were selected that had an occurrence of AICVD within the last 14 days. A total of 151 cases were divided into CHD group (n = 77) or non-CHD group (n = 74) based on a diagnosis of CHD. The risk factors, hematological indices associated with the diseases, and the nerve function defect and recovery degrees were compared between the two groups. Moreover, according to the result of the preliminary analysis of the CHD and non-CHD groups, patients were further divided into two subgroups based on whether their D-dimer levels were higher than 0.5 mg/l or not. Finally, the nerve function defect and recovery degrees in each subgroups were compared in pairs. RESULTS Among the patients consecutively enrolled, the percentage of the patients with CHD was 50.99% (77/151) and non-CHD patients was 49.01%. On admission, there was no significant difference in NIHSS scores between the CHD and non-CHD groups. However, there was a significant difference between the CHD and non-CHD groups when comparing the NIHSS scores on 14th day and the mRs scores on 90 (±7)th day after the initial onset (p = 0.006, 0.005). The D-dimer levels of AICVD complicating CHD patients were higher than those not complicating CHD patients (p = 0.006). Those AICVD patients that complicating CHD with also elevated D-dimer levels had most severe neurologic function deficits on 14th day and worst neural function recoveries on 90 (±7)th day after onset (p = 0.001, <0.001). CONCLUSIONS AICVD patients complicating CHD is very common in clinical practice. The AICVD patients that complicating CHD showed worse outcomes within 90 days after initial onset of stroke. The D-dimer levels of patients with AICVD complicating CHD were higher. Patients in the CHD group, whose D-dimer levels were higher than the normal standard, had worst outcomes. Paying close attention to the stage of the coronary artery disease and indicators of the coagulation-fibrinolysis is beneficial in the optimization of the clinical treatment for AICVD patients. Maybe the results of this study could provide some reference for specific groups of stroke patients to accept anticoagulant therapy.
Collapse
Affiliation(s)
- Yanling Wang
- a Department of Neurology , Beijing Luhe Hospital, Capital Medical University , Beijing , China.,c Department of Neurology , Xuanwu Hospital, Capital Medical University , Beijing , China
| | - Adam Hafeez
- b Department of Neurological Surgery , Wayne State University School of Medicine , Detroit , MI , USA
| | - Fanhua Meng
- a Department of Neurology , Beijing Luhe Hospital, Capital Medical University , Beijing , China
| | - Ruihua Zhang
- a Department of Neurology , Beijing Luhe Hospital, Capital Medical University , Beijing , China
| | - Xuemei Wang
- a Department of Neurology , Beijing Luhe Hospital, Capital Medical University , Beijing , China
| | - Xiaomeng Chen
- a Department of Neurology , Beijing Luhe Hospital, Capital Medical University , Beijing , China
| | - Qi Kong
- c Department of Neurology , Xuanwu Hospital, Capital Medical University , Beijing , China
| | - Huishan Du
- a Department of Neurology , Beijing Luhe Hospital, Capital Medical University , Beijing , China
| | - Xin Ma
- c Department of Neurology , Xuanwu Hospital, Capital Medical University , Beijing , China
| |
Collapse
|
17
|
Stein CE, Keijsers CJPW, Bootsma JEM, Schouten HJ. Missed diagnosis of pulmonary embolism with age-adjusted d-dimer cut-off value. Age Ageing 2016; 45:910-911. [PMID: 27496940 DOI: 10.1093/ageing/afw132] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2016] [Accepted: 06/15/2016] [Indexed: 11/14/2022] Open
Abstract
Pulmonary embolism (PE) is a potentially severe diagnosis with high short-term mortality. Recently, age-adjusted cut-off values (age × 10 μg/l) of D-dimer were introduced to improve the diagnostic workup in older patients. In clinical practice, PE is considered 'ruled out' in patients with a non-high clinical probability and a normal D-dimer. However, all diagnostic tests have a small false-negative rate. This small probability of misdiagnosis might be easily overlooked by clinicians when using simplified dichotomized flow charts. This case illustrates a normal D-dimer (age-adjusted) but with a PE. We recommend clinicians using the D-dimer test-either conventional or age-adjusted in a rule-out strategy to be aware of the-albeit small probability of a false-negative result.
Collapse
Affiliation(s)
| | | | - Janet E M Bootsma
- Jeroen Bosch Ziekenhuis-Geriatrics, Den Bosch, Noord-Brabant, Netherlands
| | | |
Collapse
|
18
|
Karasu A, Engbers MJ, Cushman M, Rosendaal FR, van Hylckama Vlieg A. Genetic risk factors for venous thrombosis in the elderly in a case-control study. J Thromb Haemost 2016; 14:1759-64. [PMID: 27377285 DOI: 10.1111/jth.13409] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2016] [Indexed: 12/01/2022]
Abstract
UNLABELLED Essentials Risk of venous thrombosis (VT) related to common genetic variants in those aged 70+ is unknown. We studied Factor V Leiden, prothrombin mutation, non-O blood group and family history (FH) of VT. Risk of VT was increased 2.2-, 1.4-, 1.3- and 2.1-fold respectively. FH is easy to obtain and can be implemented in clinical decision rules of VT risk in the elderly. Click to hear Prof. Reitsma discuss genetic risk factors of arterial and venous thrombosis SUMMARY Background As the incidence of venous thrombosis (VT) increases steeply with age and the number of elderly people is on the rise, studies of VT in this age group are important. Objectives We aimed to study the associations of common genetic risk factors (i.e. the factor V Leiden and prothrombin G20210A mutations, non-O blood group and family history of VT) with risk of a first VT in older age (> 70 years). Methods Four hundred and one consecutive cases with a first-time thrombosis and 431 controls (all ≥ 70 years) were included in the AT-AGE case-control study. Information on risk factors for VT, including family history of VT in first-degree relatives, was obtained by interview. Unprovoked VT was defined as thrombosis not related to surgery, fracture, plaster cast or immobility within 3 months prior to VT. Results The risk of VT was 2.2-fold increased in factor V Leiden carriers (95% confidence interval [CI], 1.2-3.9), 1.4-fold increased in prothrombin mutation carriers (95% CI, 0.5-3.9), and 1.3-fold increased in those with non-O blood group (95% CI, 1.0-1.8). Positive family history of VT was associated with a 2.1-fold increased risk of VT (95% CI, 1.5-3.1). The highest risk of VT was found in individuals who had both a positive family history and were carriers of one of the two prothrombotic mutations. Conclusions Genetic factors clearly related to VT in younger populations were also risk factors in older age and a positive family history was also important in this age group.
Collapse
Affiliation(s)
- A Karasu
- Department of Clinical Epidemiology, Leiden University Medical Center, Leiden, the Netherlands
| | - M J Engbers
- Department of Clinical Epidemiology, Leiden University Medical Center, Leiden, the Netherlands
| | - M Cushman
- Department of Medicine, Cardiovascular Research Institute, University of Vermont, Burlington, VT, USA
| | - F R Rosendaal
- Department of Clinical Epidemiology, Leiden University Medical Center, Leiden, the Netherlands
- Thrombosis and Haemostasis Research Center, Leiden University Medical Center, Leiden, the Netherlands
| | - A van Hylckama Vlieg
- Department of Clinical Epidemiology, Leiden University Medical Center, Leiden, the Netherlands.
| |
Collapse
|
19
|
Johnson SA, Eleazer GP, Rondina MT. Pathogenesis, Diagnosis, and Treatment of Venous Thromboembolism in Older Adults. J Am Geriatr Soc 2016; 64:1869-78. [PMID: 27556937 DOI: 10.1111/jgs.14279] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/22/2022]
Abstract
Older adults have a significantly greater risk of venous thromboembolism (VTE), including deep vein thrombosis and pulmonary embolism, than younger adults. The cause of this greater risk is thought to be multifactorial, including age-related changes in hemostatic factors and greater comorbid conditions and hospitalizations, but is not completely understood. Moreover, VTE remains underrecognized in older adults and may present atypically. Thus, a low index of clinical suspicion is essential when evaluating older adults with possible VTE. Despite this underrecognition in older adults, the diagnostic approach remains similar for all age groups and includes estimation of pretest probability, measurement of the D-dimer, and imaging. Antithrombotic agents are the mainstay of VTE treatment and, when used appropriately, substantially reduce VTE recurrence and complications. The approval of novel oral anticoagulants (NOACs), including dabigatran, rivaroxaban, apixaban, and edoxaban, provide clinicians with new therapeutic options. In some individuals, NOACs may offer advantages over warfarin, including fewer drug interactions, more-predictable anticoagulation, and lower risk of bleeding. Nevertheless, anticoagulation of VTE in older adults should always be performed cautiously, because age is a risk factor for bleeding complications. Identifying modifiable bleeding risk factors and balancing the risks of VTE recurrence with hemorrhage are important considerations when using anticoagulants in older adults.
Collapse
Affiliation(s)
- Stacy A Johnson
- Department of Internal Medicine, George E. Wahlen Veterans Affairs Medical Center, Salt Lake City, Utah.,Department of Internal Medicine, Eccles Institute of Human Genetics, University of Utah Health Sciences Center, Salt Lake City, Utah
| | - G Paul Eleazer
- Department of Internal Medicine, George E. Wahlen Veterans Affairs Medical Center, Salt Lake City, Utah
| | - Matthew T Rondina
- Department of Internal Medicine, George E. Wahlen Veterans Affairs Medical Center, Salt Lake City, Utah. .,Department of Internal Medicine, Eccles Institute of Human Genetics, University of Utah Health Sciences Center, Salt Lake City, Utah. .,Molecular Medicine Program, Eccles Institute of Human Genetics, University of Utah Health Sciences Center, Salt Lake City, Utah.
| |
Collapse
|
20
|
|
21
|
Geersing GJ, de Groot JA, Reitsma JB, Hoes AW, Rutten FH. The impending epidemic of chronic cardiopulmonary disease and multimorbidity: the need for new research approaches to guide daily practice. Chest 2016; 148:865-869. [PMID: 25856418 DOI: 10.1378/chest.14-3172] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/11/2022] Open
Abstract
Mortality caused by acute cardiopulmonary disease is decreasing, and in many countries the population is aging rapidly. Yet, the life-years gained are often spent with multiple chronic and slowly progressive conditions, and this particularly applies to patients with cardiopulmonary disease. Affected individuals often have multiple diagnoses related to the cardiopulmonary-metabolic axis with accelerated aging and gradually progressive failure of organs that provide the body with oxygen and nutrients. This more or less reflects an "engine running out of fuel." This, for instance, is the case with the concurrent presence of COPD and heart failure in one patient that is often combined with other comorbidities such as atrial fibrillation, renal failure, or diabetes. This asks for a paradigm shift: away from single-disease-oriented patient management and toward patient-tailored multimorbidity medicine. Daily clinical practice is already recognizing this on a daily basis, yet clinical research and guidelines are still lagging behind. Thus, novel research approaches are needed to better guide evidence-based clinical practice. These approaches include the construction of diagnostic models to predict the presence of multiple diseases simultaneously, individual patient data meta-analysis as a method to examine variation in the effects of treatments or diagnostic tests depending on comorbidity, and the construction of therapeutic prediction models that predict the therapeutic effect of drugs based on the presence (or absence) of relevant comorbidity. We argue that multimorbidity should be regarded as a "friend" and not as a "foe" in clinical research addressing the current clinical problems in daily practice.
Collapse
Affiliation(s)
- Geert-Jan Geersing
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht, The Netherlands.
| | - Joris A de Groot
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Johannes B Reitsma
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Arno W Hoes
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Frans H Rutten
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht, The Netherlands
| |
Collapse
|
22
|
Schreiber R. Value of WELLS's Pulmonary Embolism Prediction Score in Elderly Outpatients. J Am Geriatr Soc 2015; 63:1048-9. [PMID: 25989581 DOI: 10.1111/jgs.13409] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/17/2022]
Affiliation(s)
- Richard Schreiber
- Holy Spirit Health System, A Geisinger Affiliate, Camp Hill, Pennsylvania
| |
Collapse
|
23
|
Schouten HJ, Geersing GJ, Oudega R, van Delden JJM, Moons KGM, Koek HL. Response to Richard Schreiber: diagnosing pulmonary embolism in frail older adults out of the hospital. J Am Geriatr Soc 2015; 63:1049-50. [PMID: 25989582 DOI: 10.1111/jgs.13419] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
Affiliation(s)
- Henrike J Schouten
- Department of Geriatrics, Julius Center for Health Sciences and Primary Care, Utrecht, the Netherlands
| | - Geert-Jan Geersing
- Julius Center for Health Sciences and Primary Care, Utrecht, the Netherlands
| | - Ruud Oudega
- Julius Center for Health Sciences and Primary Care, Utrecht, the Netherlands
| | | | - Karel G M Moons
- Julius Center for Health Sciences and Primary Care, Utrecht, the Netherlands
| | - Huiberdina L Koek
- Department of Geriatrics, University Medical Center, Utrecht, the Netherlands
| |
Collapse
|