1
|
Snyder ME, Nguyen KA, Patel H, Sanchez SL, Traylor M, Robinson MJ, Damush TM, Taber P, Mixon AS, Fan VS, Savoy A, Dismore RA, Porter BW, Boockvar KS, Haggstrom DA, Locke ER, Gibson BS, Byerly SH, Weiner M, Russ-Jara AL. Clinicians' use of Health Information Exchange technologies for medication reconciliation in the U.S. Department of Veterans Affairs: a qualitative analysis. BMC Health Serv Res 2024; 24:1194. [PMID: 39375765 PMCID: PMC11460093 DOI: 10.1186/s12913-024-11690-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2024] [Accepted: 10/01/2024] [Indexed: 10/09/2024] Open
Abstract
BACKGROUND Medication reconciliation is essential for optimizing medication use. In part to promote effective medication reconciliation, the Department of Veterans Affairs (VA) invested substantial resources in health information exchange (HIE) technologies. The objectives of this qualitative study were to characterize VA clinicians' use of HIE tools for medication reconciliation in their clinical practice and to identify facilitators and barriers. METHODS We recruited inpatient and outpatient prescribers (physicians, nurse practitioners, physician assistants) and pharmacists at four geographically distinct VA medical centers for observations and interviews. Participants were observed as they interacted with HIE or medication reconciliation tools during routine work. Participants were interviewed about clinical decision-making pertaining to medication reconciliation and use of HIE tools, and about barriers and facilitators to use of the tools. Qualitative data were analyzed via inductive and deductive approaches using a priori codes. RESULTS A total of 63 clinicians participated. Over half (58%) were female, and the mean duration of VA clinical experience was 7 (range 0-32) years. Underlying motivators for clinicians seeking data external to their VA medical center were having new patients, current patients receiving care from an external institution, and clinicians' concerns about possible medication discrepancies among institutions. Facilitators for using HIE software were clinicians' familiarity with the HIE software, clinicians' belief that medication information would be available within HIE, and their confidence in the ability to find HIE medication-related data of interest quickly. Six overarching barriers to HIE software use for medication coordination included visual clutter and information overload within the HIE display; challenges with HIE interface navigation; lack of integration between HIE and other electronic health record interfaces, necessitating multiple logins and application switching; concerns with the dependability of HIE medication information; unfamiliarity with HIE tools; and a lack of HIE data from non-VA facilities. CONCLUSIONS This study is believed to be the first to qualitatively characterize clinicians' HIE use with respect to medication reconciliation. Results inform recommendations to optimize HIE use for medication management activities. We expect that healthcare organizations and software vendors will be able to apply the findings to develop more effective and usable HIE information displays.
Collapse
Affiliation(s)
- Margie E Snyder
- College of Pharmacy, Purdue University, West Lafayette, IN, USA
- Center for Health Information and Communication, Health Services Research and Development Service CIN 13-416, U.S. Department of Veterans Affairs (VA), Veterans Health Administration, Richard L. Roudebush VA Medical Center, 1481 West 10th Street (11H), Indianapolis, IN, 46202, USA
- Department of Medicine, Indiana University School of Medicine, Indianapolis, IN, USA
- Center for Health Services Research, Regenstrief Institute, Inc, Indianapolis, IN, USA
| | - Khoa A Nguyen
- Center for Health Information and Communication, Health Services Research and Development Service CIN 13-416, U.S. Department of Veterans Affairs (VA), Veterans Health Administration, Richard L. Roudebush VA Medical Center, 1481 West 10th Street (11H), Indianapolis, IN, 46202, USA
- College of Pharmacy, University of Florida, Gainesville, FL, USA
| | - Himalaya Patel
- Center for Health Information and Communication, Health Services Research and Development Service CIN 13-416, U.S. Department of Veterans Affairs (VA), Veterans Health Administration, Richard L. Roudebush VA Medical Center, 1481 West 10th Street (11H), Indianapolis, IN, 46202, USA
| | - Steven L Sanchez
- Center for Health Information and Communication, Health Services Research and Development Service CIN 13-416, U.S. Department of Veterans Affairs (VA), Veterans Health Administration, Richard L. Roudebush VA Medical Center, 1481 West 10th Street (11H), Indianapolis, IN, 46202, USA
| | - Morgan Traylor
- Center for Health Information and Communication, Health Services Research and Development Service CIN 13-416, U.S. Department of Veterans Affairs (VA), Veterans Health Administration, Richard L. Roudebush VA Medical Center, 1481 West 10th Street (11H), Indianapolis, IN, 46202, USA
| | - Michelle J Robinson
- Center for Health Information and Communication, Health Services Research and Development Service CIN 13-416, U.S. Department of Veterans Affairs (VA), Veterans Health Administration, Richard L. Roudebush VA Medical Center, 1481 West 10th Street (11H), Indianapolis, IN, 46202, USA
| | - Teresa M Damush
- Center for Health Information and Communication, Health Services Research and Development Service CIN 13-416, U.S. Department of Veterans Affairs (VA), Veterans Health Administration, Richard L. Roudebush VA Medical Center, 1481 West 10th Street (11H), Indianapolis, IN, 46202, USA
- Department of Medicine, Indiana University School of Medicine, Indianapolis, IN, USA
- Center for Health Services Research, Regenstrief Institute, Inc, Indianapolis, IN, USA
| | - Peter Taber
- Information, Decision Enhancement and Analytics Center of Innovation, U.S. Department of Veteran Affairs, Veteran Health Administration, Salt Lake City, UT, USA
- Department of Biomedical Informatics, Decision Enhancement and Analytics Sciences 2.0 Center of Innovation VA, University of Utah, Salt Lake City, UT, USA
| | - Amanda S Mixon
- Geriatric Research, Education, and Clinical Center, VA Tennessee Valley Healthcare System, Nashville, TN, USA
- School of Medicine, Vanderbilt University Medical Center, Nashville, TN, USA
| | - Vincent S Fan
- VA Puget Sound Health Care System, Seattle, WA, USA
- School of Medicine, University of Washington, Seattle, WA, USA
| | - April Savoy
- Center for Health Information and Communication, Health Services Research and Development Service CIN 13-416, U.S. Department of Veterans Affairs (VA), Veterans Health Administration, Richard L. Roudebush VA Medical Center, 1481 West 10th Street (11H), Indianapolis, IN, 46202, USA
- Center for Health Services Research, Regenstrief Institute, Inc, Indianapolis, IN, USA
- Purdue School of Engineering and Technology, Indiana University-Purdue University Indianapolis, Indianapolis, IN, USA
| | - Rachel A Dismore
- Center for Health Information and Communication, Health Services Research and Development Service CIN 13-416, U.S. Department of Veterans Affairs (VA), Veterans Health Administration, Richard L. Roudebush VA Medical Center, 1481 West 10th Street (11H), Indianapolis, IN, 46202, USA
| | - Brian W Porter
- Center for Health Information and Communication, Health Services Research and Development Service CIN 13-416, U.S. Department of Veterans Affairs (VA), Veterans Health Administration, Richard L. Roudebush VA Medical Center, 1481 West 10th Street (11H), Indianapolis, IN, 46202, USA
- University of Tennessee Health Sciences Center, Memphis, TN, USA
| | - Kenneth S Boockvar
- Birmingham VA Medical Center, Geriatrics Research Education & Clinical Center, Birmingham, AL, USA
- Division of Gerontology, Geriatrics and Palliative Care, University of Alabama at Birmingham, Birmingham, AL, USA
| | - David A Haggstrom
- Center for Health Information and Communication, Health Services Research and Development Service CIN 13-416, U.S. Department of Veterans Affairs (VA), Veterans Health Administration, Richard L. Roudebush VA Medical Center, 1481 West 10th Street (11H), Indianapolis, IN, 46202, USA
- Department of Medicine, Indiana University School of Medicine, Indianapolis, IN, USA
- Center for Health Services Research, Regenstrief Institute, Inc, Indianapolis, IN, USA
| | | | - Bryan S Gibson
- Information, Decision Enhancement and Analytics Center of Innovation, U.S. Department of Veteran Affairs, Veteran Health Administration, Salt Lake City, UT, USA
- Department of Biomedical Informatics, School of Medicine, University of Utah, Salt Lake City, UT, USA
| | - Susan H Byerly
- Geriatric Research, Education, and Clinical Center, VA Tennessee Valley Healthcare System, Nashville, TN, USA
- School of Medicine, Vanderbilt University Medical Center, Nashville, TN, USA
| | - Michael Weiner
- Center for Health Information and Communication, Health Services Research and Development Service CIN 13-416, U.S. Department of Veterans Affairs (VA), Veterans Health Administration, Richard L. Roudebush VA Medical Center, 1481 West 10th Street (11H), Indianapolis, IN, 46202, USA.
- Department of Medicine, Indiana University School of Medicine, Indianapolis, IN, USA.
- Center for Health Services Research, Regenstrief Institute, Inc, Indianapolis, IN, USA.
| | - Alissa L Russ-Jara
- College of Pharmacy, Purdue University, West Lafayette, IN, USA
- Center for Health Information and Communication, Health Services Research and Development Service CIN 13-416, U.S. Department of Veterans Affairs (VA), Veterans Health Administration, Richard L. Roudebush VA Medical Center, 1481 West 10th Street (11H), Indianapolis, IN, 46202, USA
- Center for Health Services Research, Regenstrief Institute, Inc, Indianapolis, IN, USA
- Regenstrief Center for Healthcare Engineering, Purdue University, West Lafayette, IN, USA
| |
Collapse
|
2
|
Dashtkoohi M, Poursalehian M, Azadmanjir Z, Vaeidi M, Mohammadzadeh M, Sharif-Alhoseini M, Naghdi K, Moniri Asl M, Harrop J, Rahimi-Movaghar V. Data Consistency of Two National Registries in Iran: A Preliminary Assessment to Health Information Exchange. ARCHIVES OF IRANIAN MEDICINE 2024; 27:357-363. [PMID: 39072383 PMCID: PMC11316184 DOI: 10.34172/aim.30023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/03/2024] [Accepted: 06/09/2024] [Indexed: 07/30/2024]
Abstract
BACKGROUND The National Spinal Cord Injury Registry of Iran (NSCIR-IR) and the National Trauma Registry of Iran (NTRI) were established to meet the data needs for research and assessing trauma status in Iran. These registries have a group of patients shared by both registries, and it is expected that some identical data will be collected about them. A general question arises whether the spinal cord injury registry can receive part of the common data from the trauma registry and not collect them independently. METHODS We examined variables captured in both registries based on structure and concept, identified the overlapping period during which both systems recorded data in the same centers and extracted relevant data from both registries. Further, we evaluated the data for any discrepancies in amount or nature and pinpointed the underlying reasons for any inconsistencies. RESULTS Out of all the variables in the NSCIR-IR database, 18.6% of variables were similar to the NTRI in terms of concept and structure. Although four hospitals participated in both registries, only two (Sina and Beheshti Hospitals) had common cases. Patient names, prehospital intubation, ambulance arrival time, ICU length of stay, and admission time were consistent across both registries with no differences. Other common data variables had significant discrepancies. CONCLUSION This study highlights the potential for health information exchange (HIE) between NSCIR-IR and NTRI and serves as a starting point for stakeholders and policymakers to understand the differences between the two registries and work toward the successful adoption of HIE.
Collapse
Affiliation(s)
- Mohammad Dashtkoohi
- Sina Trauma and Surgery Research Center, Tehran University of Medical Sciences, Tehran, Iran
- Students’ Scientific Research Center (SSRC), Tehran University of Medical Sciences, Tehran, Iran
- Brain and Spinal Cord Injury Research Center, Neuroscience Institute, Tehran University of Medical Sciences, Tehran, Iran
| | - Mohammad Poursalehian
- Sina Trauma and Surgery Research Center, Tehran University of Medical Sciences, Tehran, Iran
- Students’ Scientific Research Center (SSRC), Tehran University of Medical Sciences, Tehran, Iran
| | - Zahra Azadmanjir
- Sina Trauma and Surgery Research Center, Tehran University of Medical Sciences, Tehran, Iran
- Department of Health Information Management, School of Allied Medical Sciences, Tehran University of Medical Sciences, Tehran, Iran
| | - Masoomeh Vaeidi
- Trauma Research Center, Kashan University of Medical Sciences, Kashan, Iran
| | | | - Mahdi Sharif-Alhoseini
- Sina Trauma and Surgery Research Center, Tehran University of Medical Sciences, Tehran, Iran
| | - Khatereh Naghdi
- Sina Trauma and Surgery Research Center, Tehran University of Medical Sciences, Tehran, Iran
| | - Marzieh Moniri Asl
- Health Information Technology Department, Urmia University of Medical Sciences, Urmia, Iran
| | - James Harrop
- Department of Neurological Surgery, Thomas Jefferson University Hospital, Philadelphia, PA, USA
| | - Vafa Rahimi-Movaghar
- Sina Trauma and Surgery Research Center, Tehran University of Medical Sciences, Tehran, Iran
- Brain and Spinal Cord Injury Research Center, Neuroscience Institute, Tehran University of Medical Sciences, Tehran, Iran
| |
Collapse
|
3
|
Kelly WN, Ho MJ, Smith T, Bullers K, Bates DW, Kumar A. Association of Pharmacist Interventions With Adverse Drug Events and Potential Adverse Drug Events. Pharmacoepidemiol Drug Saf 2024; 33:e5853. [PMID: 38973415 DOI: 10.1002/pds.5853] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2024] [Revised: 05/16/2024] [Accepted: 05/29/2024] [Indexed: 07/09/2024]
Abstract
BACKGROUND Adverse drug events (ADEs) are a frequent cause of injury in patients. Our aim was to assess whether pharmacist interventions compared with no pharmacist intervention results in reduced ADEs and potential adverse drug events (PADEs). METHODS We searched MEDLINE, Embase, and two other databases through September 19, 2022 for any RCT assessing the effect of a pharmacist intervention compared with no pharmacist intervention and reporting on ADEs or PADEs. The risk of bias was assessed using the Cochrane tool for RCTs. A random-effects model was used to pool summary results from individual RCTs. RESULTS Fifteen RCTs met the inclusion criteria. The pooled results showed a statistically significant reduction in ADE associated with pharmacist intervention compared with no pharmacist intervention (RR = 0.86; [95% CI 0.80-0.94]; p = 0.0005) but not for PADEs (RR = 0.79; [95% CI 0.47-1.32]; p = 0.37). The heterogeneity was insignificant (I2 = 0%) for ADEs and substantial (I2 = 77%) for PADEs. Patients receiving a pharmacist intervention were 14% less likely for ADE than those who did not receive a pharmacist intervention. The estimated number of patients needed to prevent one ADE across all patient locations was 33. CONCLUSIONS To our knowledge, this is the first systematic review and meta-analysis of RCTs seeking to understand the association of pharmacist interventions with ADEs and PADEs. The risk of having an ADE is reduced by a seventh for patients receiving a pharmacist care intervention versus no such intervention. The estimated number of patients needed to be followed across all patient locations to prevent one preventable ADE across all patient locations is 33.
Collapse
Affiliation(s)
- W N Kelly
- Taneja College of Pharmacy, University of South Florida, Tampa, Florida, USA
| | - M J Ho
- Taneja College of Pharmacy, University of South Florida, Tampa, Florida, USA
| | - T Smith
- Research Methodology and Biostatistics Core, Office of Research, Morsani College of Medicine, University of South Florida, Tampa, Florida, USA
| | - K Bullers
- Shimberg Library, USF Health, University of South Florida, Tampa, Florida, USA
| | - D W Bates
- Division of General Medicine and Primary Care, Brigham and Women's Hospital, Boston, Massachusetts, USA
| | - A Kumar
- Research Methodology and Biostatistics Core, Office of Research, Morsani College of Medicine, University of South Florida, Tampa, Florida, USA
| |
Collapse
|
4
|
Petrova M, Barclay S. From "wading through treacle" to "making haste slowly": A comprehensive yet parsimonious model of drivers and challenges to implementing patient data sharing projects based on an EPaCCS evaluation and four pre-existing literature reviews. PLOS DIGITAL HEALTH 2024; 3:e0000470. [PMID: 38557799 PMCID: PMC10984410 DOI: 10.1371/journal.pdig.0000470] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/15/2021] [Accepted: 02/19/2024] [Indexed: 04/04/2024]
Abstract
Conceptually, this study aimed to 1) identify the challenges and drivers encountered by England's Electronic Palliative Care Coordination System (EPaCCS) projects in the context of challenges and drivers in other projects on data sharing for individual care (also referred to as Health Information Exchange, HIE) and 2) organise them in a comprehensive yet parsimonious framework. The study also had a strong applied goal: to derive specific and non-trivial recommendations for advancing data sharing projects, particularly ones in early stages of development and implementation. Primary data comprised 40 in-depth interviews with 44 healthcare professionals, patients, carers, project team members and decision makers in Cambridgeshire, UK. Secondary data were extracted from four pre-existing literature reviews on Health Information Exchange and Health Information Technology implementation covering 135 studies. Thematic and framework analysis underpinned by "pluralist" coding were the main analytical approaches used. We reduced an initial set of >1,800 parameters into >500 challenges and >300 drivers to implementing EPaCCS and other data sharing projects. Less than a quarter of the 800+ parameters were associated primarily with the IT solution. These challenges and drivers were further condensed into an action-guiding, strategy-informing framework of nine types of "pure challenges", four types of "pure drivers", and nine types of "oppositional or ambivalent forces". The pure challenges draw parallels between patient data sharing and other broad and complex domains of sociotechnical or social practice. The pure drivers differ in how internal or external to the IT solution and project team they are, and thus in the level of control a project team has over them. The oppositional forces comprise pairs of challenges and drivers where the driver is a factor serving to resolve or counteract the challenge. The ambivalent forces are factors perceived simultaneously as a challenge and a driver depending on context, goals and perspective. The framework is distinctive in its emphasis on: 1) the form of challenges and drivers; 2) ambivalence, ambiguity and persistent tensions as fundamental forces in the field of innovation implementation; and 3) the parallels it draws with a variety of non-IT, non-health domains of practice as a source of fruitful learning. Teams working on data sharing projects need to prioritise further the shaping of social interactions and structural and contextual parameters in the midst of which their IT tools are implemented. The high number of "ambivalent forces" speaks of the vital importance for data sharing projects of skills in eliciting stakeholders' assumptions; managing conflict; and navigating multiple needs, interests and worldviews.
Collapse
Affiliation(s)
- Mila Petrova
- Palliative and End of Life Care Group in Cambridge (PELiCam), Primary Care Unit, Department of Public Health and Primary Care, University of Cambridge, United Kingdom
| | - Stephen Barclay
- Palliative and End of Life Care Group in Cambridge (PELiCam), Primary Care Unit, Department of Public Health and Primary Care, University of Cambridge, United Kingdom
| |
Collapse
|
5
|
Dupont S, Nemeth J, Turbow S. Effects of Health Information Exchanges in the Adult Inpatient Setting: a Systematic Review. J Gen Intern Med 2023; 38:1046-1053. [PMID: 36376635 PMCID: PMC10039134 DOI: 10.1007/s11606-022-07872-z] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/22/2022] [Accepted: 10/20/2022] [Indexed: 11/16/2022]
Abstract
BACKGROUND Health information exchanges (HIEs) have proliferated over the last decade, but a gap remains in our understanding of their benefits to patients and the healthcare system. In this systematic review, we provide an updated report on what is known regarding the impacts of HIE on clinical, health care utilization, and cost outcomes in the adult inpatient setting. METHODS We searched Pubmed, Web of Science, Embase, Cochrane, and Ebsco databases for citations published between January 2015 and August 2021. Eligible studies were English-language experimental or observational studies. We assessed risk of bias via the National Heart Lung and Blood Institute's Quality Assessment Tool for Observational Cohort and Cross-Sectional Studies. RESULTS We identified 11 eligible studies-1 quasi-experimental and 10 observational. Five studies examined readmission rates and 3 found benefits from HIE. Three studies examined mortality with 2 finding benefits from the availability of HIE. Eight studies examined utilization and cost outcomes with 2 finding benefits from HIE, 1 finding poorer outcomes with HIE, and the others finding no impact. CONCLUSIONS Evidence for the impacts of HIE remains largely observational with little direct measure of HIE use during clinical care, making causality difficult to assess. The highly variable outcomes examined by these studies limit meaningful synthesis. The strength of evidence is low that HIE reduces unplanned readmissions and mortality and there is insufficient evidence for the impact of HIE on cost or utilization. The increased number of studies specific to inpatient settings that examine objective outcomes with more rigorous statistical methods is a promising development since prior reviews. TRIAL REGISTRATION PROSPERO 2021 CRD42021274049 Available from: https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42021274049 AMENDMENTS TO PROTOCOL: Initially planned use of the Newcastle-Ottawa quality assessment scale was substituted for the National Heart Lung and Blood Institute's Quality Assessment Tool for Observational Cohort and Cross-Sectional Studies as it was better suited to evaluate the primarily retrospective observational cohort studies identified in the review.
Collapse
Affiliation(s)
- Sarah Dupont
- Department of Family and Preventive Medicine, Emory University School of Medicine, Atlanta, GA USA
| | - John Nemeth
- Woodruff Health Sciences Center Library, Emory University, Atlanta, GA USA
| | - Sara Turbow
- Department of Family and Preventive Medicine, Emory University School of Medicine, Atlanta, GA USA
- Department of Medicine, Emory University School of Medicine, Atlanta, GA USA
| |
Collapse
|
6
|
Lesselroth B, Church VL, Adams K, Mixon A, Richmond-Aylor A, Glasscock N, Wiedrick J. Interprofessional survey on medication reconciliation activities in the US Department of Veterans' Affairs: development and validation of an Implementation Readiness Questionnaire. BMJ Open Qual 2022; 11:bmjoq-2021-001750. [PMID: 36229073 PMCID: PMC9562315 DOI: 10.1136/bmjoq-2021-001750] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2022] [Accepted: 09/20/2022] [Indexed: 11/17/2022] Open
Abstract
BACKGROUND Medication reconciliation (MR) can detect medication history discrepancies at interfaces-in-care and help avoid downstream adverse drug events. However, organisations have struggled to implement high-quality MR programmes. The literature has identified systems barriers, including technology capabilities and data interoperability. However, organisational culture as a root cause has been underexplored. OBJECTIVES Our objectives were to develop an implementation readiness questionnaire and measure staff attitudes towards MR across a healthcare enterprise. METHODS We developed and distributed a questionnaire to 170 Veterans' Health Affairs (VHA) sites using Research Electronic Data Capture (REDCap) software. The questionnaire contained 21 Likert-scale items that measured three constructs, such as: (1) the extent that clinicians valued MR; (2) perceptions of workflow compatibility and (3) perceptions concerning organisational climate of implementation. RESULTS 8704 clinicians and staff responded to our questionnaire (142 of 170 VHA facilities). Most staff believed reconciling medications can improve medication safety (approximately 90% agreed it was 'important'). However, most (approximately 90%) also expressed concerns about changes to their workflow. One-third of respondents prioritised other duties over MR and reported barriers associated with implementation climate. Only 47% of respondents agreed they had enough resources to address discrepancies when identified. INTERPRETATION Our findings indicate that an MR readiness assessment can forecast challenges and inform development of a context-sensitive implementation bundle. Clinicians surveyed struggled with resources, technology challenges and implementation climate. A strong campaign should include clear leadership messaging, credible champions and resources to overcome technical challenges. CONCLUSIONS This manuscript provides a method to conduct a readiness assessment and highlights the importance of organisational culture in an MR campaign. The data can help assess site or network readiness for an MR change management programme.
Collapse
Affiliation(s)
- Blake Lesselroth
- Department of Medical Informatics, The University of Oklahoma-Tulsa, Tulsa, Oklahoma, USA,School of Health Information Science, University of Victoria, Victoria, British Columbia, Canada
| | - Victoria Lee Church
- US Department of Veterans Affairs, Office of Nursing Services, Washington, DC, USA
| | - Kathleen Adams
- US Department of Veterans Affairs, Office of Human Factors Engineering, Washington, DC, USA
| | - Amanda Mixon
- School of Medicine, Vanderbilt University Medical Center, Nashville, Tennessee, USA
| | - Amy Richmond-Aylor
- Office of Specialty Care Services, Veterans Health Administration, Washington, DC, USA
| | - Naomi Glasscock
- Specialty Care Services, Prescription Drug Monitoring Program, Veterans Health Administration, Washington, DC, USA
| | - Jack Wiedrick
- Biostatistics & Design Program, Oregon Health & Science University, Portland, Oregon, USA
| |
Collapse
|
7
|
Ciapponi A, Fernandez Nievas SE, Seijo M, Rodríguez MB, Vietto V, García-Perdomo HA, Virgilio S, Fajreldines AV, Tost J, Rose CJ, Garcia-Elorrio E. Reducing medication errors for adults in hospital settings. Cochrane Database Syst Rev 2021; 11:CD009985. [PMID: 34822165 PMCID: PMC8614640 DOI: 10.1002/14651858.cd009985.pub2] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
Abstract
BACKGROUND Medication errors are preventable events that may cause or lead to inappropriate medication use or patient harm while the medication is in the control of the healthcare professional or patient. Medication errors in hospitalised adults may cause harm, additional costs, and even death. OBJECTIVES To determine the effectiveness of interventions to reduce medication errors in adults in hospital settings. SEARCH METHODS We searched CENTRAL, MEDLINE, Embase, five other databases and two trials registers on 16 January 2020. SELECTION CRITERIA: We included randomised controlled trials (RCTs) and interrupted time series (ITS) studies investigating interventions aimed at reducing medication errors in hospitalised adults, compared with usual care or other interventions. Outcome measures included adverse drug events (ADEs), potential ADEs, preventable ADEs, medication errors, mortality, morbidity, length of stay, quality of life and identified/solved discrepancies. We included any hospital setting, such as inpatient care units, outpatient care settings, and accident and emergency departments. DATA COLLECTION AND ANALYSIS We followed the standard methodological procedures expected by Cochrane and the Effective Practice and Organisation of Care (EPOC) Group. Where necessary, we extracted and reanalysed ITS study data using piecewise linear regression, corrected for autocorrelation and seasonality, where possible. MAIN RESULTS: We included 65 studies: 51 RCTs and 14 ITS studies, involving 110,875 participants. About half of trials gave rise to 'some concerns' for risk of bias during the randomisation process and one-third lacked blinding of outcome assessment. Most ITS studies presented low risk of bias. Most studies came from high-income countries or high-resource settings. Medication reconciliation -the process of comparing a patient's medication orders to the medications that the patient has been taking- was the most common type of intervention studied. Electronic prescribing systems, barcoding for correct administering of medications, organisational changes, feedback on medication errors, education of professionals and improved medication dispensing systems were other interventions studied. Medication reconciliation Low-certainty evidence suggests that medication reconciliation (MR) versus no-MR may reduce medication errors (odds ratio [OR] 0.55, 95% confidence interval (CI) 0.17 to 1.74; 3 studies; n=379). Compared to no-MR, MR probably reduces ADEs (OR 0.38, 95%CI 0.18 to 0.80; 3 studies, n=1336 ; moderate-certainty evidence), but has little to no effect on length of stay (mean difference (MD) -0.30 days, 95%CI -1.93 to 1.33 days; 3 studies, n=527) and quality of life (MD -1.51, 95%CI -10.04 to 7.02; 1 study, n=131). Low-certainty evidence suggests that, compared to MR by other professionals, MR by pharmacists may reduce medication errors (OR 0.21, 95%CI 0.09 to 0.48; 8 studies, n=2648) and may increase ADEs (OR 1.34, 95%CI 0.73 to 2.44; 3 studies, n=2873). Compared to MR by other professionals, MR by pharmacists may have little to no effect on length of stay (MD -0.25, 95%CI -1.05 to 0.56; 6 studies, 3983). Moderate-certainty evidence shows that this intervention probably has little to no effect on mortality during hospitalisation (risk ratio (RR) 0.99, 95%CI 0.57 to 1.7; 2 studies, n=1000), and on readmissions at one month (RR 0.93, 95%CI 0.76 to 1.14; 2 studies, n=997); and low-certainty evidence suggests that the intervention may have little to no effect on quality of life (MD 0.00, 95%CI -14.09 to 14.09; 1 study, n=724). Low-certainty evidence suggests that database-assisted MR conducted by pharmacists, versus unassisted MR conducted by pharmacists, may reduce potential ADEs (OR 0.26, 95%CI 0.10 to 0.64; 2 studies, n=3326), and may have no effect on length of stay (MD 1.00, 95%CI -0.17 to 2.17; 1 study, n=311). Low-certainty evidence suggests that MR performed by trained pharmacist technicians, versus pharmacists, may have little to no difference on length of stay (MD -0.30, 95%CI -2.12 to 1.52; 1 study, n=183). However, the CI is compatible with important beneficial and detrimental effects. Low-certainty evidence suggests that MR before admission may increase the identification of discrepancies compared with MR after admission (MD 1.27, 95%CI 0.46 to 2.08; 1 study, n=307). However, the CI is compatible with important beneficial and detrimental effects. Moderate-certainty evidence shows that multimodal interventions probably increase discrepancy resolutions compared to usual care (RR 2.14, 95%CI 1.81 to 2.53; 1 study, n=487). Computerised physician order entry (CPOE)/clinical decision support systems (CDSS) Moderate-certainty evidence shows that CPOE/CDSS probably reduce medication errors compared to paper-based systems (OR 0.74, 95%CI 0.31 to 1.79; 2 studies, n=88). Moderate-certainty evidence shows that, compared with standard CPOE/CDSS, improved CPOE/CDSS probably reduce medication errors (OR 0.85, 95%CI 0.74 to 0.97; 2 studies, n=630). Low-certainty evidence suggests that prioritised alerts provided by CPOE/CDSS may prevent ADEs compared to non-prioritised (inconsequential) alerts (MD 1.98, 95%CI 1.65 to 2.31; 1 study; participant numbers unavailable). Barcode identification of participants/medications Low-certainty evidence suggests that barcoding may reduce medication errors (OR 0.69, 95%CI 0.59 to 0.79; 2 studies, n=50,545). Reduced working hours Low-certainty evidence suggests that reduced working hours may reduce serious medication errors (RR 0.83, 95%CI 0.63 to 1.09; 1 study, n=634). However, the CI is compatible with important beneficial and detrimental effects. Feedback on prescribing errors Low-certainty evidence suggests that feedback on prescribing errors may reduce medication errors (OR 0.47, 95%CI 0.33 to 0.67; 4 studies, n=384). Dispensing system Low-certainty evidence suggests that dispensing systems in surgical wards may reduce medication errors (OR 0.61, 95%CI 0.47 to 0.79; 2 studies, n=1775). AUTHORS' CONCLUSIONS Low- to moderate-certainty evidence suggests that, compared to usual care, medication reconciliation, CPOE/CDSS, barcoding, feedback and dispensing systems in surgical wards may reduce medication errors and ADEs. However, the results are imprecise for some outcomes related to medication reconciliation and CPOE/CDSS. The evidence for other interventions is very uncertain. Powered and methodologically sound studies are needed to address the identified evidence gaps. Innovative, synergistic strategies -including those that involve patients- should also be evaluated.
Collapse
Affiliation(s)
- Agustín Ciapponi
- Argentine Cochrane Centre, Institute for Clinical Effectiveness and Health Policy (IECS-CONICET), Buenos Aires, Argentina
| | - Simon E Fernandez Nievas
- Quality and Patient Safety, Institute for Clinical Effectiveness and Health Policy, Buenos Aires, Argentina
| | - Mariana Seijo
- Quality of Health Care and Patient Safety, Institute for Clinical Effectiveness and Health Policy (IECS), Buenos Aires, Argentina
| | - María Belén Rodríguez
- Health Technology Assessment and Health Economics Department, Institute for Clinical Effectiveness and Health Policy (IECS), Ciudad Autónoma de Buenos Aires, Argentina
| | - Valeria Vietto
- Family and Community Medicine Service, Hospital Italiano de Buenos Aires, Buenos Aires, Argentina
| | | | - Sacha Virgilio
- Instituto de Efectividad Clínica y Sanitaria (IECS), Ciudad Autónoma de Buenos Aires, Argentina
| | - Ana V Fajreldines
- Quality and Patient Safety, Austral University Hospital, Buenos Aires, Argentina
| | - Josep Tost
- Urgencias � Calidad y Seguridad de pacientes, Consorcio Sanitario de Terrassa, Barcelona, Spain
| | | | - Ezequiel Garcia-Elorrio
- Quality and Safety in Health Care, Institute for Clinical Effectiveness and Health Policy (IECS), Buenos Aires, Argentina
| |
Collapse
|
8
|
Rahurkar S, Vest JR, Finnell JT, Dixon BE. Trends in user-initiated health information exchange in the inpatient, outpatient, and emergency settings. J Am Med Inform Assoc 2021; 28:622-627. [PMID: 33067617 DOI: 10.1093/jamia/ocaa226] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2020] [Revised: 08/25/2020] [Accepted: 09/02/2020] [Indexed: 11/12/2022] Open
Abstract
Prior research on health information exchange (HIE) typically measured provider usage through surveys or they summarized the availability of HIE services in a healthcare organization. Few studies utilized user log files. Using HIE access log files, we measured HIE use in real-world clinical settings over a 7-year period (2011-2017). Use of HIE increased in inpatient, outpatient, and emergency department (ED) settings. Further, while extant literature has generally viewed the ED as the most relevant setting for HIE, the greatest change in HIE use was observed in the inpatient setting, followed by the ED setting and then the outpatient setting. Our findings suggest that in addition to federal incentives, the implementation of features that address barriers to access (eg, Single Sign On), as well as value-added services (eg, interoperability with external data sources), may be related to the growth in user-initiated HIE.
Collapse
Affiliation(s)
- Saurabh Rahurkar
- Department of Biomedical Informatics, College of Medicine, The Ohio State University, Columbus, Ohio, USA.,Center for the Advancement of Team Science, Analytics, and Systems Thinking (CATALYST), The Ohio State University, Columbus, Ohio, USA
| | - Joshua R Vest
- Department of Health Policy and Management, IU Richard M. Fairbanks School of Public Health, Indiana University-Purdue University Indianapolis, Indianapolis, Indiana, USA.,Center for Biomedical Informatics, Regenstrief Institute, Indianapolis, Indiana, USA
| | - John T Finnell
- Center for Biomedical Informatics, Regenstrief Institute, Indianapolis, Indiana, USA.,Department of Emergency Medicine, Indiana University School of Medicine, Indianapolis, Indiana, USA
| | - Brian E Dixon
- Center for Biomedical Informatics, Regenstrief Institute, Indianapolis, Indiana, USA.,Department of Epidemiology, IU Richard M. Fairbanks School of Public Health, Indiana University-Purdue University Indianapolis, Indianapolis, Indiana, USA
| |
Collapse
|
9
|
Nakayama M, Inoue R, Miyata S, Shimizu H. Health Information Exchange between Specialists and General Practitioners Benefits Rural Patients. Appl Clin Inform 2021; 12:564-572. [PMID: 34107543 DOI: 10.1055/s-0041-1731287] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022] Open
Abstract
BACKGROUND Health information exchange (HIE) may improve diagnostic accuracy, treatment efficacy, and safety by providing treating physicians with expert advice. However, most previous studies on HIE have been observational in nature. OBJECTIVES To examine whether collaboration between specialists and general practitioners (GPs) in rural areas via HIE can improve outcomes among patients at low-to-moderate risk of cardiovascular disease, kidney disease, and stroke. METHODS In this randomized controlled trial, the Miyagi Medical and Welfare Information Network was used for HIE. We evaluated the clinical data of 1,092 patients aged ≥65 years living in the rural areas of the Miyagi Prefecture and receiving care from GPs only. High-risk patients were immediately referred to specialists, whereas low-to-moderate risk patients were randomly assigned to an intervention group in which GPs were advised by specialists through HIE (n = 518, 38% male, mean age = 76 ± 7 years) or a control group in which GPs received no advice by specialists (n = 521, 39% male, mean age = 75 ± 7 years). RESULTS In the intention-to-treat analysis, all-cause mortality and cumulative incidence of serious adverse events (e.g., hospital admission or unexpected referral to specialists) did not differ between the groups. However, per-protocol analysis controlling for GP adherence with specialist recommendations revealed significantly reduced all-cause mortality (p = 0.04) and cumulative serious adverse event incidence (p = 0.04) in the intervention group compared with the control group. CONCLUSION HIE systems may improve outcomes among low-to-moderate risk patients by promoting greater collaboration between specialists and GPs, particularly in rural areas with few local specialists.
Collapse
Affiliation(s)
- Masaharu Nakayama
- Department of Medical Informatics, Tohoku University Graduate School of Medicine, Sendai, Japan.,Medical Information Technology Center, Tohoku University Hospital, Sendai, Japan
| | - Ryusuke Inoue
- Medical Information Technology Center, Tohoku University Hospital, Sendai, Japan
| | - Satoshi Miyata
- Department of Biostatistics, Teikyo University Graduate School of Public Health, Tokyo, Japan
| | - Hiroaki Shimizu
- Department of Neurosurgery, Akita University Hospital, Akita, Japan
| |
Collapse
|
10
|
Chandrasekaran R, Sankaranarayanan B, Pendergrass J. Unfulfilled promises of health information exchange: What inhibits ambulatory clinics from electronically sharing health information? Int J Med Inform 2021; 149:104418. [PMID: 33640839 DOI: 10.1016/j.ijmedinf.2021.104418] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2020] [Revised: 02/11/2021] [Accepted: 02/14/2021] [Indexed: 11/18/2022]
Abstract
PURPOSE This study seeks to understand the key inhibitors for health information exchange (HIE) by ambulatory (outpatient) clinics. We examine the key technological, organizational and environmental factors that inhibit an ambulatory clinic from electronically exchanging health information with external clinics and hospitals. METHODS We utilize survey data from 1285 ambulatory clinics in the US state of Minnesota. Using logistic regressions, we assess if the ambulatory clinic's HIE with external clinics and external hospitals are associated with fourteen inhibitors from technological, organizational and environmental contexts in which ambulatory clinics operate. RESULTS Among the technological inhibitors, we find lack of adequate technological infrastructure, difficulties in integrating external data with electronic medical record systems, and security concerns to inhibit ambulatory clinics' HIE with both clinics and hospitals. Inadequate technical support was a barrier for HIE with hospitals, whereas inadequate training of staff was an inhibitor for clinic-to-clinic HIE. Of the environmental variables, legal concerns and complexity in framing HIE agreements with partners were found to inhibit ambulatory clinics' HIE with both external clinics and hospitals. Lack of partner readiness and ability was an inhibiting factor for clinic-to-hospital HIE whereas issues in patient consent, and problems in choosing the right vendor with a good fit were inhibiting ambulatory clinics' HIE with other clinics. Among the organizational variables, lack of adequate senior leadership support and complexity of workflow changes inhibited clinic-to-clinic health data sharing, whereas unclear return on investment (ROI) for HIE was a deterrent for ambulatory clinics' HIE with hospitals. CONCLUSIONS This study throws light on electronic HIE practices and its key inhibitors in ambulatory clinics, an understudied area in digital health. This paper provides unique insights into specific inhibitors that deter clinic-to-clinic health information sharing versus those that affect and clinic-to-hospital health information exchange.
Collapse
Affiliation(s)
| | - Balaji Sankaranarayanan
- Department of IT and Supply Chain Management, University of Wisconsin at Whitewater, United States.
| | - John Pendergrass
- Department of Operations Management and Information Systems, Northern Illinois University, United States.
| |
Collapse
|
11
|
Vest JR, Unruh MA, Freedman S, Simon K. Health systems' use of enterprise health information exchange vs single electronic health record vendor environments and unplanned readmissions. J Am Med Inform Assoc 2021; 26:989-998. [PMID: 31348514 DOI: 10.1093/jamia/ocz116] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/13/2019] [Revised: 05/28/2019] [Accepted: 06/11/2019] [Indexed: 01/07/2023] Open
Abstract
OBJECTIVE Enterprise health information exchange (HIE) and a single electronic health record (EHR) vendor solution are 2 information exchange approaches to improve performance and increase the quality of care. This study sought to determine the association between adoption of enterprise HIE vs a single vendor environment and changes in unplanned readmissions. MATERIALS AND METHODS The association between unplanned 30-day readmissions among adult patients and adoption of enterprise HIE or a single vendor environment was measured in a panel of 211 system-member hospitals from 2010 through 2014 using fixed-effects regression models. Sample hospitals were members of health systems in 7 states. Enterprise HIE was defined as self-reported ability to exchange information with other members of the same health system who used different EHR vendors. A single EHR vendor environment reported exchanging information with other health system members, but all using the same EHR vendor. RESULTS Enterprise HIE adoption was more common among the study sample than EHR (75% vs 24%). However, adoption of a single EHR vendor environment was associated with a 0.8% reduction in the probability of a readmission within 30 days of discharge. The estimated impact of adopting an enterprise HIE strategy on readmissions was smaller and not statically significant. CONCLUSION Reductions in the probability of an unplanned readmission after a hospital adopts a single vendor environment suggests that HIE technologies can better support the aim of higher quality care. Additionally, health systems may benefit more from a single vendor environment approach than attempting to foster exchange across multiple EHR vendors.
Collapse
Affiliation(s)
- Joshua R Vest
- Indiana University Richard M. Fairbanks School of Public Health, Department of Health Policy & Management, Indianapolis, Indiana, USA.,Regenstrief Institute, Center for Biomedical Informatics, Indianapolis, Indiana, USA
| | - Mark Aaron Unruh
- Weill Cornell Medical College, Department of Healthcare Policy and Research, New York, New York, USA
| | - Seth Freedman
- Indiana University O'Neill School of Public & Environmental Affairs, Bloomington, Indiana, USA
| | - Kosali Simon
- Indiana University O'Neill School of Public & Environmental Affairs, Bloomington, Indiana, USA.,National Bureau of Economic Research
| |
Collapse
|
12
|
Subbe CP, Tellier G, Barach P. Impact of electronic health records on predefined safety outcomes in patients admitted to hospital: a scoping review. BMJ Open 2021; 11:e047446. [PMID: 33441368 PMCID: PMC7812113 DOI: 10.1136/bmjopen-2020-047446] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/28/2020] [Revised: 12/10/2020] [Accepted: 12/14/2020] [Indexed: 12/31/2022] Open
Abstract
OBJECTIVES Review available evidence for impact of electronic health records (EHRs) on predefined patient safety outcomes in interventional studies to identify gaps in current knowledge and design interventions for future research. DESIGN Scoping review to map existing evidence and identify gaps for future research. DATA SOURCES PubMed, the Cochrane Library, EMBASE, Trial registers. STUDY SELECTION Eligibility criteria: We conducted a scoping review of bibliographic databases and the grey literature of randomised and non-randomised trials describing interventions targeting a list of fourteen predefined areas of safety. The search was limited to manuscripts published between January 2008 and December 2018 of studies in adult inpatient settings and complemented by a targeted search for studies using a sample of EHR vendors. Studies were categorised according to methodology, intervention characteristics and safety outcome.Results from identified studies were grouped around common themes of safety measures. RESULTS The search yielded 583 articles of which 24 articles were included. The identified studies were largely from US academic medical centres, heterogeneous in study conduct, definitions, treatment protocols and study outcome reporting. Of the 24 included studies effective safety themes included medication reconciliation, decision support for prescribing medications, communication between teams, infection prevention and measures of EHR-specific harm. Heterogeneity of the interventions and study characteristics precluded a systematic meta-analysis. Most studies reported process measures and not patient-level safety outcomes: We found no or limited evidence in 13 of 14 predefined safety areas, with good evidence limited to medication safety. CONCLUSIONS Published evidence for EHR impact on safety outcomes from interventional studies is limited and does not permit firm conclusions regarding the full safety impact of EHRs or support recommendations about ideal design features. The review highlights the need for greater transparency in quality assurance of existing EHRs and further research into suitable metrics and study designs.
Collapse
Affiliation(s)
- Christian Peter Subbe
- School of Medical Sciences, Bangor University, Bangor, UK
- Medicine, Ysbyty Gwynedd, Bangor, UK
| | | | - Paul Barach
- Pediatrics, Wayne State University, Detroit, Michigan, USA
| |
Collapse
|
13
|
Yousif ME, Elamin M, Ahmed K, Saeed O. Impact of clinical pharmacist-led medication reconciliation on therapeutic process. SAUDI JOURNAL FOR HEALTH SCIENCES 2021. [DOI: 10.4103/sjhs.sjhs_6_21] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022] Open
|
14
|
Bryan R, Aronson JK, Williams AJ, Jordan S. A systematic literature review of LASA error interventions. Br J Clin Pharmacol 2020; 87:336-351. [PMID: 33197079 PMCID: PMC9328434 DOI: 10.1111/bcp.14644] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2019] [Revised: 10/09/2020] [Accepted: 10/15/2020] [Indexed: 11/29/2022] Open
Abstract
AIMS The aim of this systematic review was to explore and evaluate the efficacy of interventions to reduce the prevalence of look-alike, sound-alike (LASA) medication name errors. METHODS We conducted a systematic review of the literature, searching PubMed, EMBASE, Scopus and Web of Science up to December 2016, and re-ran the search in February 2020 for later results. We included studies of interventions to reduce LASA errors and included randomized controlled trials, controlled before-and-after studies, and interrupted time series. Details were registered in Prospero (ID: CRD42016048198). RESULTS We identified six studies that fulfilled our inclusion criteria. All were conducted in laboratories. Given the diversity in the included studies, we did not conduct a meta-analysis and instead report the findings narratively. The only intervention explored in RCTs was capitalization of selected letters ("Tall Man"), for which we found limited efficacy and no consensus. CONCLUSIONS Tall Man lettering is a marginally effective intervention to reduce LASA errors, with a number of caveats. We suggest that Tall Man gives rise to a "quasi-placebo effect", whereby a user derives more benefit from Tall Man lettering if they are aware of its purpose.
Collapse
Affiliation(s)
- Rachel Bryan
- College of Arts and Humanities, Swansea University, Swansea, UK
| | | | | | - Sue Jordan
- College of Arts and Humanities, Swansea University, Swansea, UK
| |
Collapse
|
15
|
Manias E, Kusljic S, Wu A. Interventions to reduce medication errors in adult medical and surgical settings: a systematic review. Ther Adv Drug Saf 2020; 11:2042098620968309. [PMID: 33240478 PMCID: PMC7672746 DOI: 10.1177/2042098620968309] [Citation(s) in RCA: 35] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2020] [Accepted: 09/23/2020] [Indexed: 12/02/2022] Open
Abstract
Background and Aims: Medication errors occur at any point of the medication management process, and are a major cause of death and harm globally. The objective of this review was to compare the effectiveness of different interventions in reducing prescribing, dispensing and administration medication errors in acute medical and surgical settings. Methods: The protocol for this systematic review was registered in PROSPERO (CRD42019124587). The library databases, MEDLINE, CINAHL, EMBASE, PsycINFO, Cochrane Database of Systematic Reviews and the Cochrane Central Register of Controlled Trials were searched from inception to February 2019. Studies were included if they involved testing of an intervention aimed at reducing medication errors in adult, acute medical or surgical settings. Meta-analyses were performed to examine the effectiveness of intervention types. Results: A total of 34 articles were included with 12 intervention types identified. Meta-analysis showed that prescribing errors were reduced by pharmacist-led medication reconciliation, computerised medication reconciliation, pharmacist partnership, prescriber education, medication reconciliation by trained mentors and computerised physician order entry (CPOE) as single interventions. Medication administration errors were reduced by CPOE and the use of an automated drug distribution system as single interventions. Combined interventions were also found to be effective in reducing prescribing or administration medication errors. No interventions were found to reduce dispensing error rates. Most studies were conducted at single-site hospitals, with chart review being the most common method for collecting medication error data. Clinical significance of interventions was examined in 21 studies. Since many studies were conducted in a pre–post format, future studies should include a concurrent control group. Conclusion: The systematic review identified a number of single and combined intervention types that were effective in reducing medication errors, which clinicians and policymakers could consider for implementation in medical and surgical settings. New directions for future research should examine interdisciplinary collaborative approaches comprising physicians, pharmacists and nurses. Lay summary Activities to reduce medication errors in adult medical and surgical hospital areas Introduction: Medication errors or mistakes may happen at any time in hospital, and they are a major reason for death and harm around the world. Objective: To compare the effectiveness of different activities in reducing medication errors occurring with prescribing, giving and supplying medications in adult medical and surgical settings in hospital. Methods: Six library databases were examined from the time they were developed to February 2019. Studies were included if they involved testing of an activity aimed at reducing medication errors in adult medical and surgical settings in hospital. Statistical analysis was used to look at the success of different types of activities. Results: A total of 34 studies were included with 12 activity types identified. Statistical analysis showed that prescribing errors were reduced by pharmacists matching medications, computers matching medications, partnerships with pharmacists, prescriber education, medication matching by trained physicians, and computerised physician order entry (CPOE). Medication-giving errors were reduced by the use of CPOE and an automated medication distribution system. The combination of different activity types were also shown to be successful in reducing prescribing or medication-giving errors. No activities were found to be successful in reducing errors relating to supplying medications. Most studies were conducted at one hospital with reviewing patient charts being the most common way for collecting information about medication errors. In 21 out of 34 articles, researchers examined the effect of activity types on patient harm caused by medication errors. Many studies did not involve the use of a control group that does not receive the activity. Conclusion: A number of activity types were shown to be successful in reducing prescribing and medication-giving errors. New directions for future research should examine activities comprising health professionals working together.
Collapse
Affiliation(s)
- Elizabeth Manias
- School of Nursing and Midwifery, Centre for Quality and Patient Safety Research, Institute for Health Transformation, Deakin University, 221 Burwood Highway, Burwood, Victoria 3125, Australia
| | - Snezana Kusljic
- Department of Nursing, The University of Melbourne, Melbourne, Victoria, Australia
| | - Angela Wu
- Melbourne Medical School, The University of Melbourne, Melbourne, Victoria, Australia
| |
Collapse
|
16
|
Abstract
The US healthcare system is moving into a new era of value-based care, which focuses on delivering safer and higher quality care while reducing costs. Health information exchange (HIE) has been a vital component in this process; however, there has been a lack of awareness and use of HIE among nurse leaders, clinicians, and researchers. The purpose of this article is to provide nurses and administrators with a brief overview of HIE and its impact on care delivery, as well as practical applications using specific case examples.
Collapse
|
17
|
Leon N, Balakrishna Y, Hohlfeld A, Odendaal WA, Schmidt BM, Zweigenthal V, Anstey Watkins J, Daniels K. Routine Health Information System (RHIS) improvements for strengthened health system management. Cochrane Database Syst Rev 2020; 8:CD012012. [PMID: 32803893 PMCID: PMC8094584 DOI: 10.1002/14651858.cd012012.pub2] [Citation(s) in RCA: 21] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/09/2023]
Abstract
BACKGROUND A well-functioning routine health information system (RHIS) can provide the information needed for health system management, for governance, accountability, planning, policy making, surveillance and quality improvement, but poor information support has been identified as a major obstacle for improving health system management. OBJECTIVES To assess the effects of interventions to improve routine health information systems in terms of RHIS performance, and also, in terms of improved health system management performance, and improved patient and population health outcomes. SEARCH METHODS We searched the Cochrane Central Register of Controlled Trials (CENTRAL) in the Cochrane Library, MEDLINE Ovid and Embase Ovid in May 2019. We searched Global Health, Ovid and PsycInfo in April 2016. In January 2020 we searched for grey literature in the Grey Literature Report and in OpenGrey, and for ongoing trials using the International Clinical Trials Registry Platform (ICTRP) and ClinicalTrials.gov. In October 2019 we also did a cited reference search using Web of Science, and a 'similar articles' search in PubMed. SELECTION CRITERIA Randomised and non-randomised trials, controlled before-after studies and time-series studies comparing routine health information system interventions, with controls, in primary, hospital or community health care settings. Participants included clinical staff and management, district management and community health workers using routine information systems. DATA COLLECTION AND ANALYSIS Two authors independently reviewed records to identify studies for inclusion, extracted data from the included studies and assessed the risk of bias. Interventions and outcomes were too varied across studies to allow for pooled risk analysis. We present a 'Summary of findings' table for each intervention comparisons broadly categorised into Technical and Organisational (or a combination), and report outcomes on data quality and service quality. We used the GRADE approach to assess the certainty of the evidence. MAIN RESULTS We included six studies: four cluster randomised trials and two controlled before-after studies, from Africa and South America. Three studies evaluated technical interventions, one study evaluated an organisational intervention, and two studies evaluated a combination of technical and organisational interventions. Four studies reported on data quality and six studies reported on service quality. In terms of data quality, a web-based electronic TB laboratory information system probably reduces the length of time to reporting of TB test results, and probably reduces the overall rate of recording errors of TB test results, compared to a paper-based system (moderate certainty evidence). We are uncertain about the effect of the electronic laboratory information system on the recording rate of serious (misidentification) errors for TB test results compared to a paper-based system (very low certainty evidence). Misidentification errors are inaccuracies in transferring test results between an electronic register and patients' clinical charts. We are also uncertain about the effect of the intervention on service quality (timeliness of starting or changing a patient's TB treatment) (very low certainty evidence). A hand-held electronic device probably improves the length of time to report TB test results, and probably reduces the total frequency of recording errors in TB test results between the laboratory notebook and the electronic information record system, compared to a paper-based system (moderate-certainty evidence). We are, however, uncertain about the effect of the intervention on the frequency of serious (misidentification) errors in recording between the laboratory notebook and the electronic information record, compared to a paper-based system (very low certainty evidence). We are uncertain about the effect of a hospital electronic health information system on service quality (length of time outpatients spend at hospital, length of hospital stay, and hospital revenue collection), compared to a paper-based system (very low certainty evidence). High-intensity brief text messaging (SMS) may make little or no difference to data quality (in terms of completeness of documentation of pregnancy outcomes), compared to low-intensity brief text messaging (low-certainty evidence). We are uncertain about the effect of electronic drug stock notification (with either data management support or product transfer support) on service quality (in terms of transporting stock and stock levels), compared to paper-based stock notification (very low certainty evidence). We are uncertain about the effect of health information strengthening (where it is part of comprehensive service quality improvement intervention) on service quality (health worker motivation, receipt of training by health workers, health information index scores, quality of clinical observation of children and adults) (very low certainty evidence). AUTHORS' CONCLUSIONS The review indicates mixed effects of mainly technical interventions to improve data quality, with gaps in evidence on interventions aimed at enhancing data-informed health system management. There is a gap in interventions studying information support beyond clinical management, such as for human resources, finances, drug supply and governance. We need to have a better understanding of the causal mechanisms by which information support may affect change in management decision-making, to inform robust intervention design and evaluation methods.
Collapse
Affiliation(s)
- Natalie Leon
- Health Systems Research Unit, South African Medical Research Council, Cape Town, South Africa
- School of Public Health, Department of Epidemiology, Brown University, Providence, Rhode Island, USA
| | - Yusentha Balakrishna
- Biostatistics Unit, South African Medical Research Council, Durban, South Africa
| | - Ameer Hohlfeld
- Cochrane South Africa, South African Medical Research Council, Cape Town, South Africa
| | - Willem A Odendaal
- Health Systems Research Unit, South African Medical Research Council, Cape Town, South Africa
- Department of Psychiatry, Stellenbosch University, Cape Town, South Africa
| | - Bey-Marrié Schmidt
- Cochrane South Africa, South African Medical Research Council, Cape Town, South Africa
| | - Virginia Zweigenthal
- Health Impact Assessment Directorate, Department of Health: Western Cape Province, Cape Town, South Africa
- School of Public Health and Family Medicine, University of Cape Town, Cape Town, South Africa
| | | | - Karen Daniels
- Health Systems Research Unit, South African Medical Research Council, Cape Town, South Africa
- School of Public Health and Family Medicine, University of Cape Town, Cape Town, South Africa
| |
Collapse
|
18
|
Vest JR, Hilts KE, Ancker JS, Unruh MA, Jung HY. Usage of query-based health information exchange after event notifications. JAMIA Open 2020; 2:291-295. [PMID: 31984363 PMCID: PMC6951916 DOI: 10.1093/jamiaopen/ooz028] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2019] [Revised: 06/17/2019] [Accepted: 07/03/2019] [Indexed: 11/13/2022] Open
Abstract
Objectives This study sought to quantify the association between event notifications and subsequent query-based health information exchange (HIE) use among end users of three different community health information organizations. Materials and Methods Using system-log data merged with user characteristics, regression-adjusted estimates were used to describe the association between event notifications and subsequent query-based HIE usage. Results Approximately 5% of event notifications were associated with query-based HIE usage within 30 days. In adjusted models, odds of query-based HIE usage following an event notification were higher for older patients and for alerts triggered by a discharge event. Query-based HIE usage was more common among specialty clinics and Federally Qualified Health Centers than primary care organizations. Discussion and Conclusion In this novel combination of data, 1 in 20 event notifications resulted in subsequent query-based HIE usage. Results from this study suggest that event notifications and query-based HIE can be applied together to address clinical and population health use cases.
Collapse
Affiliation(s)
- Joshua R Vest
- Indiana University Richard M. Fairbanks School of Public Health, Department of Health Policy & Management, Indiana, USA.,Regenstrief Institute Inc., Center for Biomedical Informatics, Indianapolis, Indiana, USA
| | - Katy Ellis Hilts
- Indiana University Richard M. Fairbanks School of Public Health, Department of Health Policy & Management, Indiana, USA
| | - Jessica S Ancker
- Weill Cornell Medical College, Department of Healthcare Policy & Research, New York City, New York, USA
| | - Mark Aaron Unruh
- Weill Cornell Medical College, Department of Healthcare Policy & Research, New York City, New York, USA
| | - Hye-Young Jung
- Weill Cornell Medical College, Department of Healthcare Policy & Research, New York City, New York, USA
| |
Collapse
|
19
|
Pendergrass JC, Chandrasekaran R. Key Factors Affecting Ambulatory Care Providers' Electronic Exchange of Health Information With Affiliated and Unaffiliated Partners: Web-Based Survey Study. JMIR Med Inform 2019; 7:e12000. [PMID: 31697241 PMCID: PMC6913753 DOI: 10.2196/12000] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/21/2018] [Revised: 12/12/2018] [Accepted: 12/31/2018] [Indexed: 11/13/2022] Open
Abstract
Background Despite the potential benefits of electronic health information exchange (HIE) to improve the quality and efficiency of care, HIE use by ambulatory providers remains low. Ambulatory providers can greatly improve the quality of care by electronically exchanging health information with affiliated providers within their health care network as well as with unaffiliated, external providers. Objective This study aimed to examine the extent of electronic HIE use by ambulatory clinics with affiliated providers within their health system and with external providers, as well as the key technological, organizational, and environmental factors affecting the extent of HIE use within and outside the health system. Methods A Web-based survey of 320 ambulatory care providers was conducted in the state of Illinois. The study examined the extent of HIE usage by ambulatory providers with hospitals, clinics, and other facilities within and outside their health care system–encompassing seven kinds of health care data. Ten factors pertaining to technology (IT [information technology] Compatibility, External IT Support, Security & Privacy Safeguards), organization (Workflow Adaptability, Senior Leadership Support, Clinicians Health-IT Knowledge, Staff Health-IT Knowledge), and environment (Government Efforts & Incentives, Partner Readiness, Competitors and Peers) were assessed. A series of multivariate regressions were used to examine predictor effects. Results The 6 regressions produced adjusted R-squared values ranging from 0.44 to 0.63. We found that ambulatory clinics exchanged more health information electronically with affiliated entities within their health system as compared with those outside their health system. Partner readiness emerged as the most significant predictor of HIE usage with all entities. Governmental initiatives for HIE, clinicians’ prior familiarity and knowledge of health IT systems, implementation of appropriate security, and privacy safeguards were also significant predictors. External information technology support and workflow adaptability emerged as key predictors for HIE use outside a clinic’s health system. Differences based on clinic size, ownership, and specialty were also observed. Conclusions This study provides exploratory insights into HIE use by ambulatory providers within and outside their health care system and differential predictors that impact HIE use. HIE use can be further improved by encouraging large-scale interoperability efforts, improving external IT support, and redesigning adaptable workflows.
Collapse
Affiliation(s)
- John C Pendergrass
- Operations Management and Information Systems, Northern Illinois University, DeKalb, IL, United States
| | - Ranganathan Chandrasekaran
- Center for Health Information Management and Systems, University of Illinois at Chicago, Chicago, IL, United States
| |
Collapse
|
20
|
Vest JR, Unruh MA, Shapiro JS, Casalino LP. The associations between query-based and directed health information exchange with potentially avoidable use of health care services. Health Serv Res 2019; 54:981-993. [PMID: 31112303 PMCID: PMC6736925 DOI: 10.1111/1475-6773.13169] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/01/2022] Open
Abstract
OBJECTIVE To quantify the impact of two approaches (directed and query-based) to health information exchange (HIE) on potentially avoidable use of health care services. DATA SOURCES/STUDY SETTING Data on ambulatory care providers' adoption of HIE were merged with Medicare fee-for-service claims from 2008 to 2014. Providers were from 13 counties in New York served by the Rochester Regional Health Information Organization (RHIO). STUDY DESIGN Linear regression models with provider and year fixed effects were used to estimate changes in the probability of utilization outcomes for Medicare beneficiaries attributed to providers adopting directed and/or query-based HIE compared with beneficiaries attributed to providers who had not adopted HIE. DATA COLLECTION Providers' HIE adoption status was determined through Rochester RHIO registration records. RHIO and claims data were linked via National Provider Identifiers. PRINCIPAL FINDINGS Query-based HIE adoption was associated with a 0.2 percentage point reduction in the probability of an ambulatory care sensitive hospitalization and a 1.1 percentage point decrease in the likelihood of an unplanned readmission. Directed HIE adoption was not associated with any outcome. CONCLUSIONS The Centers for Medicare & Medicaid Services' (CMS) EHR certification criteria includes requirements for directed HIE, but not query-based HIE. Pending further research, certification criteria should place equal weight on facilitating query-based and directed exchange.
Collapse
Affiliation(s)
- Joshua R. Vest
- Center for Health PolicyIndianapolisIndiana
- Health Policy and ManagementIndiana University Richard M Fairbanks School of Public Health at IUPUIIndianapolisIndiana
- Regenstrief Institute, Inc.IndianapolisIndiana
| | - Mark Aaron Unruh
- Department of Healthcare Policy and ResearchWeill Cornell Medical CollegeNew YorkNew York
| | - Jason S. Shapiro
- Department of Emergency MedicineIcahn School of Medicine at Mout SinaiNew YorkNew York
| | - Lawrence P. Casalino
- Division of Health Policy and EconomicsThe Livingston Farrand Professor of Public HealthNew YorkNew York
- Weill Cornell Graduate School of Medical SciencesWeill Cornell Medical CollegeNew YorkNew York
| |
Collapse
|
21
|
Menachemi N, Rahurkar S, Harle CA, Vest JR. The benefits of health information exchange: an updated systematic review. J Am Med Inform Assoc 2018; 25:1259-1265. [PMID: 29718258 PMCID: PMC7646861 DOI: 10.1093/jamia/ocy035] [Citation(s) in RCA: 107] [Impact Index Per Article: 15.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2018] [Revised: 03/08/2018] [Accepted: 03/18/2018] [Indexed: 11/14/2022] Open
Abstract
Objective Widespread health information exchange (HIE) is a national objective motivated by the promise of improved care and a reduction in costs. Previous reviews have found little rigorous evidence that HIE positively affects these anticipated benefits. However, early studies of HIE were methodologically limited. The purpose of the current study is to review the recent literature on the impact of HIE. Methods We used the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines to conduct our systematic review. PubMed and Scopus databases were used to identify empirical articles that evaluated HIE in the context of a health care outcome. Results Our search strategy identified 24 articles that included 63 individual analyses. The majority of the studies were from the United States representing 9 states; and about 40% of the included analyses occurred in a handful of HIEs from the state of New York. Seven of the 24 studies used designs suitable for causal inference and all reported some beneficial effect from HIE; none reported adverse effects. Conclusions The current systematic review found that studies with more rigorous designs all reported benefits from HIE. Such benefits include fewer duplicated procedures, reduced imaging, lower costs, and improved patient safety. We also found that studies evaluating community HIEs were more likely to find benefits than studies that evaluated enterprise HIEs or vendor-mediated exchanges. Overall, these finding bode well for the HIEs ability to deliver on anticipated improvements in care delivery and reduction in costs.
Collapse
Affiliation(s)
- Nir Menachemi
- Department of Health Policy and Management, Indiana University (IU) Richard M. Fairbanks School of Public Health, Indianapolis, IN, USA
- Center for Biomedical Informatics, Regenstrief Institute, Indianapolis, IN, USA
| | - Saurabh Rahurkar
- Center for Biomedical Informatics, Regenstrief Institute, Indianapolis, IN, USA
| | - Christopher A Harle
- Department of Health Policy and Management, Indiana University (IU) Richard M. Fairbanks School of Public Health, Indianapolis, IN, USA
- Center for Biomedical Informatics, Regenstrief Institute, Indianapolis, IN, USA
| | - Joshua R Vest
- Department of Health Policy and Management, Indiana University (IU) Richard M. Fairbanks School of Public Health, Indianapolis, IN, USA
- Center for Biomedical Informatics, Regenstrief Institute, Indianapolis, IN, USA
| |
Collapse
|
22
|
Abstract
OBJECTIVE To summarize the recent literature and research and present a selection of the best papers published in 2017 in the field of Health Information Management (HIM) and Health Informatics. METHODS A systematic review of the literature was performed by the two HIM section editors of the International Medical Informatics Association (IMIA) Yearbook with the help of a medical librarian. We searched bibliographic databases for HIM-related papers using both MeSH descriptors and keywords in titles and abstracts. A shortlist of 15 candidate best papers was first selected by section editors before being peer-reviewed by independent external reviewers. RESULTS Health Information Exchange was a major theme within candidate best papers. The four papers ultimately selected as 'Best Papers' represent themes that include health information exchange, governance and policy issues, results of health information exchange, and methods of integrating information from multiple sources. Other articles within the candidate best papers include these themes as well as those focusing on authentication and de-identification and usability of information systems. CONCLUSIONS The papers discussed in the HIM section of IMIA Yearbook reflect the overall theme of the 2018 edition of the Yearbook, i.e., the tension between privacy and access to information. While most of the papers focused on health information exchange, which reflects the "access" side of the equation, most of the others addressed privacy issues. This synopsis discusses these key issues at the intersection of HIM and informatics.
Collapse
Affiliation(s)
| | - Eta S. Berner
- Graduate Programs in Health Informatics, Department of Health Services Administration, University of Alabama at Birmingham, Birmingham, AL, USA
| | | |
Collapse
|
23
|
Motulsky A, Weir DL, Couture I, Sicotte C, Gagnon MP, Buckeridge DL, Tamblyn R. Usage and accuracy of medication data from nationwide health information exchange in Quebec, Canada. J Am Med Inform Assoc 2018; 25:722-729. [PMID: 29590350 DOI: 10.1093/jamia/ocy015] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2017] [Accepted: 02/02/2018] [Indexed: 11/14/2022] Open
Abstract
Objective (1) To describe the usage of medication data from the Health Information Exchange (HIE) at the health care system level in the province of Quebec; (2) To assess the accuracy of the medication list obtained from the HIE. Methods A descriptive study was conducted utilizing usage data obtained from the Ministry of Health at the individual provider level from January 1 to December 31, 2015. Usage patterns by role, type of site, and tool used to access the HIE were investigated. The list of medications of 111 high risk patients arriving at the emergency department of an academic healthcare center was obtained from the HIE and compared with the list obtained through the medication reconciliation process. Results There were 31 022 distinct users accessing the HIE 11 085 653 times in 2015. The vast majority of pharmacists and general practitioners accessed it, compared to a minority of specialists and nurses. The top 1% of users was responsible of 19% of access. Also, 63% of the access was made using the Viewer application, while using a certified electronic medical record application seemed to facilitate usage. Among 111 patients, 71 (64%) had at least one discrepancy between the medication list obtained from the HIE and the reference list. Conclusions Early adopters were mostly in primary care settings, and were accessing it more frequently when using a certified electronic medical record. Further work is needed to investigate how to resolve accuracy issues with the medication list and how certain tools provide different features.
Collapse
Affiliation(s)
- Aude Motulsky
- Research Center, Centre hospitalier de l'Université de Montréal, Montreal, Canada.,Department of Management, Evaluation & Health Policy, School of Public Health, Université de Montréal, Montreal, Canada
| | - Daniala L Weir
- Department of Epidemiology, Biostatistics and Occupational Health & Department of Medicine, McGill University, Montreal, Canada
| | | | - Claude Sicotte
- Department of Management, Evaluation & Health Policy, School of Public Health, Université de Montréal, Montreal, Canada.,Healthcare organization management host team (EA7348 MOS - Management des organisations de santé - Healthcare Organization Management), EHESP - École des hautes études en santé publique, France
| | | | - David L Buckeridge
- Department of Epidemiology, Biostatistics and Occupational Health & Department of Medicine, McGill University, Montreal, Canada
| | - Robyn Tamblyn
- Department of Epidemiology, Biostatistics and Occupational Health & Department of Medicine, McGill University, Montreal, Canada
| |
Collapse
|