How well does chart abstraction measure quality? A prospective comparison of standardized patients with the medical record

The relationship between group A streptococcus test positivity and clinical findings in tonsillopharyngitis in children: systematic review and meta-analysis

PURPOSE

This study aimed to present an evidence-based conclusion through a systematic meta-analysis to distinguish clinical signs and symptoms associated with the presence of group A beta-hemolytic streptococcus, as confirmed by throat culture or rapid test, from those in cases without culture confirmation.

METHODS

The study protocol has been published in PROSPERO (CRD42023450854). Studies published between January 1, 2013 and August 15, 2023 were scanned in seven databases. The methodological quality of the articles was assessed using The Joanna Briggs Institution (JBI) Cross-Sectional Studies and Cohort Studies checklist. Effect size calculations were made using fixed effects and random effects models.

RESULTS

A total of 22 articles were included in the systematic review, with 14 included in the meta-analysis. The prevalence of streptococcal pharyngitis in these studies ranged from 7.3 to 44.1%. According to the meta-analysis results, a significant association was observed between GAS test positivity and the presence of tonsillar exudate, palatal petechiae, tonsillar hypertrophy, dysphagia, fever, and cervical lymphadenopathy (p < 0.05). No significant relationship was found between GAS test positivity and symptoms such as headache, sore throat, cough, absence of cough, hoarseness, scarlatiniform rash, tonsillar erythema, vomiting, rhinorrhea, and abdominal pain (p > 0.05).

CONCLUSION

The findings of the meta-analysis suggest that, in addition to the Centor criteria, palatal petechiae, dysphagia, and tonsillar hypertrophy are noteworthy indicators of GAS infection. Contrary to previous studies, our meta-analysis indicates that symptoms such as headache, sore throat, cough, absence of cough, hoarseness, scarlatiniform rash, tonsillar erythema, vomiting, rhinorrhea, and abdominal pain may not be associated with streptococcal infection. Further research is needed to elucidate these findings.

Computable phenotype for diagnostic error: developing the data schema for application of symptom-disease pair analysis of diagnostic error (SPADE)

OBJECTIVES

Diagnostic errors are the leading cause of preventable harm in clinical practice. Implementable tools to quantify and target this problem are needed. To address this gap, we aimed to generalize the Symptom-Disease Pair Analysis of Diagnostic Error (SPADE) framework by developing its computable phenotype and then demonstrated how that schema could be applied in multiple clinical contexts.

METHODS

We created an information model for the SPADE processes, then mapped data fields from electronic health records (EHR) and claims data in use to that model to create the SPADE information model (intention) and the SPADE computable phenotype (extension). Later we validated the computable phenotype and tested it in four case studies in three different health systems to demonstrate its utility.

RESULTS

We mapped and tested the SPADE computable phenotype in three different sites using four different case studies. We showed that data fields to compute an SPADE base measure are fully available in the EHR Data Warehouse for extraction and can operationalize the SPADE framework from provider and/or insurer perspective, and they could be implemented on numerous health systems for future work in monitor misdiagnosis-related harms.

CONCLUSIONS

Data for the SPADE base measure is readily available in EHR and administrative claims. The method of data extraction is potentially universally applicable, and the data extracted is conveniently available within a network system. Further study is needed to validate the computable phenotype across different settings with different data infrastructures.

Diagnostic journey for individuals with fibrous dysplasia / McCune albright syndrome (FD/MAS)

BACKGROUND

Reducing delayed diagnosis is a significant healthcare priority for individuals with rare diseases. Fibrous Dysplasia/ McCune Albright Syndrome (FD/MAS) is a rare bone disease caused by somatic activation mutations of NASA. FD/MAS has a broad clinical phenotype reflecting variable involvement of bone, endocrine and other tissues, distribution and severity. The variable phenotype is likely to prolong the diagnostic journey for patients further.

AIM

To describe the time from symptom onset to final diagnosis in individuals living with FDMAS.

METHODS

We used the UK-based RUDY research database ( www.rudystudy.org ), where patients self-report their diagnosis of FD/MAS. Participants are invited to complete the diagnostic journey based on the EPIRARE criteria.

RESULTS

51 individuals diagnosed with FD/MAS were included in this analysis. Among them, 70% were female, and the median age was 51.0 years (IQR 34.5-57.5]. 12 (35%) individuals reported McCune Albright Syndrome, 11 (21.6%) craniofacial and 11(21.6%) for each of poly- and mono-ostotic FD and 6 (11.8%) did not know their type of FD/MAS. Pain was the commonest first symptom (58.8%), and 47.1% received another diagnosis before the diagnosis of FD/MAS. The median time to final diagnosis from the first symptom was two years with a wide IQR (1,18) and range (0-59 years). Only 12 (23.5%) of individuals were diagnosed within 12 months of their first symptoms. The type of FD/MAS was not associated with the reported time to diagnosis. Significant independent predictors of longer time to final diagnosis included older current age, younger age at first symptom and diagnosis after 2010.

CONCLUSION

Individuals with FDMAS have a variable time to diagnosis that can span decades. This study highlights the need for further research on how to improve diagnostic pathways within Orthopaedic and Ear, Nose and Throat (ENT)/Maxillofacial services. Our data provides a baseline to assess the impact of novel NHS diagnostic networks on reducing the diagnostic odyssey.

Comparison of medical documentation between pharmacist-led anticoagulation clinics and physician-led anticoagulation clinics: A retrospective study

Background and objectives

High-quality documentation is critical in medical settings for providing safe patient care. This study was done with the objective of assessing the standard of medical records in anticoagulation clinics and investigating the distinctions between notes written by pharmacists and physicians.

Methods

A retrospective cross-sectional analysis of data from electronic health records (EHRs) was performed on patients who received anticoagulation and were observed at anticoagulation clinics from October to December 2020. Patients were monitored in two anticoagulation clinics, one administered by pharmacists and the other by physicians. The quality of the documentation was assessed using a score, and the note was assigned one of five categories according to its score: very good, good, average, poor, and very poor. The data was analyzed using Stata/SE 13.1. P value<0.05 was considered significant in all analytical tests.

Results

A total of 331 patients were included. While 160 patients (48.3%) were followed by the physician-led clinic, 171 (51.6%) were by the pharmacist-led clinic. The average age of the patients was 54 ± 15. 60.73% of them were female, and 90.3% of them were Saudi nationals. Warfarin was the most widely used anticoagulant (70%), followed by rivaroxaban (15.7%). Compared to physicians, pharmacists demonstrated very strong documentation (54% vs. 18%). The examination of the variables considered in the study revealed that physicians had significantly less drug-drug interaction documentation (17 vs. 71 times) or drug-food interaction documentation (23 vs. 71 times) than pharmacists. In terms of follow-up frequency, pharmacists were found to adhere to the clinic protocol (150 times) more frequently than physicians (104 times). However, there was no significant difference in therapeutic plan documentation between the two groups. (p = 0.416).

Conclusion

Pharmacists were more comprehensive in their documentation than physicians in anticoagulation clinics. Unified clinic documentation can ensure consistent documentation within EHRs across all disciplines.

Misdiagnosis-related harm quantification through mixture models and harm measures

Investigating and monitoring misdiagnosis-related harm is crucial for improving health care. However, this effort has traditionally focused on the chart review process, which is labor intensive, potentially unstable, and does not scale well. To monitor medical institutes' diagnostic performance and identify areas for improvement in a timely fashion, researchers proposed to leverage the relationship between symptoms and diseases based on electronic health records or claim data. Specifically, the elevated disease risk following a false-negative diagnosis can be used to signal potential harm. However, off-the-shelf statistical methods do not fully accommodate the data structure of a well-hypothesized risk pattern and thus fail to address the unique challenges adequately. To fill these gaps, we proposed a mixture regression model and its associated goodness-of-fit testing. We further proposed harm measures and profiling analysis procedures to quantify, evaluate, and compare misdiagnosis-related harm across institutes with potentially different patient population compositions. We studied the performance of the proposed methods through simulation studies. We then illustrated the methods through data analyses on stroke occurrence data from the Taiwan Longitudinal Health Insurance Database. From the analyses, we quantitatively evaluated risk factors for being harmed due to misdiagnosis, which unveiled some insights for health care quality research. We also compared general and special care hospitals in Taiwan and observed better diagnostic performance in special care hospitals using various new evaluation measures.

The Impact of Number of Medications on Falls in Aging Persons with Human Immunodeficiency Virus

We aimed to evaluate the impact of polypharmacy on the risk of having a fall in older persons with HIV (PWH). PWH at least 50 years of age who were seen at our institution from September 2012 to August 2017 were included. Unique participants were selected for either a case or control cohort depending on the presence of a documented fall during the study time period. Demographics, HIV-related measures, VACS score, number of medications, as well as the impact of taking benzodiazepines and opioids were compared between the two cohorts. Fall was documented for 637 patients compared to 1534 without a fall during the same time period. Multivariable logistic regression revealed that the total number of medications, having a higher VACS score, taking an opioid, being female sex assigned at birth, and having a lower nadir CD4 count were significantly associated with higher odds of having a fall. In this cohort of older PWH, taking a higher number of non-ARV medications significantly increased the odds of having a fall. In addition, taking an opioid resulted in the highest odds of having a fall. These results suggest the importance of deprescribing and addressing opioid use in reducing the risk of having a fall in older PWH.

Quality of integrated female oncofertility care is suboptimal: A patient-reported measurement

BACKGROUND

Clinical practice guidelines recommend to inform female cancer patients about their infertility risks due to cancer treatment. Unfortunately, it seems that guideline adherence is suboptimal. In order to improve quality of integrated female oncofertility care, a systematic assessment of current practice is necessary.

METHODS

A multicenter cross-sectional survey study in which a set of systematically developed quality indicators was processed, was conducted among female cancer patients (diagnosed in 2016/2017). These indicators represented all domains in oncofertility care; risk communication, referral, counseling, and decision-making. Indicator scores were calculated, and determinants were assessed by multilevel multivariate analyses.

RESULTS

One hundred twenty-one out of 344 female cancer patients participated. Eight out of 11 indicators scored below 90% adherence. Of all patients, 72.7% was informed about their infertility, 51.2% was offered a referral, with 18.8% all aspects were discussed in counseling, and 35.5% received written and/or digital information. Patient's age, strength of wish to conceive, time before cancer treatment, and type of healthcare provider significantly influenced the scores of three indicators.

CONCLUSIONS

Current quality of female oncofertility care is far from optimal. Therefore, improvement is needed. To achieve this, improvement strategies that are tailored to the identified determinants and to guideline-specific barriers should be developed.

Leveraging Comprehensive Cancer Registry Data to Enable a Broad Range of Research, Audit and Patient Support Activities

Simple Summary

Registry data has the potential to support a broad range of research, audit and education initiatives. Here, we describe the experience and learnings of a series of large multi-institutional cancer registries that leverage real-world clinical data for a range of purposes, that informs the conduct and output of each registry in a virtuous cycle. Lessons learnt include the need for careful and continuous curation of information being collected, regular database updates, and the need for a continued focus on data quality. As a standalone resource, each registry has supported numerous projects, but linkage with external datasets with patients in common has enhanced the research potential. Multiple projects have linked registry data with matched tissue specimens to support the discovery and valiation of prognostic and predictive markers in the tumour and blood specimens. Registry-based biomarker trials have been successfully supported, generating novel and practice-changing data. Registry-based clinical trials, particularly studies exploring the best use of drug options are now complementing the research conducted in traditional clinical trials. More recent projects supported by the registries include health economic studies, personalised patient education material, and increased consumer engagement, including consumer entered data.

Abstract

Traditional cancer registries have often been siloed efforts, established by single groups with limited objectives. There is the potential for registry data to support a broad range of research, audit and education initiatives. Here, we describe the establishment of a series of comprehensive cancer registries across the spectrum of common solid cancers. The experience and learnings of each registry team as they develop, implement and then use collected data for a range of purposes, that informs the conduct and output of other registries in a virtuous cycle. Each registry is multi-site, multi-disciplinary and aims to collect data of maximal interest and value to a broad range of enquiry, which would be accessible to any researcher with a high-quality proposal. Lessons learnt include the need for careful and continuous curation of data fields, with regular database updates, and the need for a continued focus on data quality. The registry data as a standalone resource has supported numerous projects, but linkage with external datasets with patients in common has enhanced the audit and research potential. Multiple projects have linked registry data with matched tissue specimens to support prognostic and predictive biomarker studies, both validation and discovery. Registry-based biomarker trials have been successfully supported, generating novel and practice-changing data. Registry-based clinical trials, particularly randomised studies exploring the optimal use of available therapy options are now complementing the research conducted in traditional clinical trials. More recent projects supported by the registries include health economic studies, personalised patient education material, and increased consumer engagement, including consumer entered data.

The Association Between Patient-Centered Communication and Primary Care Quality in Urban China: Evidence From a Standardized Patient Study

Background

Effective patient-physician communication has been considered a central clinical function and core value of health system. Currently, there are no studies directly evaluating the association between patient-centered communication (PCC) and primary care quality in urban China. This study aims to investigate the association between PCC and primary care quality.

Methods

The standardized patients were used to measure PCC and the quality of health care. We recruited 12 standardized patients from local communities presenting fixed cases (unstable angina and asthma), including 492 interactions between physicians and standardized patients across 63 CHCs in Xi'an, China. PCC was scored on three dismissions: (1) exploring disease and illness experience, (2) understanding the whole person, and (3) finding common ground. We measured the quality of the primary care by (1) accuracy of diagnosis, (2) consultation time, (3) appropriateness of treatment, (4) unnecessary exams; (5) unnecessary drugs, and (6) medical expenditure. Ordinary least-squares regression models with fixed effects were used for the continuous variables and logistic regression models with fixed effects were used for the categorical variables.

Results

The average score of PCC1, PCC2, and PCC3 was 12.24 ± 4.04 (out of 64), 0.79 ± 0.64 (out of 3), and 10.19 ± 3.60 (out of 17), respectively. The total score of PCC was 23.22 ± 6.24 (out of 84). We found 44.11% of the visits having a correct diagnosis, and 24.19% of the visits having correct treatment. The average number of unnecessary exams and drugs was 0.91 ± 1.05, and 0.45 ± 0.82, respectively. The average total cost was 35.00 ± 41.26 CNY. After controlling for the potential confounding factors and fixed effects, the PCC increased the correct diagnosis by 10 percentage points (P < 0.01), the correct treatment by 7 percentage points (P < 0.01), the consultation time by 0.17 min (P < 0.01), the number of unnecessary drugs by 0.03 items (P < 0.01), and the medical expenditure by 1.46 CNY (P < 0.01).

Conclusions

This study revealed pretty poor communication between primary care providers and patients. The PCC model has not been achieved, which could be one source of the intensified physician-patient relationship. Our findings showed the PCC model in the primary care settings has positive associations with the quality of the primary care. Interactions with a higher score of PCC were more likely to have a correct diagnosis and correct treatment, more consultation time, more unnecessary drugs, and higher medical expenditure. To improve PCC, the clinical capacity and communication skills of primary care providers need to be strengthened. Also, strategies on reforming the pay structure to better reflect the value of physicians and providing a stronger motivation for performance improvement are urgently needed.

Statistical insights for crude-rate-based operational measures of misdiagnosis-related harms

In longitudinal event data, a crude rate is a simple quantification of the event rate, defined as the number of events during an evaluation window, divided by the at-risk population size at the beginning or mid-time point of that window. The crude rate recently received revitalizing interest from medical researchers who aimed to improve measurement of misdiagnosis-related harms using administrative or billing data by tracking unexpected adverse events following a "benign" diagnosis. The simplicity of these measures makes them attractive for implementation and routine operational monitoring at hospital or health system level. However, relevant statistical inference procedures have not been systematically summarized. Moreover, it is unclear to what extent the temporal changes of the at-risk population size would bias analyses and affect important conclusions concerning misdiagnosis-related harms. In this article, we present statistical inference tools for using crude-rate based harm measures, as well as formulas and simulation results that quantify the deviation of such measures from those based on the more sophisticated Nelson-Aalen estimator. Moreover, we present results for a generalized multibin version of the crude rate, for which the usual crude rate is a single-bin special case. The generalized multibin crude rate is more straightforward to compute than the Nelson-Aalen estimator and can reduce potential biases of the single-bin crude rate. For studies that seek to use multibin measures, we provide simulations to guide the choice regarding number of bins. We further bolster these results using a worked example of stroke after "benign" dizziness from a large data set.

Safer Stroke-Dx Instrument: Identifying Stroke Misdiagnosis in the Emergency Department

BACKGROUND

Missed or delayed diagnosis of acute stroke, or false-negative stroke (FNS), at initial emergency department (ED) presentation occurs in ≈9% of confirmed stroke patients. Failure to rapidly diagnose stroke can preclude time-sensitive treatments, resulting in higher risks of severe sequelae and disability. In this study, we developed and tested a modified version of a structured medical record review tool, the Safer Dx Instrument, to identify FNS in a subgroup of hospitalized patients with stroke to gain insight into sources of ED stroke misdiagnosis.

METHODS

We conducted a retrospective cohort study at 2 unaffiliated comprehensive stroke centers. In the development and confirmatory cohorts, we applied the Safer Stroke-Dx Instrument to report the prevalence and documented sources of ED diagnostic error in FNS cases among confirmed stroke patients upon whom an acute stroke was suspected by the inpatient team, as evidenced by stroke code activation or urgent neurological consultation, but not by the ED team. Inter-rater reliability and agreement were assessed using interclass coefficient and kappa values (κ).

RESULTS

Among 183 cases in the development cohort, the prevalence of FNS was 20.2% (95% CI, 15.0-26.7). Too narrow a differential diagnosis and limited neurological examination were common potential sources of error. The interclass coefficient for the Safer Stroke-Dx Instrument items ranged from 0.42 to 0.91, and items were highly correlated with each other. The κ for diagnostic error identification was 0.90 (95% CI, 0.821-0.978) using the Safer Stroke-Dx Instrument. In the confirmatory cohort of 99 cases, the prevalence of FNS was 21.2% (95% CI, 14.2-30.3) with similar sources of diagnostic error identified.

CONCLUSIONS

Hospitalized patients identified by stroke codes and requests for urgent neurological consultation represent an enriched population for the study of diagnostic error in the ED. The Safer Stroke-Dx Instrument is a reliable tool for identifying FNS and sources of diagnostic error.

Validity of self-reported endometriosis: a comparison across four cohorts

STUDY QUESTION

How accurately do women report a diagnosis of endometriosis on self-administered questionnaires?

SUMMARY ANSWER

Based on the analysis of four international cohorts, women self-report endometriosis fairly accurately with a > 70% confirmation for clinical and surgical records.

WHAT IS KNOWN ALREADY

The study of complex diseases requires large, diverse population-based samples, and endometriosis is no exception. Due to the difficulty of obtaining medical records for a condition that may have been diagnosed years earlier and for which there is no standardized documentation, reliance on self-report is necessary. Only a few studies have assessed the validity of self-reported endometriosis compared with medical records, with the observed confirmation ranging from 32% to 89%.

STUDY DESIGN, SIZE, DURATION

We compared questionnaire-reported endometriosis with medical record notation among participants from the Black Women's Health Study (BWHS; 1995-2013), Etude Epidémiologique auprès de femmes de la Mutuelle Générale de l'Education Nationale (E3N; 1990-2006), Growing Up Today Study (GUTS; 2005-2016), and Nurses' Health Study II (NHSII; 1989-1993 first wave, 1995-2007 second wave).

PARTICIPANTS/MATERIALS, SETTING, METHODS

Participants who had reported endometriosis on self-administered questionnaires gave permission to procure and review their clinical, surgical, and pathology medical records, yielding records for 827 women: 225 (BWHS), 168 (E3N), 85 (GUTS), 132 (NHSII first wave), and 217 (NHSII second wave). We abstracted diagnosis confirmation as well as American Fertility Society (AFS) or revised American Society of Reproductive Medicine (rASRM) stage and visualized macro-presentation (e.g. superficial peritoneal, deep endometriosis, endometrioma). For each cohort, we calculated clinical reference to endometriosis, and surgical- and pathologic-confirmation proportions.

MAIN RESULTS AND THE ROLE OF CHANCE

Confirmation was high-84% overall when combining clinical, surgical, and pathology records (ranging from 72% for BWHS to 95% for GUTS), suggesting that women accurately report if they are told by a physician that they have endometriosis. Among women with self-reported laparoscopic confirmation of their endometriosis diagnosis, confirmation of medical records was extremely high (97% overall, ranging from 95% for NHSII second wave to 100% for NHSII first wave). Importantly, only 42% of medical records included pathology reports, among which histologic confirmation ranged from 76% (GUTS) to 100% (NHSII first wave). Documentation of visualized endometriosis presentation was often absent, and details recorded were inconsistent. AFS or rASRM stage was documented in 44% of NHSII first wave, 13% of NHSII second wave, and 24% of GUTS surgical records. The presence/absence of deep endometriosis was rarely noted in the medical records.

LIMITATIONS, REASONS FOR CAUTION

Medical record abstraction was conducted separately by cohort-specific investigators, potentially introducing misclassification due to variation in abstraction protocols and interpretation. Additionally, information on the presence/absence of AFS/rASRM stage, deep endometriosis, and histologic findings were not available for all four cohort studies.

WIDER IMPLICATIONS OF THE FINDINGS

Variation in access to care and differences in disease phenotypes and risk factor distributions among patients with endometriosis necessitates the use of large, diverse population samples to subdivide patients for risk factor, treatment response and discovery of long-term outcomes. Women self-report endometriosis with reasonable accuracy (>70%) and with exceptional accuracy when women are restricted to those who report that their endometriosis had been confirmed by laparoscopic surgery (>94%). Thus, relying on self-reported endometriosis in order to use larger sample sizes of patients with endometriosis appears to be valid, particularly when self-report of laparoscopic confirmation is used as the case definition. However, the paucity of data on histologic findings, AFS/rASRM stage, and endometriosis phenotypic characteristics suggests that a universal requirement for harmonized clinical and surgical data documentation is needed if we hope to obtain the relevant details for subgrouping patients with endometriosis.

STUDY FUNDING/COMPETING INTEREST(S)

This project was supported by Eunice Kennedy Shriver National Institute of Child Health and Development grants HD48544, HD52473, HD57210, and HD94842, National Cancer Institute grants CA50385, R01CA058420, UM1CA164974, and U01CA176726, and National Heart, Lung, and Blood Institute grant U01HL154386. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. AS, SM, and KT were additionally supported by the J. Willard and Alice S. Marriott Foundation. MK was supported by a Marie Curie International Outgoing Fellowship within the 7th European Community Framework Programme (#PIOF-GA-2011-302078) and is grateful to the Philippe Foundation and the Bettencourt-Schueller Foundation for their financial support. Funders had no role in the study design, conduct of the study or data analysis, writing of the report, or decision to submit the article for publication. LA Wise has served as a fibroid consultant for AbbVie, Inc for the last three years and has received in-kind donations (e.g. home pregnancy tests) from Swiss Precision Diagnostics, Sandstone Diagnostics, Kindara.com, and FertilityFriend.com for the PRESTO cohort. SA Missmer serves as an advisory board member for AbbVie and a single working group service for Roche; neither are related to this study. No other authors have a conflict of interest to report. Funders had no role in the study design, conduct of the study or data analysis, writing of the report, or decision to submit the article for publication.

TRIAL REGISTRATION NUMBER

N/A.

A Semi-Quantitative Risk Assessment and Management Strategies on COVID-19 Infection to Outpatient Health Care Workers in the Post-Pandemic Period

BACKGROUND

In the pandemic of COVID-19, due to asymptomatic patients and high personnel fluidity in outpatient clinics, health care workers (HCWs) in outpatients were facing severe threat from infection. There is an urgent need for a risk assessment to recognize and prevent infection risks.

PURPOSE

To establish a semi-quantitative risk assessment model on COVID-19 infections for HCWs in outpatient departments, and apply it to practices. Further to provide infection risk management strategies to reduce infection threats in the post-pandemic of COVID-19.

METHODS

We used the method of Brainstorm, Literature study and Analytic Hierarchy Process (AHP) for risk factors selection and model construction, we also created corresponding indicators for each risk factors, in order to collect data in assessment practice.

RESULTS

Eighteen risk factors were recognized and selected for model construction, by scatter plot, these risk factors had been classified into four parts, spanned the scopes of diagnosis and treatment, environment, personal protection and emergency handling, with specific management suggestions provided. In the practice, outpatient clinics were divided into three risk levels, 5 clinics in high risk level, 9 in medium risk level and 11 in low risk level.

CONCLUSION

A proper comprehensive risk assessment model for COVID-19 infections has been successfully established. With the model, the ability to COVID-19 prevention in outpatients can be easily evaluated. The strategies on disinfection, surveillance and personal protection were also valuable references in the post-pandemic of COVID-19.

Maternal death surveillance and response in Tanzania: comprehensiveness of narrative summaries and action points from maternal death reviews

Background

Maternal deaths reviews are proposed as one strategy to address high maternal mortality in low and middle-income countries, including Tanzania. Review of maternal deaths relies on comprehensive documentation of medical records that can reveal the sequence of events leading to death. The World Health Organization’s and the Tanzanian Maternal Death and Surveillance (MDSR) system propose the use of narrative summaries during maternal death reviews for discussing the case to categorize causes of death, identify gaps in care and recommend action plans to prevent deaths. Suggested action plans are recommended to be Specific, Measurable, Attainable, Relevant and Time bound (SMART). To identify gaps in documenting information and developing recommendations, comprehensiveness of written narrative summaries and action plans were assessed.

Methods

A total of 76 facility maternal deaths that occurred in two regions in Southern Tanzania in 2018 were included for analysis. Using a prepared checklist from Tanzania 2015 MDSR guideline, we assessed comprehensiveness by presence or absence of items in four domains, each with several attributes. These were socio-demographic characteristics, antenatal care, referral information and events that occurred after admission. Less than 75% completeness of attributes in all domains was considered poor while 95% and above were good/comprehensive. Action plans were assessed by application of SMART criteria and according to the place of planned implementation (community, facility or higher level of health system).

Results

Almost half of narrative summaries (49%) scored poor, and only1% scored good/comprehensive. Summaries missed key information such as demographic characteristics, time between diagnosis of complication and commencing treatment (65%), investigation results (47%), summary of case evolution (51%) and referral information (47%). A total of 285 action points were analysed. Most action points, 242(85%), recommended strategies to be implemented at health facilities and were mostly about service delivery, 120(42%). Only 42% (32/76) of the action points were deemed to be SMART.

Conclusions

Abstraction of information to prepare narrative summaries used in the MDSR system is inadequately done. Most recommendations were unspecific with a focus on improving quality of care in health facilities.

Factors associated with hospitalization for ischemic stroke and TIA following an emergency department headache visit

BACKGROUND

Misdiagnosis of cerebrovascular disease among Emergency Department (ED) patients with headache has been reported. We hypothesized that markers of substandard diagnostic processes would be associated with subsequent ischemic cerebrovascular events among patients discharged from the ED with a headache diagnosis even after adjusting for demographic variables and medical history.

METHODS

We conducted a case-control study of adult ED patients diagnosed with a primary headache disorder at Montefiore Medical Center from 9/1/2013-9/1/2018. Cases were defined as patients hospitalized for an ischemic stroke or TIA within 365 days of their index ED visit. Control patients were defined as those who lacked a subsequent hospitalization for cerebrovascular disease. Pre-specified demographic, clinical, and diagnostic process factors were compared between groups; conditional logistic regression was used to assess the separate and joint influence of baseline features on risk of cerebral ischemia.

RESULTS

A total of 93 consecutive headache patients with a subsequent ischemic stroke/TIA hospitalization were matched to 93 controls (n = 186). Cases were older than controls and more likely to have traditional cerebrovascular risk factors. Neurological consultation was obtained more often for cases (13% vs. 4%; P = 0.03), cases were in the ED for longer (6 vs. 5 h, P = 0.03), and more frequently received neuroimaging (80% vs. 48%; P < 0.0001). Rates of neurological examination, documented differential diagnoses, and clear discharge follow up plans were similar between cases and controls. In our conditional logistic regression model, only history of prior stroke/TIA was associated with increased odds of subsequent cerebral ischemia.

CONCLUSION

Factors associated with diagnostic process failures did not increase the odds of subsequent ischemic stroke/TIA hospitalization following ED headache visit in our study.

Quality and extent of implementation of a nurse-led care management intervention: care coordination for health promotion and activities in Parkinson's disease (CHAPS)

BACKGROUND

A recent nurse-led, telephone-administered 18-month intervention, Care Coordination for Health Promotion and Activities in Parkinson's Disease (CHAPS), was tested in a randomized controlled trial and improved care quality. Therefore, intervention details on nurse care manager activity (types and frequencies) and participant actions are needed to support potential dissemination. Activities include nurse care manager use of a holistic organizing framework, identification of Parkinson's disease (PD)-related problems/topics, communication with PD specialists and care coordination, participant coaching, and participant self-care actions including use of a notebook self-care tool.

METHODS

This article reports descriptive data on the CHAPS intervention. The study setting was five sites in the Veterans Affairs Healthcare System. Sociodemographic data were gathered from surveys of study participants (community-dwelling veterans with PD). Nurse care manager intervention activities were abstracted from electronic medical records and logbooks. Statistical analysis software was used to provide summary statistics; closed card sorting was used to group some data.

RESULTS

Intervention participants (n = 140) were primarily men, mean age 69.4 years (standard deviation 10.3) and community-dwelling. All received the CHAPS Initial Assessment, which had algorithms designed to identify 31 unique CHAPS standard problems/topics. These were frequently documented (n = 4938), and 98.6% were grouped by assigned domain from the Organizing Framework (Siebens Domain Management Model™). Nurse care managers performed 27 unique activity types to address identified problems, collaborating with participants and PD specialists. The two most frequent unique activities were counseling/emotional support (n = 387) and medication management (n = 349). Both were among 2749 total performed activities in the category Implementing Interventions (coaching). Participants reported unique self-care action types (n = 23) including use of a new notebook self-care tool.

CONCLUSIONS

CHAPS nurse care managers implemented multiple activities including participant coaching and care coordination per the CHAPS protocol. Participants reported various self-care actions including use of a personalized notebook. These findings indicate good quality and extent of implementation, contribute to ensuring reproducibility, and support CHAPS dissemination as a real-world approach to improve care quality.

TRIAL REGISTRATION

ClinicalTrials.gov as NCT01532986 , registered on January 13, 2012.

Assessment of adequacy of respiratory infection prevention in hospitals of Inner Mongolia, China: a cross-sectional study using unannounced standardized patients

INTRODUCTION

Recent respiratory infectious disease (RID) outbreaks of influenza and the novel coronavirus have resulted in global pandemics. RIDs can trigger nosocomial infections if not adequately prevented.

OBJECTIVE

The objective of this study was to rate the adequacy of healthcare workers (HCWs) and hospital settings on RID prevention using unannounced standardized patients (USP) in clinical settings of hospital gateways.

METHODS

Trained USPs visited 5 clinical settings: information desks, registration desks, two outpatient departments and the emergency departments in 10 hospitals across 3 cities of Inner Mongolia, China. USPs observed the hospital air ventilation and distance from the nearest hand-washing facilities to each clinical setting, then mimicked symptoms of either tuberculosis or influenza before observing the HCW's behavior. A total of 480 clinical-setting assessments were made by 19 USPs.

RESULTS

The overall adequacy of triage services was 86.7% and for prevention of the spread of airborne droplets was 83.5%. Almost all hospitals offered adequate air ventilation. Compared to the information desk, adequacy of triage and preventing the spread of airborne droplets by physicians in the three clinical departments was less likely to be adequate. Triage services for USPs simulating symptoms of influenza were 2.6 times more likely to be adequate than for those simulating symptoms of tuberculosis but there was no significant difference in the prevention of the spread of airborne droplets.

CONCLUSIONS

There is a need to improve respiratory infectious disease procedures in our study hospitals, especially in outpatient and emergency departments.

Finding the clinical utility of 1,5-anhydroglucitol among primary care practitioners

Background

HbA1c is widely used as the standard measure to track glycemic control in patients with diabetes and pre-diabetes but measures average levels of glycated hemoglobin over two to three months, with limited utility in the presence of recent and/or short-term fluctuations in glycemic control, which are correlated with worse patient outcomes.

Methods

We examined the clinical utility of 1-5-anhydroglucitol (1,5-AG) in six different, but common, case types of diabetes patients with short-term glycemic variability. We conducted a randomized controlled trial of simulated patients to examine the clinical practice patterns of primary care physicians before and after introducing 1,5-AG. The 145 participants were randomly assigned into standard care or standard care + 1,5-AG arms. Provider care was reviewed against explicit evidence-based care standards.

Results

At baseline, we saw no difference between the two study arms in clinical quality of care provided (p = 0.997). After introduction of 1,5-AG, standard care + 1,5-AG providers performed 3.2% better than controls (p = 0.025. In diagnosis and treatment, there was a slight, but nonsignificant trend toward better care (+1.1%, p = 0.507) for intervention providers. Upon disaggregation by case, almost all the improvement occurred in the medication-induced hyperglycemia patients (+8.1%, p = 0.047).

Conclusions

A nationally representative sample of primary care physicians demonstrated that of six different cases used in this study, 1,5-AG was found to be most effective increasing awareness of poor glucose control in medication-induced hyperglycemia. If 1,5-AG is used in this particular circumstance, the overall savings to the healthcare system is estimated to be $28 million.

Rate of diagnostic errors and serious misdiagnosis-related harms for major vascular events, infections, and cancers: toward a national incidence estimate using the “Big Three”

Background

Missed vascular events, infections, and cancers account for ~75% of serious harms from diagnostic errors. Just 15 diseases from these “Big Three” categories account for nearly half of all serious misdiagnosis-related harms in malpractice claims. As part of a larger project estimating total US burden of serious misdiagnosis-related harms, we performed a focused literature review to measure diagnostic error and harm rates for these 15 conditions.

Methods

We searched PubMed, Google, and cited references. For errors, we selected high-quality, modern, US-based studies, if available, and best available evidence otherwise. For harms, we used literature-based estimates of the generic (disease-agnostic) rate of serious harms (morbidity/mortality) per diagnostic error and applied claims-based severity weights to construct disease-specific rates. Results were validated via expert review and comparison to prior literature that used different methods. We used Monte Carlo analysis to construct probabilistic plausible ranges (PPRs) around estimates.

Results

Rates for the 15 diseases were drawn from 28 published studies representing 91,755 patients. Diagnostic error (false negative) rates ranged from 2.2% (myocardial infarction) to 62.1% (spinal abscess), with a median of 13.6% [interquartile range (IQR) 9.2–24.7] and an aggregate mean of 9.7% (PPR 8.2–12.3). Serious misdiagnosis-related harm rates per incident disease case ranged from 1.2% (myocardial infarction) to 35.6% (spinal abscess), with a median of 5.5% (IQR 4.6–13.6) and an aggregate mean of 5.2% (PPR 4.5–6.7). Rates were considered face valid by domain experts and consistent with prior literature reports.

Conclusions

Diagnostic improvement initiatives should focus on dangerous conditions with higher diagnostic error and misdiagnosis-related harm rates.

Assessing diagnostic error in cerebral venous thrombosis via detailed chart review

Background Diagnostic error in cerebral venous thrombosis (CVT) has been understudied despite the harm associated with misdiagnosis of other cerebrovascular diseases as well as the known challenges of evaluating non-specific neurological symptoms in clinical practice. Methods We conducted a retrospective cohort study of CVT patients hospitalized at a single center. Two independent reviewers used a medical record review tool, the Safer Dx Instrument, to identify diagnostic errors. Demographic and clinical factors were abstracted. We compared subjects with and without a diagnostic error using the t-test for continuous variables and the chi-square (χ2) test or Fisher's exact test for categorical variables; an alpha of 0.05 was the cutoff for significance. Results A total of 72 CVT patients initially met study inclusion criteria; 19 were excluded due to incomplete medical records. Of the 53 patients included in the final analysis, the mean age was 48 years and 32 (60.4%) were women. Diagnostic error occurred in 11 cases [20.8%; 95% confidence interval (CI) 11.8-33.6%]. Subjects with diagnostic errors were younger (42 vs. 49 years, p = 0.13), more often women (81.8% vs. 54.8%, p = 0.17), and were significantly more likely to have a past medical history of a headache disorder prior to the index CVT visit (7.1% vs. 36.4%, p = 0.03). Conclusions Nearly one in five patients with complete medical records experienced a diagnostic error. Prior history of headache was the only evaluated clinical factor that was more common among those with an error in diagnosis. Future work on distinguishing primary from secondary headaches to improve diagnostic accuracy in acute neurological disease is warranted.

Patients report inferior quality of care for knee osteoarthritis prior to assessment for knee replacement surgery - a cross-sectional study of 517 patients in Denmark

Background and purpose - Clinical care pathways for knee osteoarthritis (OA) are not always in line with clinical guidelines. We investigated (1) the patient-perceived quality of OA management, (2) which physiotherapist-delivered treatments patients with knee OA have attempted, and (3) patients' expected subsequent treatment, at the time of referral to an orthopedic surgeon.Patients and methods - This cross-sectional study included all patients with scheduled first-time appointments for knee OA at an orthopedic outpatient clinic from April 2017 to February 2018. Postal questionnaires included the 16-item OsteoArthritis Quality Indicator (OA-QI) questionnaire and questions about physiotherapist-delivered treatment for knee OA.Results - 517 of 627 (82%) eligible patients responded. Responders' (63% female) mean age was 67 years. The mean pass rate for the 16 independent quality indicators was 32% (8-74%). Sub-grouped into 4 categories, pass rates for independent quality indicators ranged from 16-52% regarding information, 9-50% regarding pain and functional assessment, 8-35% regarding referrals, and 16-74% regarding pharmacological treatment. While half of responders felt informed of physical activity benefits, only one-third had consulted a physiotherapist during the past year. Commonest physiotherapist-delivered treatments were exercise therapy for 22% and participation in the Good Life with osteoArthritis in Denmark (GLA:D) program for12% of responding patients. 65% expected surgery as subsequent treatment.Interpretation - Patients with knee OA are undertreated in primary care in Denmark; however, our findings may only reflect healthcare settings that are comparably organized. Our results call for better structure and uniform pathways for primary care knee OA treatment before referral to an orthopedic surgeon.

Variation in Diabetes Management: A National Assessment of Primary Care Providers

BACKGROUND

Glucose control is monitored primarily through ordering HbA1c levels, which is problematic in patients with glycemic variability. Herein, we report on the management of these patients by board-certified primary care providers (PCPs) in the United States.

METHODS

We measured provider practice in a representative sample of 156 PCPs. All providers cared for simulated patients with diabetes presenting with symptoms of glycemic variability. Provider responses were reviewed by trained clinicians against evidence-based care standards and accepted standard of care protocols.

RESULTS

Care varied widely-overall quality of care averaged 51.3%±10.6%-with providers performing just over half the evidence-based practices necessary for their cases. More worryingly, provider identified the underlying etiology of the poor glycemic control only 36.3% of the time. HbA1c was routinely ordered in 91.3% of all cases but often (59.5%) inappropriately. Ordering other tests of glycemic control (done in 15% of cases) led to significant increases in identifying the etiology of the hyperglycemia. Correctly modifying their patient's treatment was more likely to occur if doctors first identified the underlying etiology (65.9% vs 49.0%, P<0.001). We conservatively estimated a US $65/patient/visit in unnecessary testing and US $389 annually in additional care costs when the etiology was missed, translating potentially into millions of dollars of wasteful spending.

CONCLUSION

Despite established evidence that HbA1c misses short-term changes in diabetes, we found PCPs consistently ordered HbA1c, rarely using other available blood tests. However, if the factors leading to poor glycemic control were recognized, PCPs were more likely to correctly alter their patient's hypoglycemic therapy.

Pregnancy and multiple sclerosis: Risk of unplanned pregnancy and drug exposure in utero

Background

Multiple sclerosis is a central nervous system demyelinating disease that affects women of reproductive potential. It is important to identify the frequency and risk factors of unplanned or disease-modifying therapy-exposed pregnancies to create interventions to reduce these.

Methods

This retrospective, single-center, observational chart review study aims to identify risk factors for unplanned pregnancy to identify a target population for family counseling.

Results

In total, 63 live births in 45 patients (20 unplanned and 43 planned) were analyzed. The percentage of unplanned pregnancy was 32%. The proportion of those receiving family planning counseling was lower in the patients with unplanned pregnancies (p < 0.001). The main risk factors for unplanned pregnancy were younger age (p = 0.004), disease-modifying therapy exposure (p < 0.001), and being unmarried (p < 0.001). Overall, 16 pregnancies had disease-modifying therapy exposure and in a subsequent study the risk for disease-modifying therapy exposure was unplanned status (p < 0.001). Birth outcomes were not different between groups. There were more enhancing lesions in the post-partum magnetic resonance imaging of women with planned pregnancy (p < 0.04).

Conclusion

Prevention of unplanned pregnancy could lead to less disease-modifying therapy exposed pregnancies. This study suggests a targeted intervention of family planning counseling in younger, unmarried multiple sclerosis patients could potentially lead to less unintended in utero disease-modifying therapy exposure.

Using standardised patients to assess the quality of medical records: an application and evidence from rural China

BACKGROUND

Medical records play a fundamental role in healthcare delivery, quality assessment and improvement. However, there is little objective evidence on the quality of medical records in low and middle-income countries.

OBJECTIVE

To provide an unbiased assessment of the quality of medical records for outpatient visits to rural facilities in China.

METHODS

A sample of 207 township health facilities across three provinces of China were enrolled. Unannounced standardised patients (SPs) presented to providers following standardised scripts. Three weeks later, investigators returned to collect medical records from each facility. Audio recordings of clinical interactions were then used to evaluate completeness and accuracy of available medical records.

RESULTS

Medical records were located for 210 out of 620 SP visits (33.8%). Of those located, more than 80% contained basic patient information and drug treatment when mentioned in visits, but only 57.6% recorded diagnoses. The most incompletely recorded category of information was patient symptoms (74.3% unrecorded), followed by non-drug treatments (65.2% unrecorded). Most of the recorded information was accurate, but accuracy fell below 80% for some items. The keeping of any medical records was positively correlated with the provider's income (β 0.05, 95% CI 0.01 to 0.09). Providers at hospitals with prescription review were less likely to record completely (β -0.87, 95% CI -1.68 to 0.06). Significant variation by disease type was also found in keeping of any medical record and completeness.

CONCLUSION

Despite the importance of medical records for health system functioning, many rural facilities have yet to implement systems for maintaining patient records, and records are often incomplete when they exist. Prescription review tied to performance evaluation should be implemented with caution as it may create disincentives for record keeping. Interventions to improve record keeping and management are needed.

Agreement of antenatal care indicators from self-reported questionnaire and the antenatal care card of women in the 2015 Pelotas birth cohort, Rio Grande do Sul, Brazil

BACKGROUND

Studies of healthcare service use during the pregnancy-postpartum cycle often rely on self-reported data. The reliability of self-reported information is often questioned as administrative data or medical records, such as antenatal care cards, are usually preferred. In this study, we measured the agreement of antenatal care indicators from self-reported information and antenatal care cards of pregnant women in the 2015 Pelotas Birth Cohort, Brazil.

METHODS

In a sample of 3923 mothers, indicator agreement strengths were estimated from Kappa and prevalence-and-bias-adjusted Kappa (PABAK) coefficients. Maternal characteristics associated with indicator agreements were assessed with heterogeneity chi-squared tests.

RESULTS

The self-reported questionnaire and the antenatal care card showed a moderate to high agreement in 10 of 21 (48%) antenatal care indicators that assessed care service use, clinical examination and diseases during pregnancy. Counseling indicators performed poorly. Self-reported information presented a higher frequency data and a higher sensitivity but slightly lower specificity when compared to the antenatal card. Factors associated with higher agreement between both data sources included lower maternal age, higher level of education, primiparous status, and being a recipient of health care in the public sector.

CONCLUSIONS

Self-reported questionnaire and antenatal care cards provided substantially different information on indicator performance. Reliance on only one source of data to assess antenatal care quality may be questionable for some indicators. From a public health perspective, it is recommended that antenatal care programs use multiple data sources to estimate quality and effectiveness of health promotion and disease prevention in pregnant women and their offspring.

Population segmentation based on healthcare needs: a systematic review

BACKGROUND

Healthcare needs-based population segmentation is a promising approach for enabling the development and evaluation of integrated healthcare service models that meet healthcare needs. However, healthcare policymakers interested in understanding adult population healthcare needs may not be aware of suitable population segmentation tools available for use in the literature and barring better-known alternatives, may reinvent the wheel by creating and validating their own tools rather than adapting available tools in the literature. Therefore, we undertook a systematic review to identify all available tools which operationalize healthcare need-based population segmentation, to help inform policymakers developing population-level health service programmes.

METHODS

Using search terms reflecting concepts of population, healthcare need and segmentation, we systematically reviewed and included articles containing healthcare need-based adult population segmentation tools in PubMed, CINAHL and Web of Science databases. We included tools comprising mutually exclusive segments with prognostic value for clinically relevant outcomes. An updated secondary search on the PubMed database was also conducted as the last search was conducted 2 years ago. All identified tools were characterized in terms of segment formulation, segmentation base, whether they received peer-reviewed validation, requirement for comprehensive electronic medical records, proprietary status and number of segments.

RESULTS

A total of 16 unique tools were identified from systematically reviewing 9970 articles. Peer-reviewed validation studies were found for 9 of these tools.

DISCUSSION AND CONCLUSIONS

The underlying segmentation basis of most identified tools was found to be conceptually comparable to each other which suggests a broad recognition of archetypical patient overall healthcare need profiles. While many tools operate based on administrative record data, it is noted that healthcare systems without comprehensive electronic medical records would benefit from tools which segment populations through primary data collection. Future work could therefore include development and validation of such primary data collection-based tools. While this study is limited by exclusion of non-English literature, the identified and characterized tools will nonetheless facilitate efforts by policymakers to improve patient-centred care through development and evaluation of services tailored for specific populations segmented by these tools.

Awareness of limited joint mobility in type 2 diabetes in general practice in the Netherlands: an online questionnaire survey

BACKGROUND

Next to the well-known micro- and macrovascular complications, type 2 diabetes mellitus (T2DM) is associated with musculoskeletal disorders of the upper extremities referred to as limited joint mobility (LJM), e.g. carpal tunnel syndrome (CTS) and adhesive capsulitis. Unrecognized and untreated LJM can lead to poor quality of life and non-compliance to diabetes treatment which aggravates LJM. Despite its reported higher prevalence in international prevalence studies, examination of the upper extremities is still no part of the regular diabetes mellitus (DM) check-ups. The primary aim of this study was therefore to evaluate the awareness of Dutch GPs and nurse practitioners concerning LJM. Secondary aims were to evaluate the current management of a patient with LJM, and to assess opinions regarding the question of who should screen for LJM if this is done in the near future.

METHODS

An online survey was conducted among 390 general practitioners (GPs) and 245 nurse practitioners (NPs) of three diabetes care groups in The Netherlands to assess their awareness of the association between DM and LJM.

RESULTS

Most GPs are not aware that LJM is a DM complication, with an unawareness for specific upper extremity disorders ranging from 59 to 73%. Of the NPs, 76% is not aware either. Only 41% of GPs would advise the most optimal treatment for diabetes patient with CTS. Finally, only 25% of the GPs believe that screening for LJM should be performed during the regular diabetes check-up compared to 63% of the NPs.

CONCLUSION

The majority of GPs and NPs are not aware of LJM as a T2DM complication. In contrast to NPs, most GPs do not believe that screening for LJM should be performed during the regular diabetes check-up.

Concordance of care processes between medical records and patient self-administered questionnaires

Background

Despite the increasing use of medical records to measure quality of care, studies have shown that their validity is suboptimal. The objective of this study is to assess the concordance of cardiovascular care processes evaluated through medical record review and patient self-administered questionnaires (SAQs) using ten quality indicators (TRANSIT indicators). These indicators were developed as part of a participatory research program (TRANSIT study) dedicated to TRANSforming InTerprofessional clinical practices to improve cardiovascular disease (CVD) prevention in primary care.

Methods

For every patient participating in the TRANSIT study, the compliance to each indicator (individual scores) as well as the mean compliance to all indicators of a category (subscale scores) and to the complete set of ten indicators (overall scale score) were established. Concordance between results obtained using medical records and patient SAQs was assessed by prevalence-adjusted bias-adjusted kappa (PABAK) coefficients as well as intraclass correlation coefficients (ICCs) and 95% confidence intervals (95% CI). Generalized linear mixed models (GLMM) were used to identify patients’ sociodemographic and clinical characteristics associated with agreement between the two data sources.

Results

The TRANSIT study was conducted in a primary care setting among patients (n = 759) with multimorbidity, at moderate (16%) and high risk (83%) of cardiovascular diseases. Quality of care, as measured by the TRANSIT indicators, varied substantially between medical records and patient SAQ. Concordance between the two data sources, as measured by ICCs (95% CI), was poor for the subscale (0.18 [0.08–0.27] to 0.46 [0.40–0.52]) and overall (0.46 [0.40–0.53]) compliance scale scores. GLMM showed that agreement was not affected by patients’ characteristics.

Conclusions

In quality improvement strategies, researchers must acknowledge that care processes may not be consistently recorded in medical records. They must also be aware that the evaluation of the quality of care may vary depending on the source of information, the clinician responsible of documenting the interventions, and the domain of care.

Electronic supplementary material

The online version of this article (10.1186/s12875-019-0979-7) contains supplementary material, which is available to authorized users.

Variation in Assessing Renal Allograft Rejection: A National Assessment of Nephrology Practice

BACKGROUND

The clinical utility of early detection and treatment of allograft rejection is well-established. Despite frequent testing called for by standard of care protocols, the five-year kidney allograft survival rate is estimated to be as low as 71%. Herein, we report on posttransplant care provided to kidney allograft recipients by board-certified nephrologists in the United States.

METHODS

We measured clinical practice in a representative sample of 175 practicing nephrologists. All providers cared for simulated patients' status after renal transplant ranging from 30-75 years in age and 3-24 months after transplant. Our sample of nephrologists cared for a total of 525 allograft cases. Provider responses to the cases were reviewed by trained clinicians, and care was compared to evidence-based care standards and accepted standard of care protocols.

RESULTS

Among nephrologists, practicing in settings ranging from transplant centers to community practice, we found that the clinical workup of kidney injury in posttransplant patients is highly variable and frequently deviates from evidence-based care. In cases with pathologic evidence of rejection, only 29.1% (102/350) received an appropriate, evidence-based biopsy, whereas, in cases with no pathological evidence of rejection, 41.3% (45/109) received low-value, unnecessary biopsies.

CONCLUSION

Clinical care in the posttransplant setting is highly variable. Biopsies are often ordered in cases where their results do not alter treatment. Additionally, we found that misdiagnosis was common as were opportunities for earlier biopsy and detection of rejection. This evidence suggests that better diagnostic tools may be helpful to determine which transplant patients should be biopsied and which should not. This study suggests that nephrologists and transplant patients need better tests than creatinine and proteinuria and less invasive approaches than routine biopsies to determine when transplant patients should be investigated for rejection and additional treatment.

Use of standardised patients to assess gender differences in quality of tuberculosis care in urban India: a two-city, cross-sectional study

BACKGROUND

In India, men are more likely than women to have active tuberculosis but are less likely to be diagnosed and notified to national tuberculosis programmes. We used data from standardised patient visits to assess whether these gender differences occur because of provider practice.

METHODS

We sent standardised patients (people recruited from local populations and trained to portray a scripted medical condition to health-care providers) to present four tuberculosis case scenarios to private health-care providers in the cities of Mumbai and Patna. Sampling and weighting allowed for city representative interpretation. Because standardised patients were assigned to providers by a field team blinded to this study, we did balance and placebo regression tests to confirm standardised patients were assigned by gender as good as randomly. Then, by use of linear and logistic regression, we assessed correct case management, our primary outcome, and other dimensions of care by standardised patient gender.

FINDINGS

Between Nov 21, 2014, and Aug 21, 2015, 2602 clinical interactions at 1203 private facilities were completed by 24 standardised patients (16 men, eight women). We found standardised patients were assigned to providers as good as randomly. We found no differences in correct management by patient gender (odds ratio 1·05; 95% CI 0·76-1·45; p=0·77) and no differences across gender within any case scenario, setting, provider gender, or provider qualification.

INTERPRETATION

Systematic differences in quality of care are unlikely to be a cause of the observed under-representation of men in tuberculosis notifications in the private sector in urban India.

FUNDING

Grand Challenges Canada, Bill & Melinda Gates Foundation, World Bank Knowledge for Change Program.

Quality of primary care provided in community clinics in Japan

BACKGROUND

Quality indicators (QIs) for primary care are used worldwide. To date, however, the use of QIs to assess the quality of primary care in Japan has not been reported besides diabetes care. Here, we used QIs to evaluate the quality of primary care services provided by local clinics in Japan.

METHODS

Four primary care clinics participated in the retrospective medical chart review in 2015. To assess primary care quality, we used 18 process-oriented QIs from the Quality Indicators for Primary Care practice in Japan (QIPC-J) those we previously developed by using a modified Delphi appropriateness method, which comprises 39 QIs in five categories (Comprehensive care/Standardized care, Access, Communication, Coordination, and Understanding of patient's background). Adult subjects were selected from among patients who visited each clinic within the previous one year using medical claims data. We collected data by reviewing medical charts, and calculated the quality score for each QI and clinic.

RESULTS

A cumulative total of 4330 medical charts were reviewed. The overall quality score was 31.5%. Adherence to QIs ranged from 3.2% to 85.6%. Some quality scores varied substantially between clinics but the overall quality of care among clinics varied less, from 29.2% to 34.0%.

CONCLUSIONS

The quality of primary care services provided by local clinics in Japan varies by both QI and clinic. Strategies to improve the quality of care are warranted.

Impact of an American board of pediatrics maintenance of certification (MOC) on weight-related counseling at well-child check-ups

OBJECTIVE

The Healthy Weight Counseling Maintenance of Certification (MOC) program integrates pediatrician training and clinic changes to promote use of evidence-based, diet and physical activity (PA) health messages and counseling strategies. This interrupted time series study assessed the impact of this MOC program on provision of weight-related counseling.

METHODS

We randomly selected 10-15 well-child visit charts at three time points before and three time points after 102 Georgia pediatricians began the MOC in 2012-2015. Linear binomial regression compared the frequency of behavior-change goal setting and health messaging documentation (fruit/vegetable consumption, sugar-sweetened beverage consumption, out-of-home food consumption, PA, and screen time) before and after MOC participation.

RESULTS

At baseline, pediatricians documented behavior-change goals with 44% of patients, with an additional 49% of patients having documented goals after their pediatrician started the MOC (99.5% confidence interval [CI]: 21-77%). Similarly, absolute increases in the proportion of patients with documentation for sugar-sweetened beverage consumption (adjusted prevalence difference [aPD]: 37%; 99.5% CI: 13-62%) and out-of-home eating were observed (aPD: 38%; 99.5% CI: 12-64%).

CONCLUSION

The Healthy Weight Counseling MOC is associated with increased and sustained use of evidence-based health messages and counseling strategies.

PRACTICE IMPLICATIONS

Continuing education and facilitation of system changes help improve physicians' weight-related counseling.

Identifying Adverse Events Using International Classification of Diseases, Tenth Revision Y Codes in Korea: A Cross-sectional Study

Objectives

The use of administrative data is an affordable alternative to conducting a difficult large-scale medical-record review to estimate the scale of adverse events. We identified adverse events from 2002 to 2013 on the national level in Korea, using International Classification of Diseases, tenth revision (ICD-10) Y codes.

Methods

We used data from the National Health Insurance Service-National Sample Cohort (NHIS-NSC). We relied on medical treatment databases to extract information on ICD-10 Y codes from each participant in the NHIS-NSC. We classified adverse events in the ICD-10 Y codes into 6 types: those related to drugs, transfusions, and fluids; those related to vaccines and immunoglobulin; those related to surgery and procedures; those related to infections; those related to devices; and others.

Results

Over 12 years, a total of 20 817 adverse events were identified using ICD-10 Y codes, and the estimated total adverse event rate was 0.20%. Between 2002 and 2013, the total number of such events increased by 131.3%, from 1366 in 2002 to 3159 in 2013. The total rate increased by 103.9%, from 0.17% in 2002 to 0.35% in 2013. Events related to drugs, transfusions, and fluids were the most common (19 446, 93.4%), followed by those related to surgery and procedures (1209, 5.8%) and those related to vaccines and immunoglobulin (72, 0.3%).

Conclusions

Based on a comparison with the results of other studies, the total adverse event rate in this study was significantly underestimated. Improving coding practices for ICD-10 Y codes is necessary to precisely monitor the scale of adverse events in Korea.

Measuring the Delivery of Complex Interventions through Electronic Medical Records: Challenges and Lessons Learned

Background:

Health services and implementation researchers often seek to capture the implementation process of complex interventions yet explicit guidance on how to capture this process is limited. Medical record review is a commonly used methodology, especially when used as a proxy for provider behavior, with recognized benefits and limitations. The purpose of this study was to test the feasibility of chart review to measure implementation and offer recommendations for future researchers using this method to capture the implementation process.

Methods:

Grounded in qualitative research methods, we measured the implementation of a transitional care intervention for older adults with dementia being discharged from the hospital. We adapted the operationalization of the intervention’s components to suit chart review methods, sought input from hospital providers before and after data collection, and assessed the agreement between the results of our chart review and provider-report.

Findings:

We believe chart review can be used effectively as a method for capturing the implementation process and provide future researchers with a list of recommendations based on our experience including understanding the nuance between data extraction versus data abstraction, allowing for large amounts of data not pre-specified in the data collection instrument to be collected, and purposefully and iteratively engaging the providers who are entering data into the chart.

Major Themes:

Measuring the implementation of complex interventions is a cornerstone in health services research and with the relative convenience and low costs of using chart data, we believe with more use and refinement this methodology could emerge as a valuable and widely used method in the field.

Measuring Quality Gaps in TB Screening in South Africa Using Standardised Patient Analysis

This is the first multi-district Standardised Patient (SP) study in South Africa. It measures the quality of TB screening at primary healthcare (PHC) facilities. We hypothesise that TB screening protocols and best practices are poorly adhered to at the PHC level. The SP method allows researchers to observe how healthcare providers identify, test and advise presumptive TB patients, and whether this aligns with clinical protocols and best practice. The study was conducted at PHC facilities in two provinces and 143 interactions at 39 facilities were analysed. Only 43% of interactions resulted in SPs receiving a TB sputum test and being offered an HIV test. TB sputum tests were conducted routinely (84%) while HIV tests were offered less frequently (47%). Nurses frequently neglected to ask SPs whether their household contacts had confirmed TB (54%). Antibiotics were prescribed without taking temperatures in 8% of cases. The importance of returning to the facility to receive TB test results was only explained in 28%. The SP method has highlighted gaps in clinical practice, signalling missed opportunities. Early detection of sub-optimal TB care is instrumental in decreasing TB-related morbidity and mortality. The findings provide the rationale for further quality improvement work in TB management.

Symptom-Disease Pair Analysis of Diagnostic Error (SPADE): a conceptual framework and methodological approach for unearthing misdiagnosis-related harms using big data

BACKGROUND

The public health burden associated with diagnostic errors is likely enormous, with some estimates suggesting millions of individuals are harmed each year in the USA, and presumably many more worldwide. According to the US National Academy of Medicine, improving diagnosis in healthcare is now considered 'a moral, professional, and public health imperative.' Unfortunately, well-established, valid and readily available operational measures of diagnostic performance and misdiagnosis-related harms are lacking, hampering progress. Existing methods often rely on judging errors through labour-intensive human reviews of medical records that are constrained by poor clinical documentation, low reliability and hindsight bias.

METHODS

Key gaps in operational measurement might be filled via thoughtful statistical analysis of existing large clinical, billing, administrative claims or similar data sets. In this manuscript, we describe a method to quantify and monitor diagnostic errors using an approach we call 'Symptom-Disease Pair Analysis of Diagnostic Error' (SPADE).

RESULTS

We first offer a conceptual framework for establishing valid symptom-disease pairs illustrated using the well-known diagnostic error dyad of dizziness-stroke. We then describe analytical methods for both look-back (case-control) and look-forward (cohort) measures of diagnostic error and misdiagnosis-related harms using 'big data'. After discussing the strengths and limitations of the SPADE approach by comparing it to other strategies for detecting diagnostic errors, we identify the sources of validity and reliability that undergird our approach.

CONCLUSION

SPADE-derived metrics could eventually be used for operational diagnostic performance dashboards and national benchmarking. This approach has the potential to transform diagnostic quality and safety across a broad range of clinical problems and settings.

Medical record keeping and system performance in orthopaedic trauma patients

Objective The medical record is critical for documentation and communication between healthcare professionals. The aim of the present study was to evaluate important aspects of the orthopaedic medical record and system performance to determine whether any deficiencies exist in these areas. Methods Review of 200 medical records of surgically treated traumatic lower limb injury patients was undertaken. The operative report, discharge summary and first and second outpatient reviews were evaluated. Results In all cases, an operative report was completed by a senior surgeon. Weight-bearing status was adequately documented in 91% of reports. Discharge summaries were completed for 82.5% of admissions, with 87.3% of these having instructions reflective of those in the operative report. Of first and second outpatient reviews, 69% and 73%, respectively, occurred within 1 week of the requested time. Previously documented management plans were changed in 30% of reviews. At 6-months post-operatively, 42% of patients had been reviewed by a member of their operating team. Discussion Orthopaedic medical record documentation remains an area for improvement. In addition, hospital out-patient systems perform suboptimally and may affect patient outcomes. What is known about the topic? Medical records are an essential tool in modern medical practice. Despite the importance of comprehensive documentation in the medical record, numerous examples of poor documentation have been demonstrated, including substandard documentation during consultant ward rounds by junior doctors leading to a breakdown in healthcare professional communication and potential patient mismanagement. Further inadequacies of medical record documentation have been demonstrated in surgical discharge notes, with complete and correct documentation reported to be as low as 65%. What does this paper add? Standards of patient care should be constantly monitored and deficiencies identified in order to implement a remedy and close the quality loop. The present study has highlighted that the standard of orthopaedic trauma medical record keeping at an Australian Level 1 trauma centre is below what is expected and several key areas of documentation require improvement. This paper further evaluates the system performance of the out-patient system, an area where, to the authors knowledge, there is no previous work published. The findings show that the performance was below what is expected for surgical review, with many patients failing to be reviewed by their operating surgeon. What are the implications for practitioners? The present study shows that there is a poor level of documentation and a standard of out-patient review below what is expected. The implications of these findings will be to highlight current deficiencies to practitioners and promote change in current practice to improve the quality of medical record documentation among medical staff. Further, the findings of poor system performance will promote change in the current system of delivering out-patient care to patients.

Optimizing Selection of Biologics in Inflammatory Bowel Disease: Development of an Online Patient Decision Aid Using Conjoint Analysis

OBJECTIVES

Recent drug approvals have increased the availability of biologic therapies for inflammatory bowel disease (IBD), making it difficult for patients with ulcerative colitis (UC) and Crohn's disease (CD) to navigate treatment options. Here we developed a conjoint analysis to examine patient decision-making surrounding biologic medicines for IBD. We used the results to create an online patient decision aid that generates a unique "preferences report" for each patient to assist with shared decision-making with their provider.

METHODS

We administered an adaptive choice-based conjoint survey to IBD patients that quantifies the relative importance of biologic attributes (e.g., efficacy, side effect profile, mode of administration, and mechanism of action) in decision making. The conjoint software determined individual patient preferences by calculating part-worth utilities for each attribute. We conducted regression analyses to determine if demographic and disease characteristics (e.g., type of IBD and severity) predicted how patients made decisions.

RESULTS

640 patients completed the survey (UC=304; CD=336). In regression analyses, demographics and IBD characteristics did not predict individual patient preferences; the main exception was IBD type. When compared to UC, CD patients were more likely to report side effect profile as most important (odds ratio (OR) 1.63, 95% confidence interval (CI) 1.16-2.30). Conversely, those with UC were more likely to value therapeutic efficacy (OR 1.41, 95% CI 1.01-2.00).

CONCLUSIONS

Biologic decision-making is highly personalized; demographic and disease characteristics poorly predict individual preferences, indicating that IBD patients are unique and difficult to statistically categorize. The online decision tool resulting from this study (www.ibdandme.org) may be used by patients to support shared decision-making and optimize personalized biologic selection with their provider.

Large-Scale Evaluation of Quality of Care in 6 Countries of Eastern Europe and Central Asia Using Clinical Performance and Value Vignettes

When providers in 6 different countries were asked how they would care for the same patient, there was wide variation within and between countries. Nevertheless, 11% of the physicians scored over 80%, suggesting good quality of care is possible even with resource constraints. Use of validated clinical vignettes, which can be applied affordably at scale, could help improve quality of services in low- and middle-income countries.

Background:

A significant determinant of population health outcomes is the quality of care provided for noncommunicable diseases, obstetric, and pediatric care. We present results on clinical practice quality in these areas as measured among nearly 4,000 providers working at more than 1,000 facilities in 6 Eastern European and Central Asian countries.

Methods:

This study was conducted between March 2011 and April 2013 in Albania, Armenia, Georgia, Kazakhstan, Kirov Province in Russia, and Tajikistan. Using a probability proportional-to-size sampling technique, based on number of hospital beds, we randomly selected within each country 42 hospitals and their associated primary health care clinics. Physicians and midwives within each clinical area of interest were randomly selected from each hospital and clinic and asked how they would care for simulated patients using Clinical Performance and Value (CPV) vignettes. Facility administrators were also asked to complete a facility survey to collect structural measures of quality. CPV vignettes were scored on a scale of 0% to 100% for each provider. We used descriptive statistics and t tests to identify significant differences in CPV scores between hospitals and clinics and rural vs. urban facilities, and ANOVA to identify significant differences in CPV scores across countries.

Results:

We found that quality of care, as concurrently measured by performance on CPV vignettes, was generally poor and widely variable within and between countries. Providers in Kirov Province, Russia, had the highest overall performance, with an average score of 70.8%, while providers in Albania and Tajikistan had the lowest average score, each at 50.8%. The CPV vignettes with the lowest scores were for multiple noncommunicable disease risk factors and birth asphyxia. A considerable proportion (11%) of providers performed well on the CPV vignettes, regardless of country, facility, or structural resources available to them.

Conclusions:

Countries of Eastern Europe and Central Asia are challenged by poor performance as measured by clinical care vignettes, but there is potential for provision of high-quality care by a sizable proportion of providers. Large-scale assessments of quality of care have been hampered by the lack of effective measurement tools that provide generalizable and reliable results across diverse economic, cultural, and social settings. The feasibility of quality measurement using CPV vignettes in these 6 countries and the ability to combine results with individual feedback could significantly enhance strategies to improve quality of care, and ultimately population health.

Chart-stimulated Recall as a Learning Tool for Improving Radiology Residents' Reports

RATIONALE AND OBJECTIVES

Workplace-based assessments gauge the highest tier of clinical competence. Chart-stimulated recall (CSR) is a workplace-based assessment method that complements chart audit with an interview based on the residents' notes. It allows evaluation of the residents' knowledge and heuristics while providing opportunities for feedback and self-reflection. We evaluated the utility of CSR for improving the radiology residents' reporting skills.

MATERIALS AND METHODS

Residents in each year of training were randomly assigned to an intervention group (n = 12) or a control group (n = 13). Five pre-intervention and five post-intervention reports of each resident were independently evaluated by three blinded reviewers using a modified Bristol Radiology Report Assessment Tool. The study intervention comprised a CSR interview tailored to each individual resident's learning needs based on the pre-intervention assessment. The CSR process focused on the clinical relevance of the radiology reports. Student's t test (P < .05) was used to compare pre- and post-intervention scores of each group.

RESULTS

A total of 125 pre-intervention and 125 post-intervention reports were evaluated (total 750 assessments). The Cronbach's alpha for the study tool was 0.865. A significant improvement was seen in the cumulative 19-item score (66% versus 73%, P < .001) and the global rating score (59% versus 72%, P < .001) of the intervention group after the CSR. The reports of the control group did not demonstrate any significant improvement.

CONCLUSION

CSR is a feasible workplace-based assessment method for improving reporting skills of the radiology residents.

Management of shoulder pain by UK general practitioners (GPs): a national survey

OBJECTIVES

Studies in Canada, the USA and Australia suggested low confidence among general practitioners (GPs) in diagnosing and managing shoulder pain, with frequent use of investigations. There are no comparable studies in the UK; our objective was to describe the diagnosis and management of shoulder pain by GPs in the UK.

METHODS

A national survey of a random sample of 5000 UK GPs collected data on shoulder pain diagnosis and management using two clinical vignettes that described primary care presentations with rotator cuff tendinopathy (RCT) and adhesive capsulitis (AdhC).

RESULTS

Seven hundred and fourteen (14.7%) responses were received. 56% and 83% of GPs were confident in their diagnosis of RCT and AdhC, respectively, and a wide range of investigations and management options were reported. For the RCT presentation, plain radiographs of the shoulder were most common (60%), followed by blood tests (42%) and ultrasound scans (USS) (38%). 19% of those who recommended a radiograph and 76% of those who recommended a USS did so 'to confirm the diagnosis'. For the AdhC presentation, the most common investigations were blood tests (60%), plain shoulder radiographs (58%) and USS (31%). More than two-thirds of those recommending a USS did so 'to confirm the diagnosis'. The most commonly recommended treatment for both presentations was physiotherapy (RCT 77%, AdhC 71%) followed by non-steroidal anti-inflammatory drugs (RCT 58%, AdhC 74%). 17% opted to refer the RCT to secondary care (most often musculoskeletal interface service), compared with 31% for the AdhC.

CONCLUSIONS

This survey of GPs in the UK highlights reliance on radiographs and blood tests in the management of common shoulder pain presentations. GPs report referring more than 7 out of 10 patients with RCT and AdhC to physiotherapists. These findings need to be viewed in the context of low response to the survey and, therefore, potential non-response bias.

The positive effect of a dedicated adolescent and young adult fertility program on the rates of documentation of therapy-associated infertility risk and fertility preservation options

PURPOSE

Minimal data exist regarding documentation of therapy-associated infertility risk (IR) and fertility preservation (FP) options during the initial oncology consultation prior to systemic therapy. This study investigated factors affecting IR/FP documentation and assessed the effect of implementation of an Adolescent and Young Adult (AYA) program on documentation rates.

METHODS

A retrospective review of charts of patients receiving gonadotoxic therapy was undertaken for documentation of IR/FP pre- and post-implementation of an AYA program. Change in documentation rates was assessed using univariate and multiple logistic regression.

RESULTS

A total of 173 charts were reviewed. On univariate analysis, IR/FP documentation was less likely if patients had metastatic disease (P < 0.01, P < 0.01), by tumor type (P < 0.01, P < 0.01), received less intensive chemotherapy (P = 0.03, P = 0.06), were older (P = 0.14, P < 0.01), had more children (P < 0.01, P < 0.01), or lacked AYA program involvement (P < 0.01, P < 0.01). FP discussion was more common in males (P = 0.02). On multivariable analysis, more children (P = 0.01, P = 0.03), older age (P < 0.01, P < 0.01), tumor type (P < 0.01, P = 0.01), stage (P = 0.02, NS), relationship (P = 0.03, NS), and lack of AYA involvement (P < 0.01, P < 0.01) were associated with lower rates of IR/FP documentation. Following AYA program implementation, IR/FP rates increased from 56% (CI 46-65%) to 85% (CI 74-92%, P < 0.01) and 54% (CI 45-64%) to 86% (CI 75-93%, P < 0.01), respectively. The effect of AYA program implementation on IR/FP documentation was most noticeable in leukemia, lymphoma, and breast groups (P < 0.01).

CONCLUSIONS

Implementing an AYA consultation service at an adult cancer institution had a positive effect on the rates of IR/FP documentation. Specific programming can improve service delivery to AYA cancer patients, and fertility counseling should be integrated for patients undergoing gonadotoxic therapy.

GPs' approaches to documenting stigmatising information: a qualitative study

BACKGROUND

Complete medical documentation is essential for continuity of care, but the competing need to protect patient confidentiality presents an ethical dilemma. This is particularly poignant for GPs because of their central role in facilitating continuity.

AIM

To examine how GPs manage medical documentation of stigmatising mental health (MH) and non-MH information.

DESIGN AND SETTING

A qualitative sub-study of a factorial experiment with GPs practising in Massachusetts, US.

METHOD

Semi-structured interviews (n = 128) were audiorecorded and transcribed verbatim. Transcripts were coded and analysed for themes.

RESULTS

GPs expressed difficulties with and inconsistent strategies for documenting stigmatising information. Without being asked directly about stigmatising information, 44 GPs (34%) expressed difficulties documenting it: whether to include clinically relevant but sensitive information, how to word it, and explaining to patients the importance of including it. Additionally, 75 GPs (59%) discussed strategies for managing documentation of stigmatising information. GPs reported four strategies that varied by type of information: to exclude stigmatising information to respect patient confidentiality (MH: 26%, non-MH: 43%); to include but restrict access to information (MH: 13%, non-MH: 25%); to include but neutralise information to minimise potential stigma (MH: 26%, non-MH: 29%); and to include stigmatising information given the potential impact on care (MH: 68%, non-MH: 32%).

CONCLUSION

Lack of consistency undermines the potential of medical documentation to efficiently facilitate continuous, coordinated health care because providers cannot be certain how to interpret what is or is not in the chart. A proactive consensus process within the field of primary care would provide much needed guidance for GPs and, ultimately, could enhance quality of care.

Medical Record Versus Researcher Measures of Height and Weight

This study examined the extent of agreement between medical record and researcher measures of height and weight in adults and assessed the clinical significance of any resulting differences in body mass index (BMI) (kg/m 2 ) according to the categorizations of underweight, normal weight, and overweight. Medical record and researcher measurements for height (n = 85), preoperative weight (n = 84), and postoperative weight (n = 65) in older patients undergoing elective coronary artery bypass grafting were used for analysis. Researcher measurements of height and weight were obtained by the same person and were compared to height and weight measurements extracted from the medical record. Bland and Altman’s limits of agreement method was used to determine the extent of measurement error between medical record and researcher values. Cohen’s kappa was used to assess for clinical significance of the differences in BMI categories based on medical record and researcher measurements. For height, 7% of the values were outside the 95% limits of agreement. For preoperative and postoperative weight, less than 5% of the values were outside the 95% limits of agreement. There were no significant differences in BMI categorization using Cohen’s kappa between medical record and researcher measurements. Although there may be some measurement error for height in the medical record, weight measurements may have less error and the amount of measurement error may not be clinically relevant. Height and weight measurements extracted from the medical record are reliable and accurate in patients admitted for elective surgery, as are weight measurements obtained in stable postoperative patients.

Development of the Quality Data Collection Tool for Prospective Quality Assessment and Reporting in Palliative Care

BACKGROUND

Assessing and reporting the quality of care provided are increasingly important in palliative care, but we currently lack practical, efficient approaches for collection and reporting.

OBJECTIVE

In response, the Global Palliative Care Quality Alliance ("Alliance") sought to create a Quality Data Collection Tool for Palliative Care (QDACT-PC).

METHODS

We collaboratively and iteratively developed QDACT-PC, an electronic, point-of-care quality monitoring system for palliative care that supports prospective quality assessment and reporting in any clinical setting. QDACT-PC is the web-based data collection and reporting interface. Quality measures selected to be used in QDACT-PC were derived from a systematic review summarizing all published palliative care quality measure sets; Alliance clinical providers prioritized measures to be included in QDACT-PC to ensure maximal clinical relevance. Data elements and variables required to ascertain conformance to all selected quality measures were included in the QDACT-PC data dictionary. Whenever possible, variables collected in QDACT-PC align with validated surveys and/or nationally recognized common data elements. QDACT-PC data elements and software programmed business rules inform real-time assessments of conformance to selected quality measures. Data are deposited into a centralized registry for future analyses.

RESULTS

QDACT-PC can be used to report on >80% of all published palliative care quality measures and 100% of high-priority measure.

CONCLUSION

Electronic methods for collecting point-of-care quality monitoring data can be developed using collaborative partnerships between community and academic palliative care providers. Feasibility testing and creation of feedback reports are ongoing.

Competence of health workers in emergency obstetric care: an assessment using clinical vignettes in Brong Ahafo region, Ghana

OBJECTIVES

To assess health worker competence in emergency obstetric care using clinical vignettes, to link competence to availability of infrastructure in facilities, and to average annual delivery workload in facilities.

DESIGN

Cross-sectional Health Facility Assessment linked to population-based surveillance data.

SETTING

7 districts in Brong Ahafo region, Ghana.

PARTICIPANTS

Most experienced delivery care providers in all 64 delivery facilities in the 7 districts.

PRIMARY OUTCOME MEASURES

Health worker competence in clinical vignette actions by cadre of delivery care provider and by type of facility. Competence was also compared with availability of relevant drugs and equipment, and to average annual workload per skilled birth attendant.

RESULTS

Vignette scores were moderate overall, and differed significantly by respondent cadre ranging from a median of 70% correct among doctors, via 55% among midwives, to 25% among other cadres such as health assistants and health extension workers (p<0.001). Competence varied significantly by facility type: hospital respondents, who were mainly doctors and midwives, achieved highest scores (70% correct) and clinic respondents scored lowest (45% correct). There was a lack of inexpensive key drugs and equipment to carry out vignette actions, and more often, lack of competence to use available items in clinical situations. The average annual workload was very unevenly distributed among facilities, ranging from 0 to 184 deliveries per skilled birth attendant, with higher workload associated with higher vignette scores.

CONCLUSIONS

Lack of competence might limit clinical practice even more than lack of relevant drugs and equipment. Cadres other than midwives and doctors might not be able to diagnose and manage delivery complications. Checking clinical competence through vignettes in addition to checklist items could contribute to a more comprehensive approach to evaluate quality of care.

TRIAL REGISTRATION NUMBER

NCT00623337.