1
|
Sheringham J, Kuhn I, Burt J. The use of experimental vignette studies to identify drivers of variations in the delivery of health care: a scoping review. BMC Med Res Methodol 2021; 21:81. [PMID: 33888077 PMCID: PMC8061048 DOI: 10.1186/s12874-021-01247-4] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2020] [Accepted: 02/23/2021] [Indexed: 11/10/2022] Open
Abstract
Background Identifying how unwarranted variations in healthcare delivery arise is challenging. Experimental vignette studies can help, by isolating and manipulating potential drivers of differences in care. There is a lack of methodological and practical guidance on how to design and conduct these studies robustly. The aim of this study was to locate, methodologically assess, and synthesise the contribution of experimental vignette studies to the identification of drivers of unwarranted variations in healthcare delivery. Methods We used a scoping review approach. We searched MEDLINE, Embase, Web of Science and CINAHL databases (2007–2019) using terms relating to vignettes and variations in healthcare. We screened title/abstracts and full text to identify studies using experimental vignettes to examine drivers of variations in healthcare delivery. Included papers were assessed against a methodological framework synthesised from vignette study design recommendations within and beyond healthcare. Results We located 21 eligible studies. Study participants were almost exclusively clinicians (18/21). Vignettes were delivered via text (n = 6), pictures (n = 6), video (n = 6) or interactively, using face-to-face, telephone or online simulated consultations (n = 3). Few studies evaluated the credibility of vignettes, and many had flaws in their wider study design. Ten were of good methodological quality. Studies contributed to understanding variations in care, most commonly by testing hypotheses that could not be examined directly using real patients. Conclusions Experimental vignette studies can be an important methodological tool for identifying how unwarranted variations in care can arise. Flaws in study design or conduct can limit their credibility or produce biased results. Their full potential has yet to be realised. Supplementary Information The online version contains supplementary material available at 10.1186/s12874-021-01247-4.
Collapse
Affiliation(s)
- Jessica Sheringham
- Department of Applied Health Research, UCL, 1-19 Torrington Place, London, WC1E 7HB, UK.
| | - Isla Kuhn
- The Healthcare Improvement Studies (THIS) Institute, University of Cambridge, Cambridge Biomedical Campus, Clifford Allbutt Building, Cambridge, CB2 0AH, UK
| | - Jenni Burt
- The Healthcare Improvement Studies (THIS) Institute, University of Cambridge, Cambridge Biomedical Campus, Clifford Allbutt Building, Cambridge, CB2 0AH, UK
| |
Collapse
|
2
|
Piccardi C, Detollenaere J, Vanden Bussche P, Willems S. Social disparities in patient safety in primary care: a systematic review. Int J Equity Health 2018; 17:114. [PMID: 30086754 PMCID: PMC6081855 DOI: 10.1186/s12939-018-0828-7] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2018] [Accepted: 07/20/2018] [Indexed: 11/28/2022] Open
Abstract
BACKGROUND Patient safety is a quality indicator for primary care and it should be based on individual needs, and not differ among different social groups. Nevertheless, the attention on social disparities in patient safety has been mainly directed towards the hospital care, often overlooking the primary care setting. Therefore, this paper aims to synthesise social disparities in patient safety in the primary care setting. METHODS The Databases PubMed and Web of Science were searched for relevant studies published between January 1st 2006 and January 31st 2017. Papers investigating racial, gender and socioeconomic disparities in regards to administrative errors, diagnostic errors, medication errors and transition of care errors in primary care were included. No distinction in terms of participants' age was made. RESULTS Women and black patients are more likely to experience patient safety events in primary care, although it depends on the type of disease, treatment, and healthcare service. The available literature largely describes gender and ethnic disparities in the different patient safety domains whilst income and educational level are studied to a lesser extent. CONCLUSIONS The results of this systematic review suggest that vulnerable social groups are likely to experience adverse patient safety events in primary care. Enhancing family doctors' awareness of these inequities is a necessary first step to tackle them and improve patient safety for all patients. Future research should focus on social disparities in patient safety using socioeconomic indicators, such as income and education.
Collapse
Affiliation(s)
- Carlotta Piccardi
- Department of Family Medicine and Primary Health Care, Ghent University, Campus UZ, 6K3, C Heymanslaan 10, 9000 Ghent, Belgium
| | - Jens Detollenaere
- Department of Family Medicine and Primary Health Care, Ghent University, Campus UZ, 6K3, C Heymanslaan 10, 9000 Ghent, Belgium
| | - Pierre Vanden Bussche
- Department of Family Medicine and Primary Health Care, Ghent University, Campus UZ, 6K3, C Heymanslaan 10, 9000 Ghent, Belgium
- European Association for Quality and Patient Safey in Primary Care (WONCA Europe Network), Copenhagen, Denmark
| | - Sara Willems
- Department of Family Medicine and Primary Health Care, Ghent University, Campus UZ, 6K3, C Heymanslaan 10, 9000 Ghent, Belgium
- European Association for Quality and Patient Safey in Primary Care (WONCA Europe Network), Copenhagen, Denmark
- Centre for the Social Study of Migration and Refugees (CESSMIR), Ghent University, Ghent, Belgium
| |
Collapse
|
3
|
Ewen SC, Barrett J, Paul D, Askew D, Webb G, Wilkin A. When a patient's ethnicity is declared, medical students' decision-making processes are affected. Intern Med J 2015; 45:805-12. [DOI: 10.1111/imj.12800] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2014] [Accepted: 04/27/2015] [Indexed: 10/23/2022]
Affiliation(s)
- S. C. Ewen
- Melbourne Poche Centre for Indigenous Health; Faculty of Medicine; Dentistry and Health Sciences; The University of Melbourne; Melbourne Victoria Australia
| | - J. Barrett
- Melbourne Poche Centre for Indigenous Health; Faculty of Medicine; Dentistry and Health Sciences; The University of Melbourne; Melbourne Victoria Australia
| | - D. Paul
- Aboriginal Health; School of Medicine; University of Notre Dame; Fremantle Western Australia Australia
| | - D. Askew
- Southern Queensland Centre of Excellence in Aboriginal and Torres Strait Islander Primary Health Care; Queensland Health; Brisbane Queensland Australia
- Discipline of General Practice; The University of Queensland; Brisbane Queensland Australia
| | - G. Webb
- School of Health Sciences; The University of Melbourne; Melbourne Victoria Australia
| | - A. Wilkin
- Melbourne School of Population and Global Health; Faculty of Medicine; Dentistry and Health Sciences; The University of Melbourne; Melbourne Victoria Australia
| |
Collapse
|
4
|
Welch LC, Litman HJ, Borba CPC, Vincenzi B, Henderson DC. Does a Physician's Attitude toward a Patient with Mental Illness Affect Clinical Management of Diabetes? Results from a Mixed-Method Study. Health Serv Res 2014; 50:998-1020. [PMID: 25487069 DOI: 10.1111/1475-6773.12267] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/31/2022] Open
Abstract
OBJECTIVE To determine whether physician's attitudes toward patients with comorbid mental illness affect management of a chronic disease. DATA SOURCE A total of 256 primary care physicians interviewed in 2010. STUDY DESIGN This randomized factorial experiment entailed physicians observing video vignettes of patient-actors with poorly controlled diabetes. Patients were balanced across age, gender, race, and comorbidity (schizophrenia with bizarre or normal affect, depression, eczema). DATA COLLECTION Physicians completed structured and semistructured interviews plus chart notes about clinical management and attitudes. PRINCIPAL FINDINGS Physicians reported more negative attitudes for patients with schizophrenia with bizarre affect (SBA). There were few differences in clinical decisions measured quantitatively or in charting, but qualitative data revealed less trust of patients with SBA as reporters, with more reliance on sources other than engaging the patient in care. Physicians often alerted colleagues about SBA, thereby shaping expectations before interactions occurred. CONCLUSIONS Results are consistent with common stereotypes about people with serious mental illness. Vignettes did not include intentional indication of unreliable reporting or danger. Reducing health care disparities requires attention to subtle aspects of managing patients--particularly those with atypical affect--as seemingly slight differences could engender disparate patient experiences over time.
Collapse
Affiliation(s)
- Lisa C Welch
- Tufts Clinical and Translational Science Institute, Tufts Medical Center, Boston, MA
| | - Heather J Litman
- Clinical Research Center, Boston Children's Hospital, 300 Longwood Avenue, Boston, MA
| | - Christina P C Borba
- Schizophrenia Clinical and Research Program, Massachusetts General Hospital, Boston, MA.,Department of Psychiatry, Harvard Medical School, Boston, MA
| | - Brenda Vincenzi
- Schizophrenia Clinical and Research Program, Massachusetts General Hospital, Boston, MA
| | - David C Henderson
- Schizophrenia Clinical and Research Program, Massachusetts General Hospital, Boston, MA.,Department of Psychiatry, Harvard Medical School, Boston, MA
| |
Collapse
|
5
|
Bagheri N, McRae I, Konings P, Butler D, Douglas K, Del Fante P, Adams R. Undiagnosed diabetes from cross-sectional GP practice data: an approach to identify communities with high likelihood of undiagnosed diabetes. BMJ Open 2014; 4:e005305. [PMID: 25056976 PMCID: PMC4120432 DOI: 10.1136/bmjopen-2014-005305] [Citation(s) in RCA: 18] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/03/2022] Open
Abstract
OBJECTIVES To estimate undiagnosed diabetes prevalence from general practitioner (GP) practice data and identify areas with high levels of undiagnosed and diagnosed diabetes. DESIGN Data from the North-West Adelaide Health Survey (NWAHS) were used to develop a model which predicts total diabetes at a small area. This model was then applied to cross-sectional data from general practices to predict the total level of expected diabetes. The difference between total expected and already diagnosed diabetes was defined as undiagnosed diabetes prevalence and was estimated for each small area. The patterns of diagnosed and undiagnosed diabetes were mapped to highlight the areas of high prevalence. SETTING North-West Adelaide, Australia. PARTICIPANTS This study used two population samples-one from the de-identified GP practice data (n=9327 active patients, aged 18 years and over) and another from NWAHS (n=4056, aged 18 years and over). MAIN OUTCOME MEASURES Total diabetes prevalence, diagnosed and undiagnosed diabetes prevalence at GP practice and Statistical Area Level 1. RESULTS Overall, it was estimated that there was one case of undiagnosed diabetes for every 3-4 diagnosed cases among the 9327 active patients analysed. The highest prevalence of diagnosed diabetes was seen in areas of lower socioeconomic status. However, the prevalence of undiagnosed diabetes was substantially higher in the least disadvantaged areas. CONCLUSIONS The method can be used to estimate population prevalence of diabetes from general practices wherever these data are available. This approach both flags the possibility that undiagnosed diabetes may be a problem of less disadvantaged social groups, and provides a tool to identify areas with high levels of unmet need for diabetes care which would enable policy makers to apply geographic targeting of effective interventions.
Collapse
Affiliation(s)
- Nasser Bagheri
- Australian Primary Health Care Research Institute, Australian National University, Canberra, Australia
| | - Ian McRae
- Australian Primary Health Care Research Institute, Australian National University, Canberra, Australia
| | - Paul Konings
- Australian Primary Health Care Research Institute, Australian National University, Canberra, Australia
| | - Danielle Butler
- Australian Primary Health Care Research Institute, Australian National University, Canberra, Australia
| | - Kirsty Douglas
- Department of General Practice, School of Medicine, Australian National University, Canberra, Australia
| | | | - Robert Adams
- School of Medicine, University of Adelaide, Adelaide, Australia
| |
Collapse
|
6
|
Maserejian NN, Fischer MA, Trachtenberg FL, Yu J, Marceau LD, McKinlay JB, Katz JN. Variations among primary care physicians in exercise advice, imaging, and analgesics for musculoskeletal pain: results from a factorial experiment. Arthritis Care Res (Hoboken) 2014; 66:147-56. [PMID: 24376249 PMCID: PMC4067704 DOI: 10.1002/acr.22143] [Citation(s) in RCA: 31] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2013] [Accepted: 08/20/2013] [Indexed: 11/11/2022]
Abstract
OBJECTIVE To examine whether medical decisions regarding evaluation and management of musculoskeletal pain conditions varied systematically by characteristics of the patient or provider. METHODS We conducted a balanced factorial experiment among primary care physicians in the US. Physicians (n = 192) viewed 2 videos of different patients (actors) presenting with pain: undiagnosed sciatica symptoms or diagnosed knee osteoarthritis. Systematic variations in patient gender, socioeconomic status, and race and physician gender and experience (<20 versus ≥20 years in practice) permitted estimation of unconfounded effects. Analysis of variance was used to evaluate associations between patient or provider attributes and clinical decisions. Quality of decisions was defined based on the current recommendations of the American College of Rheumatology, American Pain Society, and clinical expert consensus. RESULTS Despite current recommendations, less than one-third of physicians would provide exercise advice (30.2% for osteoarthritis and 32.8% for sciatica). Physicians with fewer years in practice were more likely to provide advice on lifestyle changes, particularly exercise (P ≤ 0.01), and to prescribe nonsteroidal antiinflammatory drugs for pain relief, both of which were appropriate and consistent with current recommendations for care. Newer physicians ordered fewer tests, particularly basic laboratory investigations or urinalysis. Test ordering decreased as organizational emphasis on business or profits increased. Patient factors and physician gender had no consistent effects on pain evaluation or treatment. CONCLUSION Physician education on disease management recommendations regarding exercise and analgesics and implementation of quality measures may be useful, particularly for physicians with more years in practice.
Collapse
|
7
|
Trachtenberg FL, Pober DM, Welch LC, McKinlay JB. Physician styles of decision-making for a complex condition: Type 2 diabetes with co-morbid mental illness. EUROPEAN JOURNAL FOR PERSON CENTERED HEALTHCARE 2014; 2:465-476. [PMID: 25798289 DOI: 10.5750/ejpch.v2i4.831] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
Abstract
RATIONALE AIMS AND OBJECTIVES Variation in physician decisions may reflect personal styles of decision-making, as opposed to singular clinical actions and these styles may be applied differently depending on patient complexity. The objective of this study is to examine clusters of physician decision-making for type 2 diabetes, overall and in the presence of a mental health co-morbidity. METHOD This randomized balanced factorial experiment presented video vignettes of a "patient" with diagnosed, but uncontrolled type 2 diabetes. "Patients" were systematically varied by age, sex, race and co-morbidity (depression, schizophrenia with normal or bizarre affect, eczema as control). Two hundred and fifty-six primary care physicians, balanced by gender and experience level, completed a structured interview about clinical management. RESULTS Cluster analysis identified 3 styles of diabetes management. "Minimalists" (n=84) performed fewer exams or tests compared to "middle of the road" physicians (n=84). "Interventionists" (n=88) suggested more medications and referrals. A second cluster analysis, without control for co-morbidities, identified an additional cluster of "information seekers" (n=15) who requested more additional information and referrals. Physicians ranking schizophrenia higher than diabetes on their problem list were more likely "minimalists" and none were "interventionists" or "information seekers". CONCLUSIONS Variations in clinical management encompass multiple clinical actions and physicians subtly shift these decision-making styles depending on patient co-morbidities. Physicians' practice styles may help explain persistent differences in patient care. Training and continuing education efforts to encourage physicians to implement evidence-based clinical practice should account for general styles of decision-making and for how physicians process complicating comorbidities.
Collapse
Affiliation(s)
- Felicia L Trachtenberg
- Principal Research Scientist and Biostatistician, New England Research Institutes, Watertown, MA, USA
| | - David M Pober
- Mary K. Iacocca Visiting Interdisciplinary Faculty Fellow, Vascular Cell Biology, Joslin Diabetes Center & Visiting Assistant Professor of Medicine, Harvard Medical School, Boston, MA, USA
| | - Lisa C Welch
- Director, Clinical and Translational Science Institute, Boston, MA, USA
| | - John B McKinlay
- Senior Vice President; Co-director, Health Services and Disparities Research, New England Research Institutes, Watertown, MA, USA
| |
Collapse
|
8
|
McKinlay J, Piccolo R, Marceau L. An additional cause of health care disparities: the variable clinical decisions of primary care doctors. J Eval Clin Pract 2013; 19:664-73. [PMID: 23216876 PMCID: PMC3729756 DOI: 10.1111/jep.12015] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 10/18/2012] [Indexed: 12/28/2022]
Abstract
RATIONALE, AIMS AND OBJECTIVES Decades of work on health disparities have culminated in identification of three contributors to variability in diagnosis and management of disease: (i) patient attributes; (ii) doctor's characteristics; and (iii) organizational factors. Understanding the relative influence of different contributors to variability in diagnosis and management of diabetes is important to improving quality and reducing disparities. This study was designed to examine the influence of patient, provider and organizational factors on the diagnosis and management of a major chronic disease - diabetes. METHOD A factorial experiment using video vignettes was conducted among n = 192 primary care doctors. Doctors were interviewed after viewing vignettes of (1) a 'patient' with symptoms strongly suggestive of diabetes and (2) an already diagnosed diabetes 'patient' with emerging peripheral neuropathy. RESULTS A total of 60.9% of doctors identified diabetes as the correct diagnosis, with significant variations depending on the patients' race/ethnicity. Many doctors offered competing diagnoses with high levels of certainty. For the 'patient' with emerging peripheral neuropathy, 42.2% of doctors would do all essential components of a foot examination, while 21.9% would do none. CONCLUSIONS That half of all diabetes in the United States remains undiagnosed is unsurprising given only 60.9% of doctors would diagnose it when the condition is strongly suggested, and nearly one-quarter suspecting diabetes would not order tests necessary to confirm it. The diagnosis of diabetes is significantly influenced by a patient's race/ethnicity, and clinical management (specifically for foot neuropathy) is influenced by patient socio-economic status (SES), doctor's gender and access to clinical guidelines.
Collapse
Affiliation(s)
- John McKinlay
- Health Services and Disparities Research, New England Research Institutes, Watertown, Massachusetts 02472, USA.
| | | | | |
Collapse
|
9
|
Piccolo RS, Araujo AB, Pearce N, McKinlay JB. Cohort profile: the Boston Area Community Health (BACH) survey. Int J Epidemiol 2012; 43:42-51. [PMID: 23220718 DOI: 10.1093/ije/dys198] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/15/2023] Open
Abstract
The Boston Area Community Health (BACH) Survey is a community-based, random sample, epidemiologic cohort of n = 5502 Boston (MA) residents. The baseline BACH Survey (2002-05) was designed to explore the mechanisms conferring increased health risks on minority populations with a particular focus on urologic signs/symptoms and type 2 diabetes. To this end, the cohort was designed to include adequate numbers of US racial/ethnic minorities (Black, Hispanic, White), both men and women, across a broad age of distribution. Follow-up surveys were conducted ∼5 (BACH II, 2008) and 7 (BACH III, 2010) years later, which allows for both within- and between-person comparisons over time. The BACH Survey's measures were designed to cover the following seven broad categories: socio-demographics, health care access/utilization, lifestyles, psychosocial factors, health status, physical measures and biochemical parameters. The breadth of measures has allowed BACH researchers to identify disparities and quantify contributions to social disparities in a number of health conditions including urologic conditions (e.g. nocturia, lower urinary tract symptoms, prostatitis), type 2 diabetes, obesity, bone mineral content and density, and physical function. BACH I data are available through the National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK) Central Repositories (www.niddkrepository.org). Further inquiries can be made through the New England Research Institutes Inc. website (www.neriscience.com/epidemiology).
Collapse
Affiliation(s)
- Rebecca S Piccolo
- Institute for Health Services and Disparities Research, New England Research Institutes, Watertown, MA, USA and Department of Medical Statistics, London School of Hygiene and Tropical Medicine, London, UK
| | | | | | | |
Collapse
|