Mind the Mode: Differences in Paper vs. Web-Based Survey Modes Among Women With Cancer

Psychometric Assessment of an Item Bank for Adaptive Testing on Patient-Reported Experience of Care Environment for Severe Mental Illness: Validation Study

BACKGROUND

The care environment significantly influences the experiences of patients with severe mental illness and the quality of their care. While a welcoming and stimulating environment enhances patient satisfaction and health outcomes, psychiatric facilities often prioritize staff workflow over patient needs. Addressing these challenges is crucial to improving patient experiences and outcomes in mental health care.

OBJECTIVE

This study is part of the Patient-Reported Experience Measure for Improving Quality of Care in Mental Health (PREMIUM) project and aims to establish an item bank (PREMIUM-CE) and to develop computerized adaptive tests (CATs) to measure the experience of the care environment of adult patients with schizophrenia, bipolar disorder, or major depressive disorder.

METHODS

We performed psychometric analyses including assessments of item response theory (IRT) model assumptions, IRT model fit, differential item functioning (DIF), item bank validity, and CAT simulations.

RESULTS

In this multicenter cross-sectional study, 498 patients were recruited from outpatient and inpatient settings. The final PREMIUM-CE 13-item bank was sufficiently unidimensional (root mean square error of approximation=0.082, 95% CI 0.067-0.097; comparative fit index=0.974; Tucker-Lewis index=0.968) and showed an adequate fit to the IRT model (infit mean square statistic ranging between 0.7 and 1.0). DIF analysis revealed no item biases according to gender, health care settings, diagnosis, or mode of study participation. PREMIUM-CE scores correlated strongly with satisfaction measures (r=0.69-0.78; P<.001) and weakly with quality-of-life measures (r=0.11-0.21; P<.001). CAT simulations showed a strong correlation (r=0.98) between CAT scores and those of the full item bank, and around 79.5% (396/498) of the participants obtained a reliable score with the administration of an average of 7 items.

CONCLUSIONS

The PREMIUM-CE item bank and its CAT version have shown excellent psychometric properties, making them reliable measures for evaluating the patient experience of the care environment among adults with severe mental illness in both outpatient and inpatient settings. These measures are a valuable addition to the existing landscape of patient experience assessment, capturing what truly matters to patients and enhancing the understanding of their care experiences.

TRIAL REGISTRATION

ClinicalTrials.gov NCT02491866; https://clinicaltrials.gov/study/NCT02491866.

Self-Efficacy in Nepali Adults With Musculoskeletal Pain: Measurement Properties of Hard-Copy and Online Versions of the Pain Self-Efficacy Questionnaire

The Pain Self-Efficacy Questionnaire (PSEQ) is commonly used in pain self-efficacy research. Yet its Nepali translation is unavailable, limiting the ability to conduct cross-cultural research on the role of self-efficacy in musculoskeletal pain and its management. This study aimed to 1) translate and culturally adapt the 10-item (PSEQ-10) and 2-item (PSEQ-2) versions of the PSEQ into Nepali, 2) evaluate their measurement properties in Nepali adults with musculoskeletal pain, and 3) evaluate whether the type of administration (ie, hard-copy vs online) affected their measurement properties. The measurement properties of different administrations of the Nepali PSEQ-10 and PSEQ-2 were evaluated in 180 Nepali adults (120 hard-copy and 60 online administrations) with musculoskeletal pain. We conducted confirmatory factor analyses and estimated the measures' internal consistencies, test-retest reliabilities, and smallest detectable changes using standard error of measurement. We planned to conclude that the measures were valid if ≥ 75% of the validity hypotheses were supported. The results supported unidimensionality for the Nepali PSEQ-10. The Nepali PSEQ-2 and PSEQ-10 evidenced excellent internal consistencies (Cronbach alphas = .90-.95) and good to excellent test-retest reliabilities (intraclass correlation coefficient = .61-.85) for both administrations. Construct validity (r's ≥ .20) and concurrent validity (r's ≥ .83) were supported, as hypothesized. Both hard-copy and online administrations of the Nepali PSEQ-2 and PSEQ-10 are similar, reliable, and valid ways to assess self-efficacy in Nepali adults with musculoskeletal pain. The findings should facilitate telehealth and cross-cultural research on pain self-efficacy in Nepal. PERSPECTIVE: This is the first Nepali adaptation of a self-efficacy scale with testing of measurement properties for hard-copy and online administrations. It will facilitate the assessment of pain self-efficacy in clinical practice and research and facilitate a deeper cross-cultural understanding of the role of self-efficacy in musculoskeletal pain.

New measures to assess the "Other" three pillars of food security-availability, utilization, and stability

BACKGROUND

In recent reviews of available measures, no existing measures assessed all four pillars of food security and most only assessed one or two pillars-predominantly the access pillar. The purpose of this study was to preliminarily develop novel measures of availability, utilization, and stability that are complementary to the USDA's household food security survey measure (HFSSM).

METHODS

A formative phase included an expert advisory group, literature scans, and interviews with individuals experiencing food insecurity. From April-June 2021, the new measures were piloted in five states (California, Florida, Maryland, North Carolina, and Washington). The cross-sectional pilot survey included the new measures (perceived limited availability, utilization barriers, and food insecurity stability), scales and items for validation (e.g., food security, and self-reported dietary and health outcomes), and demographic questions. Exploratory factor analysis was used to assess dimensionality, internal consistency was assessed using Kuder-Richardson formula 21 (KR21), and convergent and discriminant validity were assessed using Spearman's correlation coefficients. Also, a brief screener version was created for the utilization barriers measure that may be necessary for certain applications (e.g., clinical intake screening to inform referrals to assistance programs).

RESULTS

The analytic samples (perceived limited availability (n = 334); utilization barriers (n = 428); food insecurity stability (n = 445)) were around 45 years old on average, most households had children, over two-thirds were food insecure, over three-fourths were women, and the samples were racially/ethnically diverse. All items loaded highly and unambiguously to a factor (factor loadings range 0.525-0.903). Food insecurity stability showed a four-factor structure, utilization barriers showed a two-factor structure, and perceived limited availability showed a two-factor structure. KR21 metrics ranged from 0.72 to 0.84. Higher scores for the new measures were generally associated with increased food insecurity (rhos = 0.248-0.497), except for one of the food insecurity stability scores. Also, several of the measures were associated with statistically significantly worse health and dietary outcomes.

CONCLUSIONS

The findings support the reliability and construct validity of these new measures within a largely low-income and food insecure sample of households in the United States. Following further testing, such as Confirmatory Factor Analysis in future samples, these measures may be used in various applications to promote a more comprehensive understanding of the food insecurity experience. Such work can help inform novel intervention approaches to address food insecurity more fully.

Assessing targeted invitation and response modes to improve survey participation in a diverse New York City panel: Healthy NYC

BACKGROUND

Healthy NYC is an innovative survey panel created by the New York City (NYC) Department of Health and Mental Hygiene (DOHMH) that offers a cost-effective mechanism for collecting priority and timely health information. Between November 2020 and June 2021, invitations for six different surveys were sent to Healthy NYC panelists by postal mail, email, and text messages. Panelists had the option to complete surveys online or via paper survey.

METHODS

We analyzed whether panelists varied by sociodemographic characteristics based on the contact mode they provided and the type of invitation that led to their response using logistic regression models. Poisson regression models were used to determine whether the number of invitations received before participating in a survey was associated with sociodemographic characteristics.

RESULTS

Younger age and higher education were positively associated with providing an email or text contact. Furthermore, age, race, and income were significant predictors for invitation modes that led to a survey response. Black panelists had 72% greater odds (OR 1.72 95% CI: 1.11-2.68) of responding to a mail invite and 33% lesser odds (OR 0.67, 95% CI: 0.54-0.83) of responding to an email invite compared with White panelists. Additionally, in five of the six surveys, more than half of the respondents completed surveys after two invites. Email invitations garnered the highest participation rates.

CONCLUSIONS

We recommend using targeted invitation modes as an additional strategy to improve participation in panels. For lower-income panelists who do not provide an email address, it may be reasonable to offer additional response options that do not require internet access. Our study's findings provide insight into how panels can tailor outreach to panelists, especially among underrepresented groups, in the most economical and efficient ways.

Development of three new multidimensional measures to assess household food insecurity resilience in the United States

Introduction

This study aimed to develop and test novel self-administered measures (Absorptive capacity, Adaptive capacity, and Transformative capacity) of three aspects of a household's resilience to financial shocks (e.g., job loss) that can increase food insecurity risk.

Methods

Measures were piloted in a convenience sample of households at risk for food insecurity in the United States. The survey included the new measures, validation variables (financial shock, household food security, general health, personal resilience to challenges, and financial wellbeing), and demographic questions. Exploratory factor analysis was used to assess dimensionality, internal consistency was assessed [Cronbach's alpha (CA)], and construct validity was assessed (Spearman's correlation). Also, brief screener versions of the full measures were created.

Results

Participants in the analytic samples (n = 220-394) averaged 44 years old, 67% experienced food insecurity, 47% had a high school diploma or less, 72% were women, and the sample was racially/ethnically diverse. Scores for Absorptive capacity [one factor; CA = 0.70; Mean = 1.32 (SD = 0.54)], Adaptive capacity [three factors; CAs 0.83-0.90; Mean = 2.63 (SD = 0.85)], and Transformative capacity [three factors; CAs 0.87-0.95; Mean = 2.70 (SD = 1.10)] were negatively associated with financial shocks (-0.221 to -0.307) and positively associated with food insecurity (0.310-0.550) general health (0.255-0.320), personal resilience (0.231-0.384), and financial wellbeing (0.401-0.474).

Discussion

These findings are encouraging and support reliability and validity of these new measures within this sample. Following further testing, such as Confirmatory Factor Analysis in future samples, these measures may prove useful for needs assessments, program evaluation, intake screening, and research/surveillance. Widespread adoption in the future may promote a more comprehensive understanding of the food insecurity experience and facilitate development of tailored interventions on upstream causes of food insecurity.

"There is 'Plenty' of Grace-it is Not a Limited Commodity!:" Experiences of Grace in Australian Faith Communities During the Pandemic

During the pandemic years of 2020 and 2021, Melbourne in Australia endured one of the longest lockdowns in the world. Although the severe restrictions for faith communities in particular posed many setbacks, new opportunities for worship were experienced. This paper focuses on a research project that explored hope, grace, and resilience during COVID-19 in Melbourne. A total of 106 participants from a variety of Christian denominations in Melbourne completed an online survey in relation to the notion of grace. Thematic analysis of the qualitative data was employed to explore the lived experiences of the participants. Two overarching themes-God's grace offers favour, and God's grace provides strength and builds resilience-are discussed. The findings indicate that while grace is bountiful through faith, it can also be found in unexpected places within faith settings and the wider community. While generalizations from this study cannot be made to other faith communities, recommendations are offered in relation to ways in which 'church' may be experienced in 2022 and beyond. The study showed that "there is 'plenty' of grace". Its transformational power offers hope and builds resilience as God's grace "is not a limited commodity!"

Utilization of an Electronic Patient-Reported Outcome Platform to Evaluate the Psychosocial and Quality-of-Life Experience Among a Community Sample of Ovarian Cancer Survivors

PURPOSE

Novel distress screening approaches using electronic patient-reported outcome (ePRO) measurements are critical for the provision of comprehensive quality community cancer care. Using an ePRO platform, the prevalence of psychosocial factors (distress, post-traumatic growth, resilience, and financial stress) affecting quality of life in ovarian cancer survivors (OCSs) was examined.

METHODS

A cross-sectional OCS sample from the National Ovarian Cancer Coalition-Illinois Chapter completed web-based clinical, sociodemographic, and psychosocial assessment using well-validated measures: Hospital Anxiety/Depression Scale-anxiety/depression, Post-traumatic Growth Inventory, Brief Resilience Scale, comprehensive score for financial toxicity, and Functional Assessment of Cancer Therapy-Ovarian (FACT-O/health-related quality of life [HRQOL]). Correlational analyses between variables were conducted.

RESULTS

Fifty-eight percent (174 of 300) of OCS completed virtual assessment: median age 59 (range 32-83) years, 94.2% White, 60.3% married/in domestic partnership, 59.6% stage III-IV, 48.8% employed full-time/part-time, 55.2% had college/postgraduate education, 71.9% completed primary treatment, and median disease duration 6 (range < 1-34) years. On average, OCS endorsed normal levels of anxiety (mean ± standard deviation = 6.9 ± 3.8), depression (4.1 ± 3.6), mild total distress (10.9 ± 8.9), high post-traumatic growth (72.6 ± 21.5), normal resilience (3.7 ± 0.72), good FACT-O-HRQOL (112.6 ± 22.8), and mild financial stress (26 ± 10). Poor FACT-O emotional well-being was associated with greater participant distress (P < .001). Partial correlational analyses revealed negative correlations between FACT-O-HRQOL and anxiety (r = -0.65, P < .001), depression (r = -0.76, P < .001), and total distress (r = -0.92, P < .001). Yet, high FACT-O-HRQOL was positively correlated with post-traumatic coping (r = 0.27; P = .006) and resilience (r = 0.63; P < .001).

CONCLUSION

ePRO assessment is feasible for identification of unique psychosocial factors, for example, financial toxicity and resilience, affecting HRQOL for OCS. Future investigation should explore large-scale, longitudinal ePRO assessment of the OCS psychosocial experience using innovative measures and community-based advocacy populations.

Continuous care intervention with carbohydrate restriction improves physical function of the knees among patients with type 2 diabetes: a non-randomized study

Background

In a previous study, we assessed a novel, remotely monitored carbohydrate restricted diet regimen including nutritional ketosis in patients with type 2 diabetes and reported significant improvements in weight, glycemic control, abdominal fat and inflammation from baseline to 2 years. Knee outcome measures were collected as a secondary outcome in the trial. This study aims to assess the effect of this intervention on knee functional scores and to identify if changes in weight, central abdominal fat (CAF), glycemic status and high sensitivity C-reactive protein (hsCRP) were associated with its improvement.

Methods

This prospective analysis included continuous care intervention (CCI, n = 173) and usual care (UC, n = 69) trial participants with type 2 diabetes that reported knee pain at baseline. Knee outcome measures included the Knee injury and Osteoarthritis Outcome Score (KOOS) pain, symptoms, activities of daily living (ADL), sports and recreation function, and knee-related quality of life subscales, and total KOOS score were assessed from baseline to 2 years. Missing data at each time point were replaced with multiple imputation under the assumption of missing at random. To assess if the primary analysis of the knee scores changed under plausible missing not at random assumptions, sensitivity analysis was also performed using pattern mixture models. In CCI, we also assessed factors associated with the improvement of knee scores.

Results

In the primary analysis, CCI participants demonstrated a statistically significant improvement in total KOOS and all KOOS individual subscale scores at 1 year and maintained through 2 years as opposed to UC patients who showed no significant changes from baseline to 2 years. The significant improvement in total KOOS and its individual subscale scores from baseline to 2 years remained relatively stable in CCI in the sensitivity analysis under different missing not at random scenarios confirming the robustness of the findings from the primary analysis. Approximately 46% of the CCI participants met the 10 points minimal clinically important change at 2 years. A reduction in CAF was associated with improvement in total KOOS and KOOS ADL, while a decrease in hsCRP was associated with improvement in KOOS symptoms scores.

Conclusion

A very low carbohydrate intervention including nutritional ketosis resulted in significant improvements in knee pain and function among patients with T2D. The improvements in knee function were likely secondary to a reduction in central adiposity and inflammation. Future research on the applicability of this intervention in radiographically confirmed OA patients is important.

Trial registration

Clinical trial registration: NCT02519309 (10/08/2015).

Supplementary Information

The online version contains supplementary material available at 10.1186/s12891-022-05258-0.

Cognitive appraisal of the disease and stress level in lung cancer patients. The mediating role of coping styles

PURPOSE

The aim of the study was to provide support for the hypothesis that there was a correlation between the subjective appraisal of one's disease and the level of stress, as well as the hypothesis that coping styles may have a mediating role on the relationship between the perception of the disease and stress level in patients diagnosed with lung cancer.

METHODS

The study involved 97 respondents diagnosed with lung cancer, including 50 men and 47 women. The following methods were used for the study: the Disease-Related Appraisals Scale, the Coping Inventory for Stressful Situations, and the Perceived Stress Scale. Socio-demographic data were also collected.

RESULTS

The results show that emotion-oriented coping (EOC) acts as a mediator on the relationship between the appraisal of the disease and stress level in patients diagnosed with lung cancer. A total of 4 multiple mediation models were tested.

CONCLUSION

The research findings provide support for the hypothesis that coping style is crucial for the way patients appraise their disease and for their stress level. It is important to diagnose individual specific needs of lung cancer patients. The research results are an important source of information for those responsible for training medical staff on how to support cancer patients in their illness.

Patient understanding regarding opioid use in an orthopaedic trauma surgery population: a survey study

BACKGROUND

Prior studies have assessed provider knowledge and factors associated with opioid misuse; similar studies evaluating patient knowledge are lacking. The purpose of this study was to assess the degree of understanding regarding opioid use in orthopaedic trauma patients. We also sought to determine the demographic factors and clinical and personal experiences associated with level of understanding.

METHODS

One hundred and sixty-six adult orthopaedic trauma surgery patients across two clinical sites of an academic institution participated in an internet-based survey (2352 invited, 7.1% response rate). Demographic, clinical, and personal experience variables, as well as perceptions surrounding opioid use were collected. Relationships between patient characteristics and opioid perceptions were identified using univariate and multivariable logistic regressions. Alpha = 0.05.

RESULTS

Excellent recognition (> 85% correct) of common opioids, side effects, withdrawal symptoms, and disposal methods was demonstrated by 29%, 10%, 30%, and 2.4% of patients; poor recognition (< 55%) by 11%, 56%, 33%, and 52% of patients, respectively. Compared with white patients, non-white patients had 7.8 times greater odds (95% confidence interval [CI] 1.9-31) of perceiving addiction discrepancy (p = 0.004). Employed patients with higher education levels were less likely to have excellent understanding of side effects (adjusted odds ratio [aOR] 0.06, 95% CI 0.006-0.56; p = 0.01) and to understand that dependence can occur within 2 weeks (aOR 0.28, 95% CI 0.09-0.86; p = 0.03) than unemployed patients. Patients in the second least disadvantaged ADI quartile were more knowledgeable about side effects (aOR 8.8, 95% CI 1.7-46) and withdrawal symptoms (aOR 2.7, 95% CI 1.0-7.2; p = 0.046) than those in the least disadvantaged quartile. Patients who knew someone who was dependent or overdosed on opioids were less likely to perceive addiction discrepancy (aOR 0.24, 95% CI 0.07-0.76; p = 0.02) as well as more likely to have excellent knowledge of withdrawal symptoms (aOR 2.6, 95% CI 1.1-6.5, p = 0.03) and to understand that dependence can develop within 2 weeks (aOR 3.8, 95% CI 1.5-9.8, p = 0.005).

CONCLUSIONS

Level of understanding regarding opioid use is low among orthopaedic trauma surgery patients. Clinical and personal experiences with opioids, in addition to demographics, should be emphasized in the clinical history.

ASK ME!-Routine measurement of patient experience with patient safety in ambulatory care: A mixed-mode survey

Objective

Routine measurement of patient safety from the patients’ perspective receives increasing attention as an important component of safety measurement systems. The aim of this study was to examine patients’ experience with patient safety in ambulatory care and the results’ implications for routine patient safety measurement in ambulatory care.

Design

Cross-sectional mixed-mode survey.

Setting

General practitioner and specialist practices.

Participants

Patients aged >18 years seeking care in ambulatory care practices between February and June 2020.

Methods

A 22-item-questionnaire was completed in the practice or at home either on paper or online. Multivariate logistic regression was used to analyse the influence of survey mode and patient characteristics on patient experience with patient safety.

Results

The overall response rate was 71.1%. Most patients completed the questionnaire on site (76.6%) and on paper (96.1%). Between 30.1% to 68.5% of the respondents report the most positive option for patient experience with the main domains of patient safety. A total of 2.9% of patients reported having experienced a patient-safety event (PSE) during the last 12 months. Patients who filled in the questionnaire off site were more likely to report negative experiences for the scales communication & information (OR 1.2, 95% CI 1.0–1.5), rapport & participation (OR 1.4, 95% CI 1.1–1.7) and access (OR 1.3, 95% CI 0.9–1.4) than those who completed it on site. Those who chose a paper questionnaire were more likely to report negative experiences for all five scales compared to web responders.

Conclusion

Routine measurement of patient experience with factors contributing to the occurrence of PSEs can achieve high response rates by offering flexible participation options. Results gained from mixed-mode surveys need to take mode-effects into account when interpreting and using the results. Further research is needed in how to adequately assess number and type of experienced events in routine measurements.

Limitations in representative sampling of unpaid caregivers from minority ethnocultural backgrounds in a population-based survey

OBJECTIVE

Historically, persons from minority ethnic, religious and linguistic backgrounds have been un- or under-represented in population-based research studies. Emerging scholarship suggests challenges in representative sampling, particularly of minority ethnocultural groups, has been exacerbated by the COVID-19 pandemic. This research note offers additional insights concerning these challenges in the context of a population-based survey of unpaid caregivers conducted in Ontario, Canada, between August and December, 2020, the analysis of which is currently underway.

RESULTS

Beyond limitations intrinsic to study design, including time and budget constraints, the study sample underrepresents unpaid caregivers from minority ethnocultural backgrounds due to differences in conceptions of caregiving across minority cultures, the time-consuming nature of caregiving that disproportionately affects minority groups, and a propensity to avoid research which is rooted in tokenism. These hypotheses are non-exhaustive, speculative and warrant further empirical investigation.

The feasibility of web surveys for obtaining patient-reported outcomes from cancer survivors: a randomized experiment comparing survey modes and brochure enclosures

Background

Central cancer registries are often used to survey population-based samples of cancer survivors. These surveys are typically administered via paper or telephone. In most populations, web surveys obtain much lower response rates than paper surveys. This study assessed the feasibility of web surveys for collecting patient-reported outcomes via a central cancer registry.

Methods

Potential participants were sampled from Utah Cancer Registry records. Sample members were randomly assigned to receive a web or paper survey, and then randomized to either receive or not receive an informative brochure describing the cancer registry. We calculated adjusted risk ratios with 95% confidence intervals to compare response likelihood and the demographic profile of respondents across study arms.

Results

The web survey response rate (43.2%) was lower than the paper survey (50.4%), but this difference was not statistically significant (adjusted risk ratio = 0.88, 95% confidence interval = 0.72, 1.07). The brochure also did not significantly influence the proportion responding (adjusted risk ratio = 1.03, 95% confidence interval = 0.85, 1.25). There were few differences in the demographic profiles of respondents across the survey modes. Older age increased likelihood of response to a paper questionnaire but not a web questionnaire.

Conclusions

Web surveys of cancer survivors are feasible without significantly influencing response rates, but providing a paper response option may be advisable particularly when surveying older individuals. Further examination of the varying effects of brochure enclosures across different survey modes is warranted.

The feasibility of web surveys for obtaining patient-reported outcomes from cancer survivors: a randomized experiment comparing survey modes and brochure enclosures

BACKGROUND

Central cancer registries are often used to survey population-based samples of cancer survivors. These surveys are typically administered via paper or telephone. In most populations, web surveys obtain much lower response rates than paper surveys. This study assessed the feasibility of web surveys for collecting patient-reported outcomes via a central cancer registry.

METHODS

Potential participants were sampled from Utah Cancer Registry records. Sample members were randomly assigned to receive a web or paper survey, and then randomized to either receive or not receive an informative brochure describing the cancer registry. We calculated adjusted risk ratios with 95% confidence intervals to compare response likelihood and the demographic profile of respondents across study arms.

RESULTS

The web survey response rate (43.2%) was lower than the paper survey (50.4%), but this difference was not statistically significant (adjusted risk ratio = 0.88, 95% confidence interval = 0.72, 1.07). The brochure also did not significantly influence the proportion responding (adjusted risk ratio = 1.03, 95% confidence interval = 0.85, 1.25). There were few differences in the demographic profiles of respondents across the survey modes. Older age increased likelihood of response to a paper questionnaire but not a web questionnaire.

CONCLUSIONS

Web surveys of cancer survivors are feasible without significantly influencing response rates, but providing a paper response option may be advisable particularly when surveying older individuals. Further examination of the varying effects of brochure enclosures across different survey modes is warranted.

Administrative costs in health care-A scoping review

BACKGROUND

Administrative costs (AC) are a relevant spending category in health care, and several approaches exist on how to define and measure them. Based on available AC studies, this paper aims to provide a map for this multifaceted research topic.

METHODS

A scoping review was conducted using the databases MEDLINE, EconLit, and Business Source Premier. Literature was screened focussing on the research question: What is known about the methodology of AC research from scientific publications?

RESULTS

Definition concepts mostly rely on national cost documentations. The international cost reporting framework of the Systems of Health Accounts was a critical reference point in six studies. Indications on how to operationalise AC independently from periodical cost reports were suggested by ten publications. In this context, time and full time equivalents are the most common cost measurements.

CONCLUSIONS

The results indicate a lack of evidence regarding patients' perceptions of administrative issues in health care. Also, research on administrative impact on working conditions for health care employees beyond hospitals and physicians' offices is underrepresented. A systematic approach to reporting AC studies is needed. Reporting should include the appointment of entities actually empowered to change administrative resource usage. This would help to promote principles of a balanced administration.