Combining the power of stories and the power of numbers: mixed methods research and mixed studies reviews

The Changing Role of Health Care Professionals in Nursing Homes: A Systematic Literature Review of a Decade of Change

Although the role of health care professionals is known to have changed over the last years, few formal efforts have been made to examine this change through means of a scientific review. Therefore, the goal of this paper was to investigate the changing role of health care professionals in nursing homes, as well as the conditions that make this change possible. A systematic review of health care literature published in the last decade (2007-2017) was utilized to address these goals. Our findings suggest that although health care in nursing homes is shifting from task-oriented care to relation-oriented care (e.g., through an increased focus on patient dignity), various obstacles (e.g., negative self-image, work pressure, and a lack of developmental opportunities), needs (e.g., shared values, personal development, personal empowerment, team development, and demonstrating expertise), and competences (e.g., communication skills, attentiveness, negotiation skills, flexibility, teamwork, expertise, and coaching and leadership skills) still need to be addressed in order to successfully facilitate this change. As such, this paper provides various implications for health care research, health care institutions, practitioners, HR professionals and managers, and occupational health research.

Decisional needs assessment of patients with complex care needs in primary care: a participatory systematic mixed studies review protocol

INTRODUCTION

Patients with complex care needs (PCCNs) often suffer from combinations of multiple chronic conditions, mental health problems, drug interactions and social vulnerability, which can lead to healthcare services overuse, underuse or misuse. Typically, PCCNs face interactional issues and unmet decisional needs regarding possible options in a cascade of interrelated decisions involving different stakeholders (themselves, their families, their caregivers, their healthcare practitioners). Gaps in knowledge, values clarification and social support in situations where options need to be deliberated hamper effective decision support interventions. This review aims to (1) assess decisional needs of PCCNs from the perspective of stakeholders, (2) build a taxonomy of these decisional needs and (3) prioritise decisional needs with knowledge users (clinicians, patients and managers).

METHODS AND ANALYSIS

This review will be based on the interprofessional shared decision making (IP-SDM) model and the Ottawa Decision Support Framework. Applying a participatory research approach, we will identify potentially relevant studies through a comprehensive literature search; select relevant ones using eligibility criteria inspired from our previous scoping review on PCCNs; appraise quality using the Mixed Methods Appraisal Tool; conduct a three-step synthesis (sequential exploratory mixed methods design) to build taxonomy of key decisional needs; and integrate these results with those of a parallel PCCNs' qualitative decisional need assessment (semistructured interviews and focus group with stakeholders).

ETHICS AND DISSEMINATION

This systematic review, together with the qualitative study (approved by the Centre Intégré Universitaire de Santé et Service Sociaux du Saguenay-Lac-Saint-Jean ethical committee), will produce a working taxonomy of key decisional needs (ontological contribution), to inform the subsequent user-centred design of a support tool for addressing PCCNs' decisional needs (practical contribution). We will adapt the IP-SDM model, normally dealing with a single decision, for PCCNs who experience cascade of decisions involving different stakeholders (theoretical contribution). Knowledge users will facilitate dissemination of the results in the Canadian primary care network.

PROSPERO REGISTRATION NUMBER

CRD42015020558.

Withdrawal-associated injury site pain (WISP): a descriptive case series of an opioid cessation phenomenon

Supplemental Digital Content is Available in the Text.

This descriptive case series among adults documents that pain can return temporarily at healed, previously pain-free injury sites during acute opioid withdrawal.

Withdrawal pain can be a barrier to opioid cessation. Yet, little is known about old injury site pain in this context. We conducted an exploratory mixed-methods descriptive case series using a web-based survey and in-person interviews with adults recruited from pain and addiction treatment and research settings. We included individuals who self-reported a past significant injury that was healed and pain-free before the initiation of opioids, which then became temporarily painful upon opioid cessation—a phenomenon we have named withdrawal-associated injury site pain (WISP). Screening identified WISP in 47 people, of whom 34 (72%) completed the descriptive survey, including 21 who completed qualitative interviews. Recalled pain severity scores for WISP were typically high (median: 8/10; interquartile range [IQR]: 2), emotionally and physically aversive, and took approximately 2 weeks to resolve (median: 14; IQR: 24 days). Withdrawal-associated injury site pain intensity was typically slightly less than participants' original injury pain (median: 10/10; IQR: 3), and more painful than other generalized withdrawal symptoms which also lasted approximately 2 weeks (median: 13; IQR: 25 days). Fifteen surveyed participants (44%) reported returning to opioid use because of WISP in the past. Participants developed theories about the etiology of WISP, including that the pain is the brain's way of communicating a desire for opioids. This research represents the first known documentation that previously healed, and pain-free injury sites can temporarily become painful again during opioid withdrawal, an experience which may be a barrier to opioid cessation, and a contributor to opioid reinitiation.

Exploring the evidence base for how people with dementia and their informal carers manage their medication in the community: a mixed studies review

Background

Little is known about the general medicines management issues for people with dementia living in the community. This review has three aims: firstly to explore and evaluate the international literature on how people with dementia manage medication; assess understanding of medicines management from an informal carers perspective; and lastly to understand the role that healthcare professionals play in assisting this population with medicines management.

Methods

A mixed studies review was conducted. Web of Knowledge, PubMed and Cochrane Library were searched post-1999 for studies that explored medicines management in people with dementia dwelling in the community, and the role healthcare professionals play in supporting medicines management in people with dementia. Following screening, nine articles were included. Data from included studies were synthesised using a convergent synthesis approach and analysed thematically to combine findings from studies using a range of methods (qualitative, quantitative and mixed methods).

Results

Four themes were generated from the synthesis: The nature of the disease and the effects this had on medicines management; the additional responsibilities informal carers have; informal caregivers’ knowledge of the importance of managing medication and healthcare professionals’ understanding of medicines management in people with dementia. Consequently, these were found to affect management of medication, in particular adherence to medication.

Conclusions

This review has identified that managing medication for people with dementia dwelling in the community is a complex task with a frequently associated burden on their informal caregivers. Healthcare professionals can be unaware of this burden. The findings warrant the need for healthcare professionals to undergo further training in supporting medicines management for people with dementia in their own homes.

Effects of e-learning in a continuing education context on nursing care: a review of systematic qualitative, quantitative and mixed studies reviews (protocol)

INTRODUCTION

Continuing education (CE) is imperative to the future of professional nursing. The use of e-learning by registered nurses for CE is spreading. A review of systematic reviews will be conducted to develop a broad picture of the effects of e-learning in a CE context on nursing care.

METHODS AND ANALYSIS

Systematic qualitative, quantitative and mixed studies reviews published in English, French or Spanish from 1 January 2006 will be included. The outcomes of interest will be extracted and analysed inductively and deductively from the Nursing Care Performance Framework; some themes include nursing resources, nurses' practice environment, processes, professional satisfaction, and nursing sensitive outcomes. Three reviewers will independently screen first the title and abstract of the papers, and then the full texts in order to assess eligibility. Two teams of two reviewers will extract the selected reviews' characteristics and data. The results from various types of reviews will be integrated using a data-based convergent synthesis design. We will conduct a thematic synthesis and transform all quantitative and mixed data into qualitative data.

ETHICS AND DISSEMINATION

Ethics approval is not required for review of systematic reviews. We will summarise evidence concerning the negative, neutral and positive effects of various forms of e-learning on different aspects of nursing care. If we find gaps in the literature, we will highlight them and suggest ideas for further research. We will also focus on positive effects and present, if possible, the components and characteristics of e-learning interventions that were found to be successful. We will present this protocol and results in international conferences in nursing, medical, and health informatics domains. We will also submit the results of our work for peer-review publication in a journal indexed in the international bibliographic database of biomedical information.

Organizational participatory research: a systematic mixed studies review exposing its extra benefits and the key factors associated with them

BACKGROUND

In health, organizational participatory research (OPR) refers to health organization members participating in research decisions, with university researchers, throughout a study. This non-academic partner contribution to the research may take the form of consultation or co-construction. A drawback of OPR is that it requires more time from all those involved, compared to non-participatory research approaches; thus, understanding the added value of OPR, if any, is important. Thus, we sought to assess whether the OPR approach leads to benefits beyond what could be achieved through traditional research.

METHODS

We identified, selected, and appraised OPR health literature, and at each stage, two team members independently reviewed and coded the literature. We used quantitative content analysis to transform textual data into reliable numerical codes and conducted a logistic regression to test the hypothesis that a co-construction type OPR study yields extra benefits with a greater likelihood than consultation-type OPR studies.

RESULTS

From 8873 abstracts and 992 full text papers, we distilled a sample of 107 OPR studies. We found no difference between the type of organization members' participation and the likelihood of exhibiting an extra benefit. However, the likelihood of an OPR study exhibiting at least one extra benefit is quadrupled when the impetus for the study comes from the organization, rather than the university researcher(s), or the organization and the university researcher(s) together (OR = 4.11, CI = 1.12-14.01). We also defined five types of extra benefits.

CONCLUSIONS

This review describes the types of extra benefits OPR can yield and suggests these benefits may occur if the organization initiates the OPR. Further, this review exposes a need for OPR authors to more clearly describe the type of non-academic partner participation in key research decisions throughout the study. Detailed descriptions will benefit others conducting OPR and allow for a re-examination of the relationship between participation and extra benefits in future reviews.

Critical reflections on methodological challenge in arts and dementia evaluation and research

Methodological rigour, or its absence, is often a focus of concern for the emerging field of evaluation and research around arts and dementia. However, this paper suggests that critical attention should also be paid to the way in which individual perceptions, hidden assumptions and underlying social and political structures influence methodological work in the field. Such attention will be particularly important for addressing methodological challenges relating to contextual variability, ethics, value judgement and signification identified through a literature review on this topic. Understanding how, where and when evaluators and researchers experience such challenges may help to identify fruitful approaches for future evaluation.

An integrative review of the psychosocial facilitators and challenges of continuous subcutaneous insulin infusion therapy in type 1 diabetes

AIM

To use systematic methods to explore the psychosocial facilitators and challenges of insulin pump therapy among people with type 1 diabetes.

BACKGROUND

Insulin pump therapy is now widely accepted in the management of type 1 diabetes. Given the increasing use of insulin pumps, it is timely to review the evidence relating to the psychosocial impacts of this therapy which have not been addressed in previous reviews.

DESIGN

An integrative review of the literature (January 2005-February 2017).

DATA SOURCES

A systematic search of electronic databases: CINAHL, Cochrane, Medline, PsycINFO and Scopus.

REVIEW METHODS

Empirical literature reporting psychosocial facilitators and challenges of insulin pump therapy were eligible for inclusion. A constant comparative method was used to guide the review. Quality appraisal was performed using the Mixed Methods Appraisal Tool Version 2011.

RESULTS

Thirty-five potential articles identified from titles and abstracts were reviewed. Of these, 13 articles were included in the final review. Psychosocial facilitators of insulin pump therapy included the flexibility and freedom it provided for living with diabetes, enhancing social situations and daily management. In contrast, challenges included the demands of pump therapy, self-consciousness in wearing the pump and fear of hypoglycaemia and pump failure.

CONCLUSION

Findings can be used by health professionals to inform people embarking on insulin pump therapy and prepare them with regard to expectations of the treatment. Further research is required to explore the role of diabetes health professional in providing psychosocial support to people with type 1 diabetes on insulin pump therapy.

The unintended consequences of community verifications for performance-based financing in Burkina Faso

Performance-based financing (PBF) is being widely implemented to improve healthcare services in Africa. An essential component of PBF involves conducting community verifications, wherein investigators from local associations attempt to trace samples of patients. Community surveys are administered to patients to verify whether healthcare workers reported fictitious services to increase their revenue. At the same time, client satisfaction surveys are administered to assess whether patients are satisfied with the services received. Although some global health actors are concerned that PBF can trigger unintended consequences, this topic remains neglected. The objective of this study was to document the unintended consequences of community verification. Guided by the diffusion of innovations theory, we conducted a multiple case study. The cases were the catchment areas of seven healthcare facilities in Burkina Faso. Data were collected between January 2016 and May 2016 using non-participant observation, 92 semi-structured interviews, and informal discussions. Participants included a wide range of stakeholders, such as community verifiers, investigators, patients, and healthcare providers. Data were coded using QDA Miner, and thematic analysis was conducted. Healthcare workers did not significantly disturb or try to influence community verifiers during patient selection for community verifications. Unintended consequences included stakeholders' dissatisfaction regarding compensation modalities, work overload for community verifiers, and falsification of verification data by investigators. Community verifications led to loss of patient confidentiality as well as fears and apprehensions, although some patients were pleased to share their views regarding healthcare services. Community verifications also triggered marital issues, resulting in conflicts with, or interference from, husbands. The numerous challenges associated with locating patients in their communities led stakeholders to question the validity and utility of the results. These unintended consequences could jeopardize the overall effectiveness of community verifications. Attention should be paid to these unintended consequences to inform effective implementation and refine future interventions.

Psychosocial and career outcomes of peer mentorship in medical resident education: a systematic review protocol

BACKGROUND

Many medical residents lack ready access to social and emotional supports that enable them to successfully cope with the challenges associated with medical residency. This absence of support has been shown to lead to high levels of burnout, decreased mental wellbeing, and difficulty mastering professional competencies in this population. While there is emerging evidence that peer mentoring can be an important source of psychosocial and career-related support for many individuals, the extent of the evidence regarding the benefits of peer mentorship in medical residency education has not yet been established. We describe a protocol for a systematic review to assess the effects of peer mentoring on medical residents' mental wellbeing, social connectedness, and professional competencies.

METHODS

Studies included in this review will be those that report on peer-mentoring relationships among medical residents. Quantitative, qualitative, and mixed-methods studies will be eligible for inclusion. No date or language limits will be applied. We will search EMBASE, MEDLINE, PsychINFO, Web of Science, Scopus, ERIC, Education Research Complete, and Academic Research Complete databases to identify relevant studies. Two authors will independently assess all abstracts and full-text studies for inclusion and study quality and extract study data in duplicate.

DISCUSSION

This is the first systematic review to explicitly explore the role of peer mentoring in the context of medical residency education. We anticipate that the findings from this review will raise awareness of the benefits and challenges associated with peer-mentoring relationships, further the development and implementation of formal peer-mentoring programs for medical residents, and, through identifying gaps in the existing literature, inform future research efforts.

SYSTEMATIC REVIEW REGISTRATION

This protocol has not been registered in PROSPERO or any other publicly accessible registry.

Protocol for a mixed studies systematic review on the implementation of the recovery approach in adult mental health services

INTRODUCTION

Recovery is integral to mental health planning in G-8 countries including Canada. A recovery-oriented approach to care aims to promote personal empowerment, illness self-management and a life beyond services for people with serious mental illness (SMI), while reducing the financial burden associated with mental illness. Although there is a growing body of literature on recovery, no synthesis of research on the implementation of recovery into mental health services exists.

OBJECTIVES

The objective is to conduct a mixed studies systematic review on the operationalisation of recovery into mental health services for adults with SMI. It will inform the transformation of Canadian services to a recovery orientation, but may be applicable to other countries.

METHODS AND ANALYSIS

Seven databases including PubMed, Ovid Medline, Ovid Embase, Ovid PsycInfo, CINAHL, the Cochrane Library and Scopus will be searched for peer-reviewed empirical studies published from 1998 to December 2016. Systematic reviews and studies using quantitative, qualitative and mixed methodologies will be included. Secondary searches will be conducted in reference lists of all selected full text articles. Handsearches will also be performed in the tables of contents of three recovery-focused journals for the last 5 years. International experts in the field will be contacted for comments and advice. Data extraction will include identification and methodological synthesis of each study; definition of recovery; information on recovery implementation; facilitators and barriers and study outcomes. A quality assessment will be conducted on each study. The data will be synthesised and a stepwise thematic analysis performed.

ETHICS AND DISSEMINATION

Ethics approval is not required for this knowledge synthesis. Findings will be disseminated through knowledge translation activities including: (1) a 1-day symposium; (2) presentations in national and international conferences and to local stakeholders; (3) publications in peer-reviewed journals; (4) posts on the organisational websites.

Health financing policies in Sub-Saharan Africa: government ownership or donors' influence? A scoping review of policymaking processes

BACKGROUND

The rise on the international scene of advocacy for universal health coverage (UHC) was accompanied by the promotion of a variety of health financing policies. Major donors presented health insurance, user fee exemption, and results-based financing policies as relevant instruments for achieving UHC in Sub-Saharan Africa. The "donor-driven" push for policies aiming at UHC raises concerns about governments' effective buy-in of such policies. Because the latter has implications on the success of such policies, we searched for evidence of government ownership of the policymaking process.

METHODS

We conducted a scoping review of the English and French literature from January 2001 to December 2015 on government ownership of decision-making on policies aiming at UHC in Sub-Saharan Africa. Thirty-five (35) results were retrieved. We extracted, synthesized and analyzed data in order to provide insights on ownership at five stages of the policymaking process: emergence, formulation, funding, implementation, and evaluation.

RESULTS

The majority of articles (24/35) showed mixed results (i.e. ownership was identified at one or more levels of policymaking process but not all) in terms of government ownership. Authors of only five papers provided evidence of ownership at all reviewed policymaking stages. When results demonstrated some lack of government ownership at any of the five stages, we noticed that donors did not necessarily play a role: other actors' involvement was contributing to undermining government-owned decision-making, such as the private sector. We also found evidence that both government ownership and donors' influence can successfully coexist.

DISCUSSION

Future research should look beyond indicators of government ownership, by analyzing historical factors behind the imbalance of power between the different actors during policy negotiations. There is a need to investigate how some national actors become policy champions and thereby influence policy formulation. In order to effectively achieve government ownership of financing policies aiming at UHC, we recommend strengthening the State's coordination and domestic funding mobilization roles, together with securing a higher involvement of governmental (both political and technical) actors by donors.

Rapid qualitative research methods during complex health emergencies: A systematic review of the literature

The 2013-2016 Ebola outbreak in West Africa highlighted both the successes and limitations of social science contributions to emergency response operations. An important limitation was the rapid and effective communication of study findings. A systematic review was carried out to explore how rapid qualitative methods have been used during global heath emergencies to understand which methods are commonly used, how they are applied, and the difficulties faced by social science researchers in the field. We also asses their value and benefit for health emergencies. The review findings are used to propose recommendations for qualitative research in this context. Peer-reviewed articles and grey literature were identified through six online databases. An initial search was carried out in July 2016 and updated in February 2017. The PRISMA checklist was used to guide the reporting of methods and findings. The articles were assessed for quality using the MMAT and AACODS checklist. From an initial search yielding 1444 articles, 22 articles met the criteria for inclusion. Thirteen of the articles were qualitative studies and nine used a mixed-methods design. The purpose of the rapid studies included: the identification of causes of the outbreak, and assessment of infrastructure, control strategies, health needs and health facility use. The studies varied in duration (from 4 days to 1 month). The main limitations identified by the authors were: the low quality of the collected data, small sample sizes, and little time for cross-checking facts with other data sources to reduce bias. Rapid qualitative methods were seen as beneficial in highlighting context-specific issues that need to be addressed locally, population-level behaviors influencing health service use, and organizational challenges in response planning and implementation. Recommendations for carrying out rapid qualitative research in this context included the early designation of community leaders as a point of contact, early and continuous sharing of findings, and development of recommendations with local policy makers and practitioners.

Touchscreen interventions and the well-being of people with dementia and caregivers: a systematic review

BACKGROUND

Dementia can have significant detrimental impacts on the well-being of those with the disease and their carers. A range of computer-based interventions, including touchscreen-based interventions have been researched for use with this population in the hope that they might improve psychological well-being. This article reviews touchscreen-based interventions designed to be used by people with dementia (PWD), with a specific focus in assessing their impact on well-being.

METHOD

The data bases, PsycInfo, ASSIA, Medline, CINAHL, and Cochrane Reviews were searched for touchscreen-based interventions designed to be used by PWD with reported psychological well-being outcomes. Methodological quality was assessed using Pluye and Hong's (2014) Mixed Methods Appraisal Tool (MMAT) checklist.

RESULTS

Sixteen papers were eligible. They covered 14 methodologically diverse interventions. Interventions were reported to be beneficial in relation to mental health, social interaction, and sense of mastery. Touchscreen interventions also reportedly benefit informal carers in relation to their perceived burden and the quality of their relationships with the people they care for. Key aspects included the user interface, provision of support, learning style, tailored content, appropriate challenge, ergonomics, and users' dementia progression.

CONCLUSIONS

Whilst much of the existing research is relatively small-scale, the findings tentatively suggest that touchscreen-based interventions can improve the psychological well-being of PWD, and possibilities for more rigorous future research are suggested.

Marriage after the transition to stroke: a systematic review

In health and chronic illness, satisfying marriages promote wellbeing and life satisfaction, yet stroke research has focused on either the stroke survivor as the patient or the spouse as a care-giver. Using Pope, Mays and Popay's framework for synthesising qualitative and quantitative methods, we conducted a systematic review and synthesis of 39 peer-reviewed studies to determine what happens to marital relationships after one partner has suffered a stroke. All the articles examined the impact of stroke. Three overarching themes characterise the evolution of marriage after stroke: chaos in the marriage, work to re-establish the marriage and evolution of the marriages. While both the stroke condition itself and the survivors’ need for care undermined the emotional qualities of the relationship for some couples, about two-thirds were able to retain or regain the relationship closeness. As in other chronic illnesses, the relationship closeness and a couple's ability to collaborate contributed to the survivor's recovery and to the satisfaction with life of the stroke survivor and the spouse. Our results underscore the need to consider the quality of, and the qualities of, the relationship between stroke survivors and their spouses. Future research could include a greater focus on qualitative or mixed-methods approaches to explore the interactions between stroke survivors and spouses that impact the wellbeing of both partners.

Factors affecting nursing staff use of a communication tool to reduce potentially preventable acute care transfers in long-term care

Although specialized communication tools can effectively reduce acute care transfers, few studies have assessed the factors that may influence the use of such tools by nursing staff at the individual level. We evaluated the associations between years of experience, tool-related training, nursing attitudes, and intensity of use of a communication tool developed to reduce transfers in a long-term care facility. We employed a mixed methods design using data from medical charts, electronic records, and semi-structured interviews. Experienced nurses used the tool significantly less than inexperienced nurses, and training had a significant positive impact on tool use. Nurses found the purpose of the tool to be confusing. No significant differences in attitude were observed based on years of experience or intensity of use. Project findings indicate that focused efforts to enrich training may increase intervention adherence. Experienced nurses in particular should be made aware of the benefits of utilizing communication tools.

Use of concurrent mixed methods combining concept mapping and focus groups to adapt a health equity tool in Canada

The aim of this project was to identify and prioritize a set of conditions to be considered for incorporating a health equity tool into public health practice. Concept mapping and focus groups were implemented as complementary methods to investigate the conditions of use of a health equity tool by public health organizations in Quebec. Using a hybrid integrated research design is a richer way to address the complexity of questions emerging from intervention and planning settings. This approach provides a deeper, operational, and contextualized understanding of research results involving different professional and organizational cultures, and thereby supports the decision-making process. Concept mapping served to identify and prioritize in a limited timeframe the conditions to be considered for incorporation into a health equity tool into public health practices. Focus groups then provided a more refined understanding of the barriers, issues, and facilitating factors surrounding the tools adoption, helped distinguish among participants' perspectives based on functional roles and organizational contexts, and clarified some apparently contradictory results from the concept map. The combined use of these two techniques brought the strengths of each approach to bear, thereby overcoming some of the respective limitations of concept mapping and focus groups. This design is appropriate for investigating targets with multiple levels of complexity.

Using a computer simulation for teaching communication skills: A blinded multisite mixed methods randomized controlled trial

OBJECTIVES

To assess advanced communication skills among second-year medical students exposed either to a computer simulation (MPathic-VR) featuring virtual humans, or to a multimedia computer-based learning module, and to understand each group's experiences and learning preferences.

METHODS

A single-blinded, mixed methods, randomized, multisite trial compared MPathic-VR (N=210) to computer-based learning (N=211). Primary outcomes: communication scores during repeat interactions with MPathic-VR's intercultural and interprofessional communication scenarios and scores on a subsequent advanced communication skills objective structured clinical examination (OSCE). Multivariate analysis of variance was used to compare outcomes.

SECONDARY OUTCOMES

student attitude surveys and qualitative assessments of their experiences with MPathic-VR or computer-based learning.

RESULTS

MPathic-VR-trained students improved their intercultural and interprofessional communication performance between their first and second interactions with each scenario. They also achieved significantly higher composite scores on the OSCE than computer-based learning-trained students. Attitudes and experiences were more positive among students trained with MPathic-VR, who valued its providing immediate feedback, teaching nonverbal communication skills, and preparing them for emotion-charged patient encounters.

CONCLUSIONS

MPathic-VR was effective in training advanced communication skills and in enabling knowledge transfer into a more realistic clinical situation.

PRACTICE IMPLICATIONS

MPathic-VR's virtual human simulation offers an effective and engaging means of advanced communication training.

Stakeholder views of breastfeeding education in schools: a systematic mixed studies review of the literature

BACKGROUND

Breastfeeding provides numerous health benefits for mothers and infants, but worldwide breastfeeding rates fall below recommendations. As part of efforts to increase breastfeeding initiation and duration, the World Health Organization and UNICEF UK recommend educational interventions to increase awareness and positive attitudes towards breastfeeding beginning during the school years. Breastfeeding education in the school setting offers the opportunity to improve the knowledge base, address misconceptions, and positively influence beliefs and attitudes for students from a wide range of socioeconomic and cultural backgrounds. The purpose of this paper is to present a comprehensive narrative review of the literature regarding student and teacher (stakeholder) views of breastfeeding and breastfeeding education programs in schools to inform future research in the area.

METHODS

Articles were located through a systematic search of online databases and journals using the following keywords in various combinations: (1) breastfeeding, lactation, breast-feeding, "bottle feeding", "infant feeding" (2) student, educator, teacher, "school administrator" and (3) schools, "secondary education", "primary education", "K-12", "high school", "middle school", "elementary school", education, adolescents, curriculum, and a manual search of article references. Studies were screened for inclusion against specific criteria and included papers were assessed using the Mixed Methods Appraisal Tool (MMAT).

RESULTS

This review suggests that adolescents have a deficit in breastfeeding knowledge and express negative conceptions about breastfeeding. Breastfeeding is being discussed in some school environments, but the extent of lessons and the specific messages that teachers communicate have not been explored. Students appear to be interested in receiving more information about breastfeeding, especially if delivered by health professionals or breastfeeding mothers. The majority of teachers are supportive of incorporating breastfeeding education in family and consumer sciences, sexual education, and health classes; however, time constraints and limited knowledge of infant feeding recommendations may be barriers to implementation of appropriate lesson plans.

CONCLUSIONS

Students generally support and are receptive to breastfeeding education; however, research on educator attitudes, knowledge, and experiences are necessary for appropriate implementation of breastfeeding education in varying school settings around the world.

Convergent and sequential synthesis designs: implications for conducting and reporting systematic reviews of qualitative and quantitative evidence

BACKGROUND

Systematic reviews of qualitative and quantitative evidence can provide a rich understanding of complex phenomena. This type of review is increasingly popular, has been used to provide a landscape of existing knowledge, and addresses the types of questions not usually covered in reviews relying solely on either quantitative or qualitative evidence. Although several typologies of synthesis designs have been developed, none have been tested on a large sample of reviews. The aim of this review of reviews was to identify and develop a typology of synthesis designs and methods that have been used and to propose strategies for synthesizing qualitative and quantitative evidence.

METHODS

A review of systematic reviews combining qualitative and quantitative evidence was performed. Six databases were searched from inception to December 2014. Reviews were included if they were systematic reviews combining qualitative and quantitative evidence. The included reviews were analyzed according to three concepts of synthesis processes: (a) synthesis methods, (b) sequence of data synthesis, and (c) integration of data and synthesis results.

RESULTS

A total of 459 reviews were included. The analysis of this literature highlighted a lack of transparency in reporting how evidence was synthesized and a lack of consistency in the terminology used. Two main types of synthesis designs were identified: convergent and sequential synthesis designs. Within the convergent synthesis design, three subtypes were found: (a) data-based convergent synthesis design, where qualitative and quantitative evidence is analyzed together using the same synthesis method, (b) results-based convergent synthesis design, where qualitative and quantitative evidence is analyzed separately using different synthesis methods and results of both syntheses are integrated during a final synthesis, and (c) parallel-results convergent synthesis design consisting of independent syntheses of qualitative and quantitative evidence and an interpretation of the results in the discussion.

CONCLUSIONS

Performing systematic reviews of qualitative and quantitative evidence is challenging because of the multiple synthesis options. The findings provide guidance on how to combine qualitative and quantitative evidence. Also, recommendations are made to improve the conducting and reporting of this type of review.

When Educational Material Is Delivered: A Mixed Methods Content Validation Study of the Information Assessment Method

BACKGROUND

The Information Assessment Method (IAM) allows clinicians to report the cognitive impact, clinical relevance, intention to use, and expected patient health benefits associated with clinical information received by email. More than 15,000 Canadian physicians and pharmacists use the IAM in continuing education programs. In addition, information providers can use IAM ratings and feedback comments from clinicians to improve their products.

OBJECTIVE

Our general objective was to validate the IAM questionnaire for the delivery of educational material (ecological and logical content validity). Our specific objectives were to measure the relevance and evaluate the representativeness of IAM items for assessing information received by email.

METHODS

A 3-part mixed methods study was conducted (convergent design). In part 1 (quantitative longitudinal study), the relevance of IAM items was measured. Participants were 5596 physician members of the Canadian Medical Association who used the IAM. A total of 234,196 ratings were collected in 2012. The relevance of IAM items with respect to their main construct was calculated using descriptive statistics (relevance ratio R). In part 2 (qualitative descriptive study), the representativeness of IAM items was evaluated. A total of 15 family physicians completed semistructured face-to-face interviews. For each construct, we evaluated the representativeness of IAM items using a deductive-inductive thematic qualitative data analysis. In part 3 (mixing quantitative and qualitative parts), results from quantitative and qualitative analyses were reviewed, juxtaposed in a table, discussed with experts, and integrated. Thus, our final results are derived from the views of users (ecological content validation) and experts (logical content validation).

RESULTS

Of the 23 IAM items, 21 were validated for content, while 2 were removed. In part 1 (quantitative results), 21 items were deemed relevant, while 2 items were deemed not relevant (R=4.86% [N=234,196] and R=3.04% [n=45,394], respectively). In part 2 (qualitative results), 22 items were deemed representative, while 1 item was not representative. In part 3 (mixing quantitative and qualitative results), the content validity of 21 items was confirmed, and the 2 nonrelevant items were excluded. A fully validated version was generated (IAM-v2014).

CONCLUSIONS

This study produced a content validated IAM questionnaire that is used by clinicians and information providers to assess the clinical information delivered in continuing education programs.

Describing knowledge encounters in healthcare: a mixed studies systematic review and development of a classification

Background

Implementation science seeks to promote the uptake of research and other evidence-based findings into practice, but for healthcare professionals, this is complex as practice draws on, in addition to scientific principles, rules of thumb and a store of practical wisdom acquired from a range of informational and experiential sources. The aims of this review were to identify sources of information and professional experiences encountered by healthcare workers and from this to build a classification system, for use in future observational studies, that describes influences on how healthcare professionals acquire and use information in their clinical practice.

Methods

This was a mixed studies systematic review of observational studies. DATA SOURCES: OVID MEDLINE and Embase and Google Scholar were searched using terms around information, knowledge or evidence and sharing, searching and utilisation combined with terms relating to healthcare groups. ELIGIBILITY: Studies were eligible if one of the intentions was to identify information or experiential encounters by healthcare workers. DATA EXTRACTION: Data was extracted by one author after piloting with another. STUDY APPRAISAL: Studies were assessed using the Mixed Methods Appraisal Tool (MMAT). PRIMARY OUTCOME: The primary outcome extracted was the information source or professional experience encounter. ANALYSIS: Similar encounters were grouped together as single constructs. Our synthesis involved a mixed approach using the top-down logic of the Bliss Bibliographic Classification System (BC2) to generate classification categories and a bottom-up approach to develop descriptive codes (or “facets”) for each category, from the data. The generic terms of BC2 were customised by an iterative process of thematic content analysis. Facets were developed by using available theory and keeping in mind the pragmatic end use of the classification.

Results

Eighty studies were included from which 178 discreet knowledge encounters were extracted. Six classification categories were developed: what information or experience was encountered; how was the information or experience encountered; what was the mode of encounter; from whom did the information originate or with whom was the experience; how many participants were there; and where did the encounter take place. For each of these categories, relevant descriptive facets were identified.

Conclusions

We have sought to identify and classify all knowledge encounters, and we have developed a faceted description of key categories which will support richer descriptions and interrogations of knowledge encounters in healthcare research.

Electronic supplementary material

The online version of this article (doi:10.1186/s13012-017-0564-1) contains supplementary material, which is available to authorized users.

Gender perspectives on views and preferences of older people on exercise to prevent falls: a systematic mixed studies review

Background

To offer fall prevention exercise programs that attract older people of both sexes there is a need to understand both women’s and men’s views and preferences regarding these programs. This paper aims to systematically review the literature to explore any underlying gender perspectives or gender interpretations on older people’s views or preferences regarding uptake and adherence to exercise to prevent falls.

Methods

A review of the literature was carried out using a convergent qualitative design based on systematic searches of seven electronic databases (PubMed, CINAHL, Amed, PsycINFO, Scopus, PEDro, and OTseeker). Two investigators identified eligible studies. Each included article was read by at least two authors independently to extract data into tables. Views and preferences reported were coded and summarized in themes of facilitators and barriers using a thematic analysis approach.

Results

Nine hundred and nine unique studies were identified. Twenty five studies met the criteria for inclusion. Only five of these contained a gender analysis of men’s and women’s views on fall prevention exercises. The results suggests that both women and men see women as more receptive to and in more need of fall prevention messages. The synthesis from all 25 studies identified six themes illustrating facilitators and six themes describing barriers for older people either starting or adhering to fall prevention exercise. The facilitators were: support from professionals or family; social interaction; perceived benefits; a supportive exercise context; feelings of commitment; and having fun. Barriers were: practical issues; concerns about exercise; unawareness; reduced health status; lack of support; and lack of interest. Considerably more women than men were included in the studies.

Conclusion

Although there is plenty of information on the facilitators and barriers to falls prevention exercise in older people, there is a distinct lack of studies investigating differences or similarities in older women’s and men’s views regarding fall prevention exercise. In order to ensure that fall prevention exercise is appealing to both sexes and that the inclusion of both men and women are encouraged, more research is needed to find out whether gender differences exists and whether practitioners need to offer a range of opportunities and support strategies to attract both women and men to falls prevention exercise.

Electronic supplementary material

The online version of this article (doi:10.1186/s12877-017-0451-2) contains supplementary material, which is available to authorized users.

What is the existing evidence supporting the efficacy of compression bandage systems containing both elastic and inelastic components (mixed-component systems)? A systematic review

AIMS AND OBJECTIVES

To analyse current evidence on the efficacy of bandage systems containing both elastic and inelastic components (mixed-component systems).

BACKGROUND

International consensus on the efficacy of types of compression systems is difficult to achieve; however, mixed-component systems are being promoted as combining the best properties of both elastic and inelastic bandage systems and increasingly being used to treat venous leg ulcers in practice.

DESIGN

A systematic literature review.

METHODS

Search terms such as venous leg ulcer, varicose ulcer, leg ulcer, compression, bandage, elastic, inelastic, short stretch, healing rate, interface pressure, mixed component, two-layer, four-layer and multi-layer were used in database and hand searches in several combinations. Limits were set for years 2005-March 2015 and English-language publications.

RESULTS

A total of 475 studies were identified at initial search, and following elimination from abstract and title, this was reduced to 7. A further study was identified on Google Scholar, bringing the final number of studies fitting inclusion criteria to 8. The following subgroups relating to outcomes of efficacy were identified: ulcer healing, maintenance of interface pressure, slippage, ease of application and patient quality of life.

CONCLUSIONS

Mixed-component systems were found to have comparable ulcer healing rates to alternative compression systems and be easy to apply; have similar abilities to maintain pressure as four-layer bandages and better abilities than short-stretch bandages; have less slippage than alternative systems; and to be significantly associated with several favourable quality of life outcomes. Clinician skill in bandage application was an uncontrolled variable in all eight papers included in the review, which may limit reliability of findings.

RELEVANCE TO CLINICAL PRACTICE

This review synthesises existing evidence on the efficacy of mixed-component systems and encourages clinicians to regard them as an effective alternative to purely elastic or inelastic compression systems. Additionally, it highlights the importance of clinician skill in bandage application as a crucial determinant of effective compression.

Nurses' resilience and the emotional labour of nursing work: An integrative review of empirical literature

BACKGROUND

The emotional labour of nursing work involves managing the emotional demands of relating with patients, families and colleagues. Building nurses' resilience is an important strategy in mitigating the stress and burnout that may be caused by ongoing exposure to these demands. Understandings of resilience in the context of emotional labour in nursing, however, are limited.

OBJECTIVES

To investigate the state of knowledge on resilience in the context of emotional labour in nursing.

DESIGN

Integrative literature review.

DATA SOURCES

CINAHL, Medline, Scopus, and PsycINFO electronic databases were searched for abstracts published between 2005 and 2015 and written in English. Reference lists were hand searched.

REVIEW METHODS

Whittemore and Knafl's integrative review method was used to guide this review. The constant comparative method was used to analyze and synthesize data from 27 peer-reviewed quantitative and qualitative articles. Methodological quality of included studies was assessed using the Mixed Methods Assessment Tool.

RESULTS

Emotional labour is a facet of all aspects of nursing work and nurse-patient/family/collegial interactions. Emotional dissonance arising from surface acting in emotional labour can lead to stress and burnout. Resilience can be a protective process for the negative effects of emotional labour. Several resilience interventions have been designed to strengthen nurses' individual resources and reduce the negative effects of workplace stress; however they do not specifically address emotional labour. Inclusion of emotional labour-mitigating strategies is recommended for future resilience interventions.

CONCLUSION

Resilience is a significant intervention that can build nurses' resources and address the effects of emotional dissonance in nursing work. There is a need for further investigation of the relationship between resilience and emotional labour in nursing, and robust evaluation of the impact of resilience interventions that address emotional labour.

Participatory epidemiology: the contribution of participatory research to epidemiology

Background

Epidemiology has contributed in many ways to identifying various risk factors for disease and to promoting population health. However, there is a continuing debate about the ability of epidemiology not only to describe, but also to provide results which can be better translated into public health practice. It has been proposed that participatory research approaches be applied to epidemiology as a way to bridge this gap between description and action. A systematic account of what constitutes participatory epidemiology practice has, however, been lacking.

Methods

A scoping review was carried out focused on the question of what constitutes participatory approaches to epidemiology for the purpose of demonstrating their potential for advancing epidemiologic research. Relevant databases were searched, including both the published and non-published (grey) literature. The 102 identified sources were analyzed in terms of comparing common epidemiologic approaches to participatory counterparts regarding central aspects of the research process. Exemplary studies applying participatory approaches were examined more closely.

Results

A highly diverse, interdisciplinary body of literature was synthesized, resulting in a framework comprised of seven aspects of the research process: research goal, research question, population, context, data synthesis, research management, and dissemination of findings. The framework specifies how participatory approaches not only differ from, but also how they can enhance common approaches in epidemiology. Finally, recommendations for the further development of participatory approaches are given. These include: enhancing data collection, data analysis, and data validation; advancing capacity building for research at the local level; and developing data synthesis.

Conclusion

The proposed framework provides a basis for systematically developing the emergent science of participatory epidemiology.

Parent and Health Care Provider Perceptions for Development of a Web-Based Weight Management Program for Survivors of Pediatric Acute Lymphoblastic Leukemia: A Mixed Methods Study

Background

Survivors of pediatric acute lymphoblastic leukemia (ALL) may experience unhealthy weight gain during treatment, which has been associated with higher risk for chronic health issues.

Objective

The purpose of this study was to obtain feedback on weight management in pediatric ALL survivors and on the content and implementation of a Web-based weight management program.

Methods

Study participants included 54 parent survey respondents and 19 pediatric oncology professionals in 4 focus groups. Survey questions included report of child weight status and interest in participating in weight management programming at various time points. Pediatric oncology professionals were asked about the preferred topics and timing, as well as their role. Focus group data were analyzed by a multidisciplinary research team for common themes.

Results

The mean age of survivors was 6.5 years. By parent report, 19% of children were overweight and 25% were obese. Preferred timing for weight management program participation was within 3 months of starting maintenance chemotherapy (23/53, 43%) or within 12 months after completion of all cancer treatments (18/53, 34%). Pediatric oncology professionals likewise considered the maintenance phase appropriate. They considered parenting to be an important topic to include and indicated that their most appropriate roles would be promotion and support.

Conclusions

Parents and pediatric oncology professionals are interested in and supportive of early weight management in pediatric ALL survivors. Future research needs to identify strategies to integrate this into pediatric cancer care and to evaluate the feasibility and efficacy of these strategies.

Mixed-Methods Research in Diabetes Management via Mobile Health Technologies: A Scoping Review

Background

Considering the increasing incidence and prevalence of diabetes worldwide and the high level of patient involvement it requires, diabetes self-management is a serious issue. The use of mobile health (mHealth) in diabetes self-management has increased, but so far research has not provided sufficient information about the uses and effectiveness of mHealth-based interventions. Alternative study designs and more rigorous methodologies are needed. Mixed-methods designs may be particularly useful because both diabetes self-management and mHealth studies require integrating theoretical and methodological approaches.

Objective

This scoping review aimed to examine the extent of the use of mixed-methods research in mHealth-based diabetes management studies. The methodological approaches used to conduct mixed-methods studies were analyzed, and implications for future research are provided.

Methods

Guided by Arksey and O’Malley’s framework, this scoping review implemented a comprehensive search strategy including reviewing electronic databases, key journal searches, Web-based research and knowledge centers, websites, and handsearching reference lists of the studies. The studies focusing on mHealth technologies and diabetes management were included in the review if they were primary research papers published in academic journals and reported using a combination of qualitative and quantitative methods. The key data extracted from the reviewed studies include purpose of mixing, design type, stage of integration, methods of legitimation, and data collection techniques.

Results

The final sample (N=14) included studies focused on the feasibility and usability of mHealth diabetes apps (n=7), behavioral measures related to the mHealth apps (n=6), and challenges of intervention delivery in the mHealth context (n=1). Reviewed studies used advanced forms of mixed-methods designs where integration occurred at multiple points and data were collected using multiple techniques. However, the majority of studies did not identify a specific mixed-methods design or use accepted terminology; nor did they justify using this approach.

Conclusions

This review provided important insights into the use of mixed methods in studies focused on diabetes management via mHealth technologies. The prominent role of qualitative methods and tailored measures in diabetes self-management studies was confirmed, and the importance of using multiple techniques and approaches in this field was emphasized. This review suggests defining specific mixed-methods questions, using specific legitimation methods, and developing research designs that overcome sampling and other methodological problems in future studies.

Factors associated with parents' attitudes to the HPV vaccination of their adolescent sons : A systematic review

OBJECTIVE

The objective of the study was to identify factors associated with human papilloma virus (HPV) vaccine acceptability in parents of adolescent boys. This information is critical to the development of approaches to optimise HPV vaccine uptake among this population group.

METHODS

We performed a systematic search of the literature in addressing factors influencing parental attitudes to and beliefs about HPV vaccine and its acceptability for use. The findings were organised within the framework of the Health Belief Model (HBM) and summarised using a semi quantitative method.

RESULTS

Eighteen studies met the inclusion criteria. Parental decisions were predominantly shaped by the perceived benefits of the vaccine; perceived risk of sons contracting the HPV infection, and having recommendations from health care providers. Fear of side effects and uncertainty about vaccine effectiveness, as well as cost and lack of healthcare, were barriers to HPV vaccination. Other factors such as knowledge, family characteristics, parent-child dialogue and egalitarian values appeared to be important when deciding whether to vaccinate boys.

CONCLUSIONS

HPV vaccine uptake among male adolescents is suboptimal. Future programs need to address the predictors of uptake by educating parents about the boys' high susceptibility to infection, the benefits of vaccination, and reduce concerns regarding perceived barriers. Additionally, uptake may be facilitated by encouraging health care provider endorsement, particularly in countries without government-funded immunisation programs.

"Forewarned and forearmed": Long-term childhood cancer survivors' and parents' information needs and implications for survivorship models of care

OBJECTIVE

This mixed-method study assessed 1) survivors' and parents' information needs; and 2) associations between unmet information needs and clinical and socio-demographic characteristics.

METHODS

Stage 1: CCS and parents of CCS, >5years post-diagnosis completed a questionnaire on information needs, overall health and perceived risk. Predictors for unmet information needs were assessed by multivariable regression. Stage 2: participants were interviewed in-depth on these topics.

RESULTS

Questionnaires were completed by 485 participants comprising 322 survivors (mean age: 26.7years, SD=7.9; time since diagnosis: 19.7years, SD=8.8) and 163 parents (child age: 12.9years, SD=2.4; time since diagnosis: 9.7years, SD=2.3), and complemented by 70 interviews. Survivors reported unmet information needs about late effects (57.5%) and parents for fertility issues (62.5%). Survivors had more unmet needs for medical information whereas parents had significantly more regarding sexual issues and lifestyle. Being a parent (p=0.001), dissatisfaction with follow-up care (p=0.003), lower overall health (p=0.014), higher perceived risk of late effects (p<0.001), and greater anxiety/depression (p<0.001) were significantly associated with more unmet needs.

CONCLUSION

Unmet information needs were common for survivors and parents of CCS.

PRACTICE IMPLICATIONS

Future efforts towards tailoring information on potential late effects, healthy lifestyles and follow-up care may help to address unmet information needs.

Exploring Injury Panorama, Consequences, and Recovery among Bus Crash Survivors: A Mixed-Methods Research Study

OBJECTIVE

The aim of this study was to explore physical and mental consequences and injury mechanisms among bus crash survivors to identify aspects that influence recovery.

METHODS

The study participants were the total population of survivors (N=56) from a bus crash in Sweden. The study had a mixed-methods design that provided quantitative and qualitative data on injuries, mental well-being, and experiences. Results from descriptive statistics and qualitative thematic analysis were interpreted and integrated in a mixed-methods analysis.

RESULTS

Among the survivors, 11 passengers (20%) sustained moderate to severe injuries, and the remaining 45 (80%) had minor or no physical injuries. Two-thirds of the survivors screened for posttraumatic stress disorder (PTSD) risk were assessed, during the period of one to three months after the bus crash, as not being at-risk, and the remaining one-third were at-risk. The thematic analysis resulted in themes covering the consequences and varying aspects that affected the survivors' recoveries. The integrated findings are in the form of four "core cases" of survivors who represent a combination of characteristics: injury severity, mental well-being, social context, and other aspects hindering and facilitating recovery. Core case Avery represents a survivor who had minor or no injuries and who demonstrated a successful mental recovery. Core case Blair represents a survivor with moderate to severe injuries who experienced a successful mental recovery. Core case Casey represents a survivor who sustained minor injuries or no injuries in the crash but who was at-risk of developing PTSD. Core case Daryl represents a survivor who was at-risk of developing PTSD and who also sustained moderate to severe injuries in the crash.

CONCLUSION

The present study provides a multi-faceted understanding of mass-casualty incident (MCI) survivors (ie, having minor injuries does not always correspond to minimal risk for PTSD and moderate to severe injuries do not always correspond to increased risk for PTSD). Injury mitigation measures (eg, safer roadside material and anti-lacerative windows) would reduce the consequences of bus crashes. A well-educated rescue team and a compassionate and competent social environment will facilitate recovery. Doohan I , Björnstig U , Östlund U , Saveman BI . Exploring injury panorama, consequences, and recovery among bus crash survivors: a mixed-methods research study. Prehosp Disaster Med. 2017;32(2):165-174.

Development of a Self-Rated Mixed Methods Skills Assessment: The National Institutes of Health Mixed Methods Research Training Program for the Health Sciences

INTRODUCTION

Demand for training in mixed methods is high, with little research on faculty development or assessment in mixed methods. We describe the development of a self-rated mixed methods skills assessment and provide validity evidence. The instrument taps six research domains: "Research question," "Design/approach," "Sampling," "Data collection," "Analysis," and "Dissemination." Respondents are asked to rate their ability to define or explain concepts of mixed methods under each domain, their ability to apply the concepts to problems, and the extent to which they need to improve.

METHODS

We administered the questionnaire to 145 faculty and students using an internet survey. We analyzed descriptive statistics and performance characteristics of the questionnaire using the Cronbach alpha to assess reliability and an analysis of variance that compared a mixed methods experience index with assessment scores to assess criterion relatedness.

RESULTS

Internal consistency reliability was high for the total set of items (0.95) and adequate (≥0.71) for all but one subscale. Consistent with establishing criterion validity, respondents who had more professional experiences with mixed methods (eg, published a mixed methods article) rated themselves as more skilled, which was statistically significant across the research domains.

DISCUSSION

This self-rated mixed methods assessment instrument may be a useful tool to assess skills in mixed methods for training programs. It can be applied widely at the graduate and faculty level. For the learner, assessment may lead to enhanced motivation to learn and training focused on self-identified needs. For faculty, the assessment may improve curriculum and course content planning.

Why the Qualms With Qualitative? Utilizing Qualitative Methods in 360° Feedback

Although the authors of the focal article provide a comprehensive definition of 360° feedback, one exclusionary criterion results in an overly narrow definition of 360° feedback. Specifically, Point 3 in their definition described the criticality of strictly using quantitative methods in collecting 360° feedback. The authors provided a brief rationale by stating, “Data generated from truly qualitative interviews would not allow comparisons between rater groups on the same set of behaviors” (Bracken, Rose, & Church, 2016, p. 765). Although there is little doubt about the value in taking a quantitative approach for gathering 360° feedback, it is not clear why this has to be the sole approach. Below, I outline three issues with taking this constricted methodology. That is, first, excluding qualitative methods is not in line with the purpose of 360° feedback, which is directed at minimizing criterion deficiency. Second, qualitative methodologies (in conjunction with quantitative methodologies) are more equipped to provide and inspire a call to action (supporting the change component addressed by the authors). Finally, there are qualitative methods that allow for rigorous quantitative analysis and can provide an additional source of macro organizational-level data.

Performance of a mixed filter to identify relevant studies for mixed studies reviews

OBJECTIVE

Mixed studies reviews include empirical studies with diverse designs. Given that identifying relevant studies for such reviews is time consuming, a mixed filter was developed.

METHODS

The filter was used for six journals from three disciplines. For each journal, database records were coded "empirical" (relevant) when they mentioned a research question or objective, data collection, analysis, and results. We measured precision (proportion of retrieved documents being relevant), sensitivity (proportion of relevant documents retrieved), and specificity (proportion of nonrelevant documents not retrieved).

RESULTS

Records were coded with and without the filter, and descriptive statistics were performed, suggesting the mixed filter has high sensitivity.