Designing a learning tool for translating resilience in healthcare into practice: A qualitative mixed methods study

There is currently a lack of tools that focus on strengthening resilient performance of healthcare systems through learning from positive healthcare events. Such tools are needed to operationalize and translate resilience in healthcare and, thus, advance the field of patient safety by learning from both positive and negative events and outcomes. The purpose of this study is to describe the developmental process of one such tool to enable operationalization of resilient healthcare and aid future tool development. The development process featured a complex, multi-step, design through involvement of a range of different stakeholders. A combination of publicly available platforms, cross-sectional knowledge, step-by step instructions and a learning tool that engages participants in collaborative practice to facilitate discussions across stakeholders and system levels is proposed as a means to create awareness of when and what contributes to resilient performance is fundamental to understanding and improving healthcare system resilience.

Computational modeling of neuron-glia signaling interactions to unravel cellular and neural circuit functioning

Glial cells have been shown to be vital for various brain functions, including homeostasis, information processing, and cognition. Over the past 30 years, various signaling interactions between neuronal and glial cells have been shown to underlie these functions. This review summarizes the interactions, particularly between neurons and astrocytes, which are types of glial cells. Some of the interactions remain controversial in part due to the nature of experimental methods and preparations used. Based on the accumulated data, computational models of the neuron-astrocyte interactions have been developed to explain the complex functions of astrocytes in neural circuits and to test conflicting hypotheses. This review presents the most significant recent models, modeling methods and simulation tools for neuron-astrocyte interactions. In the future, we will especially need more experimental research on awake animals in vivo and new computational models of neuron-glia interactions to advance our understanding of cellular dynamics and the functioning of neural circuits in different brain regions.

Innovative computational tools provide new insights into the polyploid wheat genome

Bread wheat (Triticum aestivum) is an important crop and serves as a significant source of protein and calories for humans, worldwide. Nevertheless, its large and allopolyploid genome poses constraints on genetic improvement. The complex reticulate evolutionary history and the intricacy of genomic resources make the deciphering of the functional genome considerably more challenging. Recently, we have developed a comprehensive list of versatile computational tools with the integration of statistical models for dissecting the polyploid wheat genome. Here, we summarize the methodological innovations and applications of these tools and databases. A series of step-by-step examples illustrates how these tools can be utilized for dissecting wheat germplasm resources and unveiling functional genes associated with important agronomic traits. Furthermore, we outline future perspectives on new advanced tools and databases, taking into consideration the unique features of bread wheat, to accelerate genomic-assisted wheat breeding.

A framework for evaluating the diversity of clinical trials

OBJECTIVES

The topic of diversity in clinical trials is rising to the forefront of many conversations in evidence-based medicine, and efforts are being made to improve the diversity of clinical trials. However, there is little uniformity in the methods used to evaluate these efforts. In this article, we describe our Clinical trial Diversity Rating (CDR) framework and the development process, including the broader considerations for evaluating the demographic diversity of clinical trials and their implications, and demonstrate its use through an illustrative example.

STUDY DESIGN AND SETTING

The development of the framework was a four-step process, including a scoping review, a cross-sectional study, creation of the tool, and integration of feedback from an advisory group.

RESULTS

Our scoping review identified 110 publications that examined clinical trial diversity. Race/ethnicity, sex, and age were the most common characteristics evaluated. About 85% clearly defined the benchmark used for evaluation, but less than half (48%) used disease prevalence as the benchmark. Only 64% of studies defined what would be considered adequate representation. The cross-sectional study, which applied some of the approaches identified in the literature, helped to identify the complexities of evaluating multinational trials and certain demographic characteristics. Key decisions for the CDR framework, such as the demographic characteristics to be evaluated, the benchmark and thresholds for evaluation, and how these factors contribute to the overall rating of clinical trial diversity, were informed by the two earlier phases and feedback from an advisory group.

CONCLUSION

The CDR framework provides an objective and transparent approach to evaluating clinical trial diversity. Groups such as Health Technology Assessment bodies, clinical trial regulators, policymakers, journal editors, and individual researchers can use this tool to examine, monitor, and improve diversity in clinical trials.

Multi-staged development and pilot testing of a self-assessment tool for organizational health literacy

BACKGROUND

Until now a comprehensive, consensus-based tool that can be used by a variety of health care organizations for assessing their organizational health literacy (OHL) is not available. Therefore, we aimed to develop and test a literature- and consensus-based self-assessment tool.

METHODS

The study is based on a scoping review that was previously published by the authors. For the development of the self-assessment tool, the criteria identified in the literature were synthesized with criteria gained through group discussions with representatives of different types of health care organizations (N = 27) all based in Hamburg (Germany). Consensus on the criteria was reached by conducting a Delphi process (N = 22). A review by the project's patient advisory council was included in the process. The self-assessment tool was converted into an online tool and refined by a pretest. Finally, the online survey was piloted (N = 53) and the reliability and item loadings for each scale were analyzed.

RESULTS

In total, 77 criteria (items) characterizing a health literate health care organization were developed and grouped into five main categories (scales): (1) "easy access and navigation", (2) "integration, prioritization, and dissemination of OHL", (3) "qualification, quality management, evaluation, and needs assessment", (4) "communication with target groups", and (5) "involvement and support of target groups". The results of the online survey showed that the tool is suitable for assessing an organization's status quo on OHL. The psychometric analysis showed good to excellent internal consistency. Item analyses of the developed self-assessment tool was satisfactory.

CONCLUSIONS

We were able to define a set of 77 items to characterize OHL, which were integrated into a new, comprehensive, and consensus-based self-assessment tool to identify areas for improvement. We found evidence that the self-assessment tool, based on the identified criteria, consists of the assumed five scales. Further research should analyze the validity of the self-assessment tool on a higher detail level.

Cultural Expression of Anxiety Symptoms in Kannada Language: A Qualitative Study

Background

In anxiety disorders, culture is important in symptom presentation and help-seeking. Most tools for anxiety disorders are not validated in India and thus might not capture culture-specific aspects of anxiety. This study aims to identify and generate culturally specific terms to describe symptoms of anxiety as part of the development of the Kannada version of the Panic and Anxiety National Indian Questionnaire (PANIQ). The PANIQ is a tool under development to identify anxiety and panic in Indian settings.

Methods

This study used qualitative methods like focus group discussions (FGDs) and in-depth interviews (IDIs) to identify and generate items related to anxiety and panic in Kannada from stakeholders like individuals with anxiety disorders, their caregivers, healthcare workers, and mental health professionals who treat individuals with anxiety and panic disorders. Five FGDs (n = 28), one triad (n = 3), and 34 IDIs (n = 34) were conducted.

Results

The mean age of the participants was 38.9 (standard deviation: 12.28) years; 57.1% were from rural areas. We generated 615 Kannada items. These were classified into 21 domains and facets. Items in domains like Somatic symptoms, Fear, and Impairment in day-to-day life were higher than those noted in existing tools for anxiety that focus more on cognitive symptoms of anxiety.

Conclusions

This study generated culturally specific items of anxiety through a qualitative process of tool development incorporating subjective experiences of persons with anxiety disorders and other stakeholders. This is among the first steps toward the development of PANIQ.

Development and validation of tools to screen occupational mental health and workplace factors influencing it: for the Indian workforce

An imbalance in the key organizational psychology constructs viz. "Workload", "Reward", "Community", "Control", "Values" and "Fairness" are potential factors leading to negative occupational mental health, i.e. burnout. Burnout, a psychological syndrome is the combination of emotional exhaustion, sense of reduced compassion and accomplishment. To note, the concept of occupational mental health in a nation with second largest workforce is nascent. Further, the utility of existing western tools in Indian subcontinent is limited by culturally inappropriateness, patented, less comprehensible and other factors. Present study attempted to develop tools to screen occupational mental health and workplace areas. Conventional steps involved in psychological tool development, viz. construct identification, drafting of pertinent questions, content validation, field testing of questions and others were adopted. After series of steps, tools for screening occupational mental health and key constructs influencing mental health at workplace (workplace assessment) were developed. The screening tools exhibited adequate test-retest reliability, internal consistency/reliability (cronbach's α>0.73) and correlation (correlation coefficient >0.6) with the general mental health in larger evaluation of 153 consenting workers. The proposed simple and easy to administer tool requires development of normative scores thereby aiding early diagnosis and management of those requiring intervention.

Study protocol: development and pilot testing of the Critical Care Pain Observation Tool for families (CPOT-Fam)

Background

Patients in the intensive care unit (ICU) often have limited ability to communicate making it more difficult to identify and effectively treat their pain. Family caregivers or close friends of critically ill patients may be able to identify signs of pain before the clinical care team and could potentially assist in routine pain assessments. This study will adapt the Critical Care Pain Observation Tool (CPOT) for use by family members to create the CPOT-Fam and compare family CPOT-Fam assessments with nurse-provided CPOT assessments for a given patient.

Methods

This study will be executed in two phases:

1) Development of the CPOT-Fam — A working group of patient partners, ICU clinicians, and researchers will adapt the CPOT for use by family caregivers (creating the CPOT-Fam) and produce an accompanying educational module to deliver information on pain and how to use the tool. The CPOT-Fam will undergo preclinical testing with participants (i.e., members of the public and family caregivers of critically ill adults), who will complete the educational module and provide CPOT-Fam scores on sample cases. Feedback on the CPOT-Fam will be collected.

2) Pilot testing the CPOT — Fam family caregivers of critically ill adults will complete the educational module and provide information on the following: (1) demographics, (2) anxiety, (3) caregiving self-efficacy, and (4) satisfaction with care in the ICU. Family caregivers will then provide a proxy assessment of their critically ill loved one’s pain through the CPOT-Fam and also provide a subjective (i.e., questionnaire-based including open-ended responses) account of their loved one’s pain status. A comparison (i.e., agreement) will be made between family caregiver provided CPOT-Fam scores and ICU nurse-provided CPOT scores (collected from the provincial health information system), calculated independently and blinded to one another. Feasibility and acceptability of the CPOT-Fam will be determined.

Discussion

The results of this work will produce a family caregiver CPOT (i.e., CPOT-Fam), determine feasibility and acceptability of the CPOT-Fam, and compare pain assessments conducted by family caregivers and ICU nurses. The results will inform whether a larger study to determine a role for family caregivers in ICU pain assessment using the CPOT-Fam is warranted.

Supplementary Information

The online version contains supplementary material available at 10.1186/s40814-022-01102-3.

Clinical feasibility, utility, and usability of the Profile of Preschool Communication: A pilot test in community settings

AIM

. This study aimed to pilot test, assess usability and utility of, and identify barriers to implementation for the Profile of Preschool Communication (PPC) - a new data collection tool designed to support outcome monitoring in preschool speech-language programs and practice-based research.

METHODS

. This pilot study was conducted with three sites in the Ontario Preschool Speech and Language (PSL) program. Twenty-three speech-language pathologists used the PPC for all outcome monitoring assessments for 2-3-months and provided feedback about their experience using it in practice. Then, 18 of the 23 speech-language pathologists completed online surveys to rate usability and utility, and report their perceived implementation barriers and facilitators.

RESULTS

. Speech-language pathologists reported difficulties completing some sections of the PPC, most notably obtaining data related to maternal education and family history of mental health concerns. Usability and utility were generally rated favorably with some items rated as neutral. Barriers to implementation included the paper format, completion time, requirement to ask personal questions, and the perception by some that data were useful for outcome monitoring but not practice. Facilitators included ease of use, an improvement over the existing tool, and the collection of data to support service planning.

CONCLUSIONS

. The PPC shows potential as an outcome monitoring data collection tool in preschool speech-language pathology programs. Findings will be of interest to researchers engaged in practice-based research and those interested in engaging end users to develop clinically meaningful tools.

Sustainability assessment of short food supply chains (SFSC): developing and testing a rapid assessment tool in one African and three European city regions

Recent literature demonstrates the contribution of short food supply chains (SFSC) to regional economies and sustainable food systems, and acknowledges their role as drivers for sustainable development. Moreover, different types of SFSC have been supported by urban food policies (UFP) over the few last years and actors from the food chain became part of new institutional settings for urban food policies. However, evidence from the sustainability impact assessment (SIA) of these SFSC in urban contexts is limited. Our paper presents an approach for the development of an SIA framework for different SFSC types. In addition, a practical application of the tool in four metropolitan regions (Berlin, London, Ljubljana and Nairobi) is tested. The conceptual development of the SIA framework is based on an in-depth analysis of existing SIA frameworks and methods for assessing the sustainability of agriculture, food chains and food systems and adapted to the specific needs of analysing SFSC in metropolitan regions. The operational value and utility of the framework and the tool were tested with social and natural scientists and local stakeholders. The assessment results demonstrate that SFSC seems to be more sustainable than the baseline (long global food chains) in the social dimension, but also feature specific strengths and weaknesses concerning their economic and environmental sustainability. This might give an indication for regional adjusted strategies and food chain innovations that improve the sustainability performance may be required. We found the tool useful for framing the dialogue between food chain actors, consumers and policy, because it makes benefits and trade-offs of the chain types operating in an urban-rural context more visible and communicable.

SUPPLEMENTARY INFORMATION

The online version contains supplementary material available at 10.1007/s10460-021-10288-w.

The Taxonomy of Opportunities to Learn (TxOTL): a tool for understanding the learning potential and substance of interactions in faculty (online) learning community meetings

BACKGROUND

While many research-based instructional strategies in STEM have been developed, faculty need support in implementing and sustaining use of these strategies. A number of STEM faculty professional development programs aim to provide such pedagogical support, and it is necessary to understand the activity and learning process for faculty in these settings. In this paper, a taxonomy for describing the learning opportunities in faculty (online) learning community meetings is presented. Faculty learning communities, meeting either in-person or (increasingly) online, are a common form of professional development. They aim to develop the pedagogical and reflective skills of participants through regular meetings centered on conversations about teaching and learning.

RESULTS

The tool presented in this paper, the Taxonomy of Opportunities to Learn (TxOTL), provides a structured approach to making sense of the dynamic interactions that occur during faculty learning community meetings. The origins and development of the TxOTL are described, followed by a detailed presentation of the constructs that make up the TxOTL: communicative approach used in a conversation, the concepts developed, and the meeting segment category. The TxOTL characterizes the learning opportunities presented by a faculty learning community conversation through describing the content of the conversation as well as how participants engage in the conversation. Examples of the tool in use are provided through an application to a faculty online learning community serving instructors of a physical science curriculum. A visual representation used to compactly display the results of applying the taxonomy to a meeting is detailed as well. These examples serve to illustrate the types of claims the TxOTL facilitates.

CONCLUSIONS

The TxOTL allows one to examine learning opportunities available to a faculty learning community group, analyze concept development present in their conversations, track change over time in a given group, and identify patterns between meeting segment categories and communicative approaches. It is useful for researchers as well as facilitators of these STEM faculty professional development groups. The taxonomy is most applicable to faculty (online) learning communities, with limited use for workshops and K-12 professional development contexts.

SUPPLEMENTARY INFORMATION

The online version contains supplementary material available at (10.1186/s40594-021-00301-3).

A two-component pictured-based appetite assessment tool is capable of detecting appetite sensations in younger children: A pilot study

Visual analogue scales (VAS) have commonly been used to assess appetite in children 8 years and older; however, these tools have been considered unreliable for children 7 years old and under. The objective of this pilot study was to develop a picture-based appetite assessment (PBAA) tool for children aged 4-10 years and pilot test it compared to a VAS-based appetite assessment. The study hypothesis was that the PBAA scores would decrease following the consumption of an ad libitum snack compared to the scores in the fasted state in children 4 to 10 years old; furthermore, there would be a good level of agreement (intraclass correlation coefficients >0.75) between the appetite scores by the PBAA and VAS tools in children aged 8 years or older. At Visit 1, in a fasted state, all children (n = 15) completed the PBAA. Children who were 8-10 years old (n = 8) also completed the VAS-based appetite assessment. Then, an ad libitum snack was provided, and appetite assessments were repeated at 5-, 30- and 60-minutes post-snack. The same assessments were completed at visit 2 pre (fasting)- and post-consumption of a snack containing 25% of the amount consumed at visit 1 (limited snack). PBAA scores were different across time (P < .001) and between types of meal (ad libitum vs limited snack) (P = .015) in all children. A good agreement between the PBAA and VAS scores at 30 and 60 minutes after both types of meal was found (intraclass correlation coefficients >0.75). The PBAA tool was able to detect expected changes in appetite sensations and was in good agreement with the VAS instrument.

Development of a tool for identifying and addressing prioritised determinants of quality improvement initiatives led by healthcare professionals: a mixed-methods study

Background

Several frameworks have been developed to identify essential determinants for healthcare improvement. These frameworks aim to be comprehensive, leading to the creation of long lists of determinants that are not prioritised based on being experienced as most important. Furthermore, most existing frameworks do not describe the methods or actions used to identify and address the determinants, limiting their practical value. The aim of this study is to describe the development of a tool with prioritised facilitators and barriers supplemented with methods to identify and address each determinant. The tool can be used by those performing quality improvement initiatives in healthcare practice.

Methods

A mixed-methods study design was used to develop the tool. First, an online survey was used to ask healthcare professionals about the determinants they experienced as most facilitating and most hindering during the performance of their quality improvement initiative. A priority score was calculated for every named determinant, and those with a priority score ≥ 20 were incorporated into the tool. Semi-structured interviews with implementation experts were performed to gain insight on how to analyse and address the determinants in our tool.

Results

The 25 healthcare professionals in this study experienced 64 facilitators and 66 barriers when performing their improvement initiatives. Of these, 12 facilitators and nine barriers were incorporated into the tool. Sufficient support from management of the department was identified as the most important facilitator, while having limited time to perform the initiative was considered the most important barrier. The interviews with 16 experts in implementation science led to various inputs for identifying and addressing each determinant. Important themes included maintaining adequate communication with stakeholders, keeping the initiative at a manageable size, learning by doing and being able to influence determinants.

Conclusions

This paper describes the development of a tool with prioritised determinants for performing quality improvement initiatives with suggestions for analysing and addressing these determinants. The tool is developed for those engaged in quality improvement initiatives in practice, so in this way it helps in bridging the research to practice gap of determinants frameworks. More research is needed to validate and develop the tool further.

Development and pilot of a tool to measure the healthiness of the in-store food environment

Objective:

To rigorously develop a tool which enables rapid yet comprehensive appraisal of the consumer food retail environment and provision of real-time feedback to store managers and owners, based on the ‘4Ps’ principles of marketing.

Design:

Multi-stage iterative approach including (1) Systematic literature review; (2) Stakeholder consultation; (3) Assessment of existing tools against identified needs; (4) Tool development; (5) Pilot testing and (6) Transition of tool to mobile application (the Store Scout app).

Setting:

Northern Territory, Australia.

Participants:

Nine remote Aboriginal community food stores; public health nutritionists, retailers, store board directors, Aboriginal community members, government representatives.

Results:

Forty-seven existing tools and thirty-four stakeholder interviews informed the development of the current instrument, which comprised: (1) seven product categories (Fruit & Vegetables, Drinks, Snack Foods, Meals & Convenience Foods, Meat & Seafood, Dairy & Eggs, Breads & Cereals) across the ‘4Ps’ (Product, Placement, Price, Promotion); (2) Store manager questions about context and perceived importance of key principles about the store environment and (3) a scoring and feedback component. The tool was considered feasible and acceptable by all testers.

Conclusions:

The developed tool addresses an unmet need to measure the consumer food retail environment across all 4Ps whilst also incorporating manager perspectives and immediate feedback. Our objectives of developing a comprehensive, feasible and acceptable instrument were achieved during pilot testing. The tool will support implementation of best practice within stores to encourage healthy food choices and has potential for broad application in retail settings locally and internationally, as well as for research purposes.

Enhancing Formative Feedback in Orthopaedic Training: Development and Implementation of a Competency-Based Assessment Framework

OBJECTIVE

The purpose of this study was to develop, implement, and evaluate the effectiveness of an assessment framework aimed at improving formative feedback practices in a Canadian orthopaedic postgraduate training program.

METHODS

Tool development began in 2014 and took place in 4 phases, each building upon the previous and informing the next. The reliability, validity, and educational impact of the tools were assessed on an ongoing basis, and changes were made accordingly.

RESULTS

One hundred eighty-two tools were completed and analyzed during the study period. Quantitative results suggested moderate to excellent agreement between raters (intraclass correlation coefficient = 0.54-0.93), and an ability of the tools to discriminate between learners at different stages of training (p's < 0.05). Qualitative data suggested that the tools improved both the quality and quantity of formative feedback given by assessors and had begun to foster a culture change around assessment in the program.

CONCLUSIONS

The tool development, implementation, and evaluation processes detailed in this article can serve as a model for other training programs to consider as they move towards adopting competency-based approaches and refining current assessment practices.

Perceived cultural differences in healthcare for foreign patients visiting South Korea: tool development and measurement

Background

We developed a 41-item tool measuring cultural differences in healthcare as perceived by foreign patients visiting South Korea.

Methods

The tool was tested on 256 foreign patients who visited three tertiary hospitals in Seoul, South Korea. Content validity was explored by two physicians and eight nurses working in an international healthcare department. Structural validity was tested via exploratory factor analysis and by testing two hypotheses: (1) there are perceived cultural differences between the South Korean healthcare and those of foreign patients’ home countries (one-sample t-test); and, (2) Perceived cultural differences vary among language groups (analysis of variance). We also calculated Cronbach’s alpha.

Results

The content validity index of the tool was 0.97. Exploratory factor analysis identified seven significant factors: hospital care and services, food, the healthcare system, communication, the healthcare facility, religion, and cultural values. The overall Cronbach’s alpha for the tool was 0.96, indicating very high internal consistency. We found that foreign patients visiting South Korean hospitals perceived that the healthcare culture differed significantly from that of their home country. The perceived cultural differences varied significantly by language group.

Conclusions

Nurses can use our new tool to understand the cultural differences of foreign patients and provide them with culturally competent nursing care.

T-CaST: an implementation theory comparison and selection tool

Background

Theories, models, and frameworks (TMF) are foundational for generalizing implementation efforts and research findings. However, TMF and the criteria used to select them are not often described in published articles, perhaps due in part to the challenge of selecting from among the many TMF that exist in the field. The objective of this international study was to develop a user-friendly tool to help scientists and practitioners select appropriate TMF to guide their implementation projects.

Methods

Implementation scientists across the USA, the UK, and Canada identified and rated conceptually distinct categories of criteria in a concept mapping exercise. We then used the concept mapping results to develop a tool to help users select appropriate TMF for their projects. We assessed the tool’s usefulness through expert consensus and cognitive and semi-structured interviews with implementation scientists.

Results

Thirty-seven implementation scientists (19 researchers and 18 practitioners) identified four criteria domains: usability, testability, applicability, and familiarity. We then developed a prototype of the tool that included a list of 25 criteria organized by domain, definitions of the criteria, and a case example illustrating an application of the tool. Results of cognitive and semi-structured interviews highlighted the need for the tool to (1) be as succinct as possible; (2) have separate versions to meet the unique needs of researchers versus practitioners; (3) include easily understood terms; (4) include an introduction that clearly describes the tool’s purpose and benefits; (5) provide space for noting project information, comparing and scoring TMF, and accommodating contributions from multiple team members; and (6) include more case examples illustrating its application. Interview participants agreed that the tool (1) offered them a way to select from among candidate TMF, (2) helped them be explicit about the criteria that they used to select a TMF, and (3) enabled them to compare, select from among, and/or consider the usefulness of combining multiple TMF. These revisions resulted in the Theory Comparison and Selection Tool (T-CaST), a paper and web-enabled tool that includes 16 specific criteria that can be used to consider and justify the selection of TMF for a given project. Criteria are organized within four categories: applicability, usability, testability, and acceptability.

Conclusions

T-CaST is a user-friendly tool to help scientists and practitioners select appropriate TMF to guide implementation projects. Additionally, T-CaST has the potential to promote transparent reporting of criteria used to select TMF within and beyond the field of implementation science.

Electronic supplementary material

The online version of this article (10.1186/s13012-018-0836-4) contains supplementary material, which is available to authorized users.

Developing a valid and reliable assessment of knowledge translation (KT) for continuing professional development program of health professionals

Introduction

Knowledge Translation (KT) is expected to be a critical learning outcome of a Continuing Professional Development (CPD) program. It continues to serve as an area of interest among educators and healthcare providers due to its importance to evidence-based practice. This study endeavored to develop a valid and reliable KT learning assessment tool in CPD.

Methods

The Inventory of Reflective Vignettes (IRV), an innovative approach of integrating research vignettes, was utilized in crafting the 20-item IRV-KT tool. This instrument includes knowledge creation and action as essential KT constructs. KT competency was assessed in three segments (i.e., before and after CPD event and if in a lecture) using a one-group post-posttest pre-experimental design. Health professionals who successfully completed a CPD program on a knowledge translation topic were asked to complete the IRV-KT during the pilot study (n = 10) and actual implementation (n = 45). Responses were subjected to Cronbach’s reliability and criterion-validity testing.

Results

The initial test of the IRV-KT tool demonstrated a high internal reliability (α = 0.97) and most items yielded acceptable validity scores. During the actual implementation, a higher reliability score of 0.98 was generated with significant correlations between the before-after segments for both KT constructs of creation (r = 0.33, p < 0.05) and action (r = 0.49, p < 0.05). All items have significant positive validity coefficients (r > 0.35, p < 0.05) in all segments of the tool.

Discussion

The study produced a reflective assessment tool to validly and reliably assess KT learning in a CPD. IRV-KT is seen to guide the curriculum process of CPD programs to bridge learning and healthcare outcomes.

Development and validation of a mental health screening tool for asylum-seekers and refugees: the STAR-MH

BACKGROUND

There is no screening tool for major depressive disorder (MDD) or post-traumatic stress disorder (PTSD) in asylum-seekers or refugees (ASR) that can be readily administered by non-mental health workers. Hence, we aimed to develop a brief, sensitive and rapidly administrable tool for non-mental health workers to screen for MDD and PTSD in ASR.

METHODS

The screening tool was developed from an extant dataset (n = 121) of multiply screened ASR and tested prospectively (N = 192) against the M.I.N.I. (Mini International Neuropsychiatric Interview) structured psychiatric interview. Rasch, Differential Item Functioning and ROC analyses evaluated the psychometric properties and tool utility.

RESULTS

A 9-item tool with a median administration time of six minutes was generated, comprising two 'immediate screen-in' items, and a 7-item scale. The prevalence of PTSD &/or MDD using the M.I.N.I. was 32%, whilst 99% of other diagnosed mental disorders were comorbid with one or both of these. Using a cut-score of ≥2, the tool provided a sensitivity of 0.93, specificity of 0.75 and predictive accuracy of 80.7%.

CONCLUSIONS

A brief sensitive screening tool with robust psychometric properties that was easy to administer at the agency of first presentation was developed to facilitate mental health referrals for asylum-seekers and new refugees.

Developing and testing a nursing home end -of -life care chart audit tool

BACKGROUND

Nursing home (NH) administrators need tools to measure the effectiveness of care delivered at the end of life so that they have objective data on which to evaluate current practices, and identify areas of resident care in need of improvement.

METHODS

A three-phase mixed methods study was used to develop and test an empirically derived chart audit tool aimed at assessing the care delivered along the entire dying trajectory.

RESULTS

The Auditing Care at the End of Life (ACE) instrument contains 27 questions captured across 6 domains, which are indicative of quality end-of-life care for nursing home residents.

CONCLUSIONS

By developing a brief chart audit tool that captures best practices derived from expert consensus and the research literature, NH facilities will be equipped with one means for monitoring and assessing the care delivered to dying residents.

Piloting a programme tool to evaluate malaria case investigation and reactive case detection activities: results from 3 settings in the Asia Pacific

BACKGROUND

Case investigation and reactive case detection (RACD) activities are widely-used in low transmission settings to determine the suspected origin of infection and identify and treat malaria infections nearby to the index patient household. Case investigation and RACD activities are time and resource intensive, include methodologies that vary across eliminating settings, and have no standardized metrics or tools available to monitor and evaluate them.

METHODS

In response to this gap, a simple programme tool was developed for monitoring and evaluating (M&E) RACD activities and piloted by national malaria programmes. During the development phase, four modules of the RACD M&E tool were created to assess and evaluate key case investigation and RACD activities and costs. A pilot phase was then carried out by programme implementers between 2013 and 2015, during which malaria surveillance teams in three different settings (China, Indonesia, Thailand) piloted the tool over a period of 3 months each. This study describes summary results of the pilots and feasibility and impact of the tool on programmes.

RESULTS

All three study areas implemented the RACD M&E tool modules, and pilot users reported the tool and evaluation process were helpful to identify gaps in RACD programme activities. In the 45 health facilities evaluated, 71.8% (97/135; min 35.3-max 100.0%) of the proper notification and reporting forms and 20.0% (27/135; min 0.0-max 100.0%) of standard operating procedures (SOPs) were available to support malaria elimination activities. The tool highlighted gaps in reporting key data indicators on the completeness for malaria case reporting (98.8%; min 93.3-max 100.0%), case investigations (65.6%; min 61.8-max 78.4%) and RACD activities (70.0%; min 64.7-max 100.0%). Evaluation of the SOPs showed that knowledge and practices of malaria personnel varied within and between study areas. Average monthly costs for conducting case investigation and RACD activities showed variation between study areas (min USD $844.80-max USD $2038.00) for the malaria personnel, commodities, services and other costs required to carry out the activities.

CONCLUSION

The RACD M&E tool was implemented in the three pilot areas, identifying key gaps that led to impacts on programme decision making. Study findings support the need for routine M&E of malaria case reporting, case investigation and RACD activities. Scale-up of the RACD M&E tool in malaria-eliminating settings will contribute to improved programme performance to the high level that is required to reach elimination.

Development and psychometric testing of Holistic Clinical Assessment Tool (HCAT) for undergraduate nursing students

BACKGROUND

A major focus in nursing education is on the judgement of clinical performance, and it is a complex process due to the diverse nature of nursing practice. A holistic approach in assessment of competency is advocated. Difficulties in the development of valid and reliable assessment measures in nursing competency have resulted in the development of assessment instruments with an increase in face and content validity, but few studies have tested these instruments psychometrically. It is essential to develop a holistic assessment tool to meet the needs of the clinical education. The study aims to develop a Holistic Clinical Assessment Tool (HCAT) and test its psychometric properties.

METHODS

The HCAT was developed based on the systematic literature review and the findings of qualitative studies. An expert panel was invited to evaluate the content validity of the tool. A total of 130 final-year nursing undergraduate students were recruited to evaluate the psychometric properties (i.e. factor structure, internal consistency and test-retest reliability) of the tool.

RESULTS

The HCAT has good content validity with content validity index of .979. The exploratory factor analysis reveals a four-factor structure of the tool. The internal consistency and test-retest reliability of the HCAT are satisfactory with Cronbach alpha ranging from .789 to .965 and Intraclass Correlation Coefficient ranging from .881 to .979 for the four subscales and total scale.

CONCLUSIONS

HCAT has the potential to be used as a valid measure to evaluate clinical competence in nursing students, and provide specific and ongoing feedback to enhance the holistic clinical learning experience. In addition, HCAT functions as a tool for self-reflection, peer-assessment and guides preceptors in clinical teaching and assessment.

EU-OPENSCREEN-chemical tools for the study of plant biology and resistance mechanisms

EU-OPENSCREEN is an academic research infrastructure initiative in Europe for enabling researchers in all life sciences to take advantage of chemical biology approaches to their projects. In a collaborative effort of national networks in 16 European countries, EU-OPENSCREEN will develop novel chemical compounds with external users to address questions in, among other fields, systems and network biology (directed and selective perturbation of signalling pathways), structural biology (compound-target interactions at atomic resolution), pharmacology (early drug discovery and toxicology) and plant biology (response of wild or crop plants to environmental and agricultural substances). EU-OPENSCREEN supports all stages of a tool development project, including assay adaptation, high-throughput screening and chemical optimisation of the 'hit' compounds. All tool compounds and data will be made available to the scientific community. EU-OPENSCREEN integrates high-capacity screening platforms throughout Europe, which share a rationally selected compound collection comprising up to 300,000 (commercial and proprietary compounds collected from European chemists). By testing systematically this chemical collection in hundreds of assays originating from very different biological themes, the screening process generates enormous amounts of information about the biological activities of the substances and thereby steadily enriches our understanding of how and where they act.