R.I.M.E. and reason: multi-station OSCE enhancement to neutralize grade inflation

To offset grade inflation, many clerkships combine faculty evaluations with objective assessments including the Medical Examiners Subject Examination (NBME-SE) or Objective Structured Clinical Examination (OSCE), however, standardized methods are not established. Following a curriculum transition removing faculty clinical evaluations from summative grading, final clerkship designations of fail (F), pass (P), and pass-with-distinction (PD) were determined by combined NBME-SE and OSCE performance, with overall PD for the clerkship requiring meeting this threshold in both. At the time, 90% of students achieved PD on the Internal Medicine (IM) OSCE resulting in overall clerkship grades primarily determined by the NBME-SE. The clerkship sought to enhance the OSCE to provide a more thorough objective clinical skills assessment, offset grade inflation, and reduce the NBME-SE primary determination of the final clerkship grade. The single-station 43-point OSCE was enhanced to a three-station 75-point OSCE using the Reporter-Interpreter-Manager-Educator (RIME) framework to align patient encounters with targeted assessments of progressive skills and competencies related to the clerkship rotation. Student performances were evaluated pre- and post-OSCE enhancement. Student surveys provided feedback about the clinical realism of the OSCE and the difficulty. Pre-intervention OSCE scores were more tightly clustered (SD = 5.65%) around a high average performance with scores being highly negatively skewed. Post-intervention OSCE scores were more dispersed (SD = 6.88%) around a lower average with scores being far less skewed resulting in an approximately normal distribution. This lowered the total number of students achieving PD on the OSCE and PD in the clerkship, thus reducing the relative weight of the NMBE-SE in the overall clerkship grade. Student response was positive, indicating the examination was fair and reflective of their clinical experiences. Through structured development, OSCE assessment can provide a realistic and objective measurement of clinical performance as part of the summative evaluation of students.

A survey from the ESH Working Group on Diabetes and Metabolic Risk Factors

BACKGROUND

Healthcare providers are faced with an increasing number of patients with obesity and arterial hypertension. Preventing obesity-associated hypertension and appropriately managing patients with established disease are both important. Hence, the aim of our study was to evaluate the clinical care of patients with obesity and hypertension among ESH Excellence Centres (ECs).

METHODS

We conducted a cross-sectional, international 30-item survey through e-mails.

RESULTS

In total, 70 representatives of ECs participated (78% men) with 66% of them practicing medicine for more than 30 years and working in well-equipped clinics. Most were internists (41%) and cardiologists (37%) and 73% reported training on the management of obese patients with hypertension. A majority weigh their patients (77%) and evaluate patients for sleep disorders (93%). However, only 47% spend more than 5min to advise for lifestyle modification in general, 59% for weight loss, 56% for salt intake and 64% for exercise. Finally, a minority of participants ask patients if they like their body (6%) or about previous attempts to lose weight (28%), evaluate 24h urinary sodium excretion rate (22%) and provide written (15%) or personalized (10%) dietary advices. If the patient suffers also from type 2 diabetes mellitus, 66% switch treatment to GLP1 receptor agonists and 60% to SGLT2 inhibitors.

CONCLUSION

Most clinicians in ESH ECs are well educated regarding obesity-associated hypertension, and clinics are sufficiently equipped to manage these patients, as well. However, several deficits were reported regarding efforts to address and implement obesity specific aspects and interventions to improve care in patients with obesity and hypertension.

GLIM criteria for definition of malnutrition in peritoneal dialysis: a new aspect of nutritional assessment

Background: The aim of our study was to evaluate the effectiveness of Global Leadership Initiative on Malnutrition (GLIM) criteria in assessing malnutrition within the peritoneal dialysis (PD) population.Methods: We conducted a retrospective analysis involving 1057 PD patients across multiple institutions, characterized by an age of 56.1 ± 14.4 years, 464 (43.9%) female, and a median follow-up of 45 (25, 68) months. Malnutrition was diagnosed according to GLIM criteria. The endpoint event was overall mortality. The survival rate and hazard ratio (HR) of death between malnutrition and well-nourished were analyzed in all patients and various subgroups. Receiver operator characteristic curve and integrated discrimination improvement (IDI) were used to distinguish the efficacy of the nutritional tools prediction model.Results: According to the GLIM criteria, the prevalence of malnutrition among the study population was 34.9%. The adjusted HR of overall mortality was 2.91 (2.39 - 3.54, p < 0.001) for malnutrition versus well-nourished. In sensitivity analyses, the HR remained robust except the cardiovascular disease subgroup. The area under the curve of GLIM predicting 5-year mortality was 0.65 (0.62-0.68, p < 0.001). As a complex model for forecast the long-term mortality, the performance of adjusted factors combined with GLIM was poorer than combined malnutrition inflammation score (MIS) (IDI >0, p < 0.001), but fitter than combined geriatric nutritional risk index (GNRI) (IDI <0, p < 0.001).Conclusions: The GLIM criteria provide a viable tool for nutritional assessment in patients with PD, and malnutrition defined according to the GLIM can predict prognosis with an acceptable performance.

A systematic review of neurological airway respiratory cardiovascular other-surgical severity (NARCO-SS) score as a pediatric perioperative scoring system

OBJECTIVE

To systematically identify and synthesize the available evidence of the neurological airway respiratory cardiovascular other-surgical severity (NARCO-SS) score as compared to other pediatric specific perioperative scoring systems.

DESIGN

This systematic review was conducted in accordance with the Preferred Reporting Items for Systematic Review and Meta-analysis (PRISMA) statement. All studies in all languages comparing NARCO-SS with pediatric perioperative scoring systems against outcomes were included. Records were screened and data were extracted by three independent reviewers into standardized pilot-tested extraction templates.

DATA SOURCES

Electronic searches were performed in MEDLINE, Embase, Scopus, and CINAHL (from inception to February 2023).

REVIEW METHODS

The references were uploaded to a validated software for systematic reviews (Rayyan) and screened against the inclusion criteria. Full text of included studies were reviewed and the available data were tabulated. We conducted Risk of Bias analysis on the included studies using the Prediction model Risk Of Bias ASsessment Tool (PROBAST).

RESULTS

A meta-analysis could not be performed due to differences in outcome definitions across the included studies. Correlations between NARCO-SS scores, ASA-PS scores and the predefined outcomes of each study were presented as a narrative synthesis. The included studies were determined to have a high risk of bias using the PROBAST.

CONCLUSIONS

This review has identified a need for high-quality studies assessing NARCO-SS before recommendations for clinical practice can be made. Addressing its limitations and enhancing the NARCO-SS through targeted refinements of its individual descriptive categories could potentially lead to improvement in its overall predictive accuracy and facilitate wider adoption into clinical practice.

Psychometric evaluation of the appearance anxiety inventory in adolescents with body dysmorphic disorder

The Appearance Anxiety Inventory (AAI) is a self-report measure assessing the typical cognitions and behaviours of body dysmorphic disorder (BDD). Despite its use in research and clinical settings, its psychometric properties have not been evaluated in young people with BDD. We examined the factor structure, reliability, validity, and sensitivity to change of the AAI in 182 youths with BDD (82.9% girls; Mage = 15.56, SD = 1.37) consecutively referred to two specialist outpatient clinics in Stockholm, Sweden (n = 97) and London, England (n = 85). An exploratory factor analysis identified three factors, namely "threat monitoring", "camouflaging", and "avoidance", explaining 48.15% of the variance. The scale showed good internal consistency (McDonalds omega = 0.83) and adequate convergent validity with the Yale-Brown Obsessive-Compulsive Scale Modified for Body Dysmorphic Disorder for Adolescents (BDD-YBOCS-A; rs = 0.42) and the Clinical Global Impression-Severity Scale (rs = 0.32). Sensitivity to change was adequate, with AAI total scores and individual factor scores significantly decreasing over time in the subgroup of participants receiving multimodal treatment for BDD (n = 79). Change of AAI scores over treatment showed a positive statistically significant moderate-to-good correlation (r = 0.55) with changes in BDD symptom severity, measured by the BDD-YBOCS-A. The study provides empirical support for the use of the AAI in young people with BDD in clinical settings.

Assessing competency in exodontia: A UK perspective

INTRODUCTION

Assessment ensures that undergraduate students and postgraduate trainees are providing optimal patient care. Numerous assessment methods are currently being used within the United Kingdom. Therefore, the purpose of this review was to provide an overview of the methods used to assess competency in exodontia and compare methods against criteria defined for good assessment.

MATERIALS AND METHODS

A systematic narrative review was carried out. Databases were electronically searched for published studies assessing the competence of undergraduate students and postgraduate trainees in exodontia up to October 2023.The validity, reproducibility, equivalence, feasibility, educational impact, catalytic effect and acceptability of each assessment method was considered.

RESULTS

In this review, 591 undergraduate students (n = 529) and postgraduate dental trainees (n = 62) had their competence in exodontia assessed. Undergraduate students were assessed on simple exodontia with forceps and elevators, whereas postgraduate trainees were assessed on the surgical removal of mandibular third molars. Only one study took place in a simulated dental environment, the remaining (n = 7) took place in a clinical environment. A range of formative and summative assessment methods were identified including structured clinical objective tests (SCOT), self-assessment, peer assessment and logbooks. Common marking criteria such as global rating and checklist scales were also highlighted.

CONCLUSION

This review highlights the lack of evidence to support one form of assessment and the lack of consensus on assessment within the United Kingdom. Further research related to this topic, alongside the opinion of trainees and trainers is required to improve assessments. This will maximise learning opportunities for trainees and translate to better patient care.

ADHD and Anxiety Symptoms: Does Construct or Assessment Type Matter More?

OBJECTIVE

This study examined the relationships between self-reported ADHD symptoms, self-reported anxiety, and continuous performance test (CPT) performance.

METHOD

128 postsecondary students referred for clinical evaluation for possible ADHD and related conditions completed the Conners Adult ADHD Rating Scale, the Behavior Assessment Scale for Children, Third Edition, and either of two CPTs.

RESULTS

Multiple regression models found that when self-reported anxiety and CPT performance were used to simultaneously predict self-reported ADHD symptoms, CPT performance was not a significant predictor, whereas self-reported anxiety was. This finding was replicated across two different subsamples that took different CPTs.

CONCLUSION

Self-reported anxiety and ADHD symptoms are strongly related, but neither of these variables is significantly related to CPT performance. Implications for clinical practice and future research are discussed.

Ten tips for effective use and quality assurance of multiple-choice questions in knowledge-based assessments

Multiple-choice questions (MCQs) are the most popular type of items used in knowledge-based assessments in undergraduate and postgraduate healthcare education. MCQs allow assessment of candidates' knowledge on a broad range of knowledge-based learning outcomes in a single assessment. Single-best-answer (SBA) MCQs are the most versatile and commonly used format. Although writing MCQs may seem straight-forward, producing decent-quality MCQs is challenging and warrants a range of quality checks before an item is deemed suitable for inclusion in an assessment. Like all assessments, MCQ-based examinations must be aligned with the learning outcomes and learning opportunities provided to the students. This paper provides evidence-based guidance on the effective use of MCQs in student assessments, not only to make decisions regarding student progression but also to build an academic environment that promotes assessment as a driver for learning. Practical tips are provided to the readers to produce authentic MCQ items, along with appropriate pre- and post-assessment reviews, the use of standard setting and psychometric evaluation of assessments based on MCQs. Institutions need to develop an academic culture that fosters transparency, openness, equality and inclusivity. In line with contemporary educational principles, teamwork amongst teaching faculty, administrators and students is essential to establish effective learning and assessment practices.

Dental students' perceptions of simultaneous live and online OSCEs during the COVID-19 pandemic

INTRODUCTION

The Objective Structured Clinical Examination (OSCE) is a valid, reliable and reproducible assessment method traditionally carried out as a live examination but recently also provided online. The aim was to compare any differences in the perceptions of dental students participating in online and live OSCE using mixed methods.

MATERIALS AND METHODS

All Finnish fourth-year undergraduate dental students (n = 172) attended the exam in April 2021. Due to the COVID-19 pandemic, the official administrative restrictions in teaching in universities still existed in April 2021. By the time of the national OSCE, the pandemic situation varied in different parts of the country. Therefore, two of the universities conducted a live OSCE and two an online version of the OSCE. Data were collected after the OSCE using a voluntary anonymous electronic questionnaire with multiple-choice and open-ended questions (response rate 58%). Differences between the OSCE versions were analysed using the Mann-Whitney U test and open answers with qualitative content analysis.

RESULTS

The students considered both types of OSCE good in general. The main differences were found concerned adequate time allocation and overall technical implementation, in favour of the live OSCE. While a qualitative analysis revealed exam anxiety as the most often mentioned negative issue, overall, comments were positive.

CONCLUSION

Variation in the assessments between different question entities seemed to be wider than between the implemented OSCE versions. Time management in the OSCE should be further developed by managing the assignment of tasks.

Development of health literacy assessment scale for Thai stroke patients

BACKGROUND

One important factor influencing the treatment and rehabilitation results for stroke patients is their level of health literacy. In order to acquire comprehensive information for appropriate treatment and rehabilitation programs that will promote the optimal possible health outcomes, health literacy assessment should be done in stroke patients from the earliest stages of stroke onset.

OBJECTIVES

This research aimed to develop a health literacy assessment scale for Thai stroke patients and to evaluate the HL levels of those patients using that assessment scale.

METHODS

A draft version of the scale has been developed based on the literature review and focus group discussions. After tryout, content validity, corrected item-total correlation and internal consistency were examined. A confirmatory factor analysis (CFA) was conducted in 400 patients with stroke to test the construct validity.

RESULTS

The Health Literacy Assessment Scale for Thai Stroke Patients was successfully developed. The complete version featured 50 health literacy-related questions, along with seven demographic-related questions. This tool demonstrated good psychometric properties, including content validity (Item-objective congruence; IOC > 0.50), internal consistency (Cronbach's alpha = 0.951 to 0.955, overall = 0.94). Confirmatory factor analysis (CFA) also revealed good construct validity.

CONCLUSIONS

The Health Literacy Assessment Scale for Thai Stroke Patients (HLS-Th) is measuring five components cover all health literacy aspects necessary for Thai stroke patient. This novel measurement scale is an accurate psychometric tool for assessing the level of health literacy among Thai stroke survivors.

Health Needs Assessment in Home-Living Older Adults: Protocol for a Pre-Post Study

BACKGROUND

Conducting a health needs assessment for older adults is important, particularly for early detection and management of frailty. Such assessments can help to improve health outcomes, maintain overall well-being, and support older adults in retaining their independence as they age at home.

OBJECTIVE

In this study, a systematic approach to health needs assessment is adopted in order to reflect real-world practices in municipal health care and capture the nuances of frailty. The aim is to assess changes in frailty levels in home-living older adults over 5 months and to examine the observable functional changes from a prestudy baseline (t1) to a poststudy period (t2). Additionally, the study explores the feasibility of conducting the health needs assessment from the perspective of home-living older adults and their informal caregivers.

METHODS

Interprofessional teams of registered nurses, physiotherapists, and occupational therapists will conduct 2 health needs assessments covering physical, cognitive, psychological, social, and behavioral domains. The study includes 40 home-living older adults of 75 years of age or older, who have applied for municipal health and care services in Norway. A quantitative approach will be applied to assess changes in frailty levels in home-living older adults over 5 months. In addition, we will examine the observable functional changes from t1 to t2 and how these changes correlate to frailty levels. Following this, a qualitative approach will be used to examine the perspectives of participants and their informal caregivers regarding the health needs assessment and its feasibility. The final sample size for the qualitative phase will be determined based on the participant's willingness to be interviewed. The quantitative data consist of descriptive statistics, simple tests, and present plots and correlation coefficients. For the qualitative analysis, we will apply thematic analysis.

RESULTS

The initial baseline assessments were completed in July 2023, and the second health needs assessments are ongoing. We expect the results to be available for analysis in the spring of 2024.

CONCLUSIONS

This study has potential benefits for not only older adults and their informal caregivers but also health care professionals. Moreover, it can be used to inform future studies focused on health needs assessments of this specific demographic group. The study also provides meaningful insights for local policy makers, with potential future implications at the national level.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05837728; https://clinicaltrials.gov/study/NCT05837728.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/55192.

Intensive care nurses' perceptions and awareness of delirium and delirium prevention guidelines

BACKGROUND

Delirium is an acute and fluctuating disturbance of cognition and is a common occurrence in critically ill patients. It is a manifestation of an acute brain dysfunction often attributed to higher survival rates and a subsequently aging population. Intensive Care Unit (ICU) treatment and survival often contributes towards development of delirium, and lack of or inappropriate management can translate into the development of long-term psychological effects that last even after discharge. While a lot is already known about this topic, and several assessment tools exist, these are not being consistently used by ICU nurses and as a result delirium often goes unrecognized, with unwarranted consequences.

AIMS

The study aimed to explore the perception of delirium among ICU nurses, and the extent of their awareness about guidelines to assess and prevent delirium in ICU patients. It also sought to understand the application of delirium guidelines in ICU practice.

STUDY DESIGN

A quantitative, exploratory, self-reporting survey was conducted among 145 ICU nurses from one critical care unit in the Republic of Ireland.

RESULTS

The overall response rate was 71% (103/145). Most nurses (85%) who participated in this survey believed delirium was expected. However, only 45% acknowledged it is a complication. Only 31% of nurses monitored delirium using a validated scale and few observed this as a part of routine care. Most nurses had received education; however, this did not translate to their clinical practice.

CONCLUSIONS

Guidelines on managing delirium may not be routinely implemented in the ICU settings of hospitals in the Republic of Ireland.

RELEVANCE TO CLINICAL PRACTICE

As the findings suggest, a gap exists between theory and practice, necessary revision of policy or creating a new policy, supplemental educational sessions such as bedside sessions, e-learning module, study day or seminars need to be organized to improve nurses' awareness related to delirium and delirium prevention guidelines.

Exploration of a somatosensory interactive assessment tool for children with intellectual disabilities

Based on the functional assessment concept and embodied assessment requirements, the present study aimed to design and develop an assessment tool for children with intellectual disabilities with the help of somatosensory interactive (SI) technology. The sample in this study consisted of 73 children with intellectual disabilities and 70 children with typical development. Data were collected through three SI tasks, four traditional executive function tasks, and user experience interviews to analyse the effectiveness of the SI assessment tool. The results showed that the SI assessment tool had good scale validity, discriminant validity, and the ability to identify intellectual disabilities. Children preferred SI tasks and showed higher involvement and more positive emotions. The SI tool with three SI tasks is a more scientific, effective, and advanced tool for assessing children with intellectual disabilities.

Authors' Reply: "Evaluating GPT-4's Cognitive Functions Through the Bloom Taxonomy: Insights and Clarifications"

Collapse

Tailored Prompting to Improve Adherence to Image-Based Dietary Assessment: Mixed Methods Study

Background

Accurately assessing an individual's diet is vital in the management of personal nutrition and in the study of the effect of diet on health. Despite its importance, the tools available for dietary assessment remain either too imprecise, expensive, or burdensome for clinical or research use. Image-based methods offer a potential new tool to improve the reliability and accessibility of dietary assessment. Though promising, image-based methods are sensitive to adherence, as images cannot be captured from meals that have already been consumed. Adherence to image-based methods may be improved with appropriately timed prompting via text message.

Objective

This study aimed to quantitatively examine the effect of prompt timing on adherence to an image-based dietary record and qualitatively explore the participant experience of dietary assessment in order to inform the design of a novel image-based dietary assessment tool.

Methods

This study used a randomized crossover design to examine the intraindividual effect of 3 prompt settings on the number of images captured in an image-based dietary record. The prompt settings were control, where no prompts were sent; standard, where prompts were sent at 7:15 AM, 11:15 AM, and 5:15 PM for every participant; and tailored, where prompt timing was tailored to habitual meal times for each participant. Participants completed a text-based dietary record at baseline to determine the timing of tailored prompts. Participants were randomized to 1 of 6 study sequences, each with a unique order of the 3 prompt settings, with each 3-day image-based dietary record separated by a washout period of at least 7 days. The qualitative component comprised semistructured interviews and questionnaires exploring the experience of dietary assessment.

Results

A total of 37 people were recruited, and 30 participants (11 male, 19 female; mean age 30, SD 10.8 years), completed all image-based dietary records. The image rate increased by 0.83 images per day in the standard setting compared to control (P=.23) and increased by 1.78 images per day in the tailored setting compared to control (P≤.001). We found that 13/21 (62%) of participants preferred to use the image-based dietary record versus the text-based dietary record but reported method-specific challenges with each method, particularly the inability to record via an image after a meal had been consumed.

Conclusions

Tailored prompting improves adherence to image-based dietary assessment. Future image-based dietary assessment tools should use tailored prompting and offer both image-based and written input options to improve record completeness.

Implementation of a programmatic assessment model in radiation oncology medical physics training

PURPOSE

In 2019, a formal review and update of the current training program for medical physics residents/registrars in Australasia was conducted. The purpose of this was to ensure the program met current local clinical and technological requirements, to improve standardization of training across Australia and New Zealand and generate a dynamic curriculum and programmatic assessment model.

METHODS

A four-phase project was initiated, including a consultant desktop review of the current program and stakeholder consultation. Overarching program outcomes on which to base the training model were developed, with content experts used to update the scientific content. Finally, assessment specialists reviewed a range of assessment models to determine appropriate assessment methods for each learning outcome, creating a model of programmatic assessment.

RESULTS

The first phase identified a need for increased standardized assessment incorporating programmatic assessment. Seven clear program outcome statements were generated and used to guide and underpin the new curriculum framework. The curriculum was expanded from the previous version to include emerging technologies, while removing previous duplication. Finally, a range of proposed assessments for learning outcomes in the curriculum were generated into the programmatic assessment model. These new assessment methods were structured to incorporate rubric scoring to provide meaningful feedback.

CONCLUSIONS

An updated training program for Radiation Oncology Medial Physics registrars/residents was released in Australasia. Scientific content from a previous program was used as a foundation and revised for currency with the ability to accommodate a dynamic curriculum model. A programmatic model of assessment was created after comprehensive review and consultation. This new model of assessment provides more structured, ongoing assessment throughout the training period. It contains allowances for local bespoke assessment, and guidance for supervisors by the provision of marking templates and rubrics.

LEVEL OF SUPERVISION FOR THE EPAS COMMON TO GENERAL PEDIATRICS AND THE SUBSPECIALTIES DECREASES FROM RESIDENCY TO FELLOWSHIP

OBJECTIVES

To compare level of supervision (LOS) ratings of graduating pediatric residents with their assessments as fellows for the 5 Entrustable Professional Activities (EPAs) common to general pediatrics and the subspecialties and to determine if the difference between ratings from residency to fellowship is less for the QI and PRACTICE MANAGEMENT EPAs, since the skills needed to perform these may be less context-dependent.

METHODS

We compared ratings of graduating residents with their assessments as fellows using LOS data from 2 sequential EPA studies.

RESULTS

There were 65 ratings from 41 residents at the 1st fellow assessment. At graduation, most residents needed little to no supervision for all EPAs with 94% (61/65) of ratings level 4 or 5. In contrast, only 5/65 (8%) of the 1st fellow assessments were level 4 or 5. The ratings difference for the QI and PRACTICE MANAGEMENT EPAs was similar to the others.

CONCLUSIONS

LOS ratings for the EPAs common to generalists and subspecialists reset as residents become fellows. There was no evidence that the QI and PRACTICE MANAGEMENT EPAs are less context-dependent. This study provides additional validity evidence for using these LOS scales to assess trainees in pediatric residency and fellowship.

Twelve tips for supporting medical learners through high-stakes assessment challenges

Learners across the medical education continuum will encounter numerous high-stakes exams and assessments. Effectively preparing for and performing well on these types of assessments can be challenging for learners for a wide variety of reasons. It is imperative that medical educators provide appropriate support for learners who experience challenges with high-stakes exams, particularly given the complexity of factors like life circumstances of individual learners and the significance of these assessments for career advancement/progression. Grouped into areas including educator mindset, information-gathering, and developing and executing a study plan, the following 12 tips will help medical educators be better prepared to meaningfully support learners in need of assessment remediation and guidance.

The Montreal Cognitive Assessment detects cognitive deficits that go unnoticed during clinical observation in the acute phase after stroke

BACKGROUND

Detecting cognitive impairments early after stroke is essential for appropriate referrals. Although recommended in stroke guidelines, early cognitive screening is not always implemented. We assessed whether the Montreal Cognitive Assessment (MoCA) adds diagnostic value compared to clinical observation alone. In addition, discharge destinations for stroke patients with and without cognitive deficits detected with the screening tool or the treatment team were explored.

METHODS

Forty-four stroke patients were screened with the MoCA during stroke unit admission. Their charts were studied for cognitive impairments reported by the stroke care team, who were blinded to screening scores. Proportions of detected cognitive deficits were compared between screening (score <26) and patient charts. Discharge destination distribution (home vs. rehabilitation) was explored.

RESULTS

The proportion of cognitively impaired patients indicated by the MoCA (84%) and reported in patients' charts (25%) differed significantly (p < 0.001). The distribution of discharge destination did not suggest an association with the detection of cognitive deficits by the treatment team or the cognitive screening.

CONCLUSIONS

The MoCA detects more cognitive deficits than clinical impression alone, emphasizing the importance of standard screening for cognitive impairments in acute stroke patients. Ultimately, systematic screening may enhance discharge planning and improve long-term outcomes.

Providing rigor in bee colony strength auditing methods

The primary method used to audit honey bee (Apis mellifera Linnaeus, 1758 [Hymenoptera: Apidae]) colony strength for almond pollination services, Nasr et al.'s (1990) frame-top cluster count method, is a subjective visual audit that relies on an auditor's spot assessment and may lack rigor and repeatability. We created novel, open-source software for the analysis of frame-top cluster count photographic assessments to improve methodological rigor and repeatability. We evaluated 2 existing visual audit methods, created 3 novel audit method variations, and determined between-method conversion factors using linear modeling. The software has potential applications in apiological research, apiarist and orchardist colony auditing, as well as training future generations of apiarists in auditing techniques. The software enhances the rigor and repeatability of Nasr et al.'s (1990) frame-top cluster count population assessment. In this article, we introduce the novel open-source software and between-method regression equations and review the tested visual assessment methods and their application.

Development and psychometric evaluation of the asthma Action plan questionnaire (AAPQ)

OBJECTIVE

To develop a practical and psychometrically sound tool to evaluate caregiver knowledge of their child's asthma action plan (AAP).

METHODS

A pilot study was conducted in a sample of 40 caregivers of children with asthma to assess the content validity, item difficulty, and item discrimination of the Asthma Action Plan Questionnaire (AAPQ). The inter-rater and intra-rater agreement of the AAPQ's scoring rubric were also examined. Subsequently, a large-scale study was conducted in a sample of 80 caregivers of children with asthma and 40 caregivers of children without current asthma and no prior exposure to patients with asthma to evaluate the internal consistency, test-retest reliability, and known-groups validity of the AAPQ.

RESULTS

The 7-item AAPQ demonstrated acceptable content validity (a scale-content validity index of 0.98) and internal consistency (Cronbach's alpha =.63 and mean inter-item correlation coefficient of.20) and very strong test-retest reliability over a two-to-four-week period (r = .88, p < .001). The AAPQ discriminated between caregivers of children with asthma and caregivers of children without asthma (M ± SD 8.3 ± 1.6 vs. 4.3 ± 1.7, p < .001, respectively).

CONCLUSION

The AAPQ is a valid and reliable questionnaire that provides an assessment of caregivers' knowledge of their child's AAP and can guide educational interventions by healthcare providers.

An overview of current assessment techniques for evaluating cutaneous perfusion in reconstructive surgery

This article provides a comprehensive analysis of modern techniques used in the assessment of cutaneous flaps in reconstructive surgery. It emphasizes the importance of preoperative planning and intra- and perioperative assessment of flap perfusion to ensure successful outcomes. Despite technological advancements, direct clinical assessment remains the gold standard. We categorized assessment techniques into non-invasive and invasive modalities, discussing their strengths and weaknesses. Non-invasive methods, such as acoustic Doppler sonography, near-infrared spectroscopy, hyperspectral imaging thermal imaging, and remote-photoplethysmography, offer accessibility and safety but may sacrifice specificity. Invasive techniques, including contrast-enhanced ultrasound, computed tomography angiography, near-infrared fluorescence angiography with indocyanine green, and implantable Doppler probe, provide high accuracy but introduce additional risks. We emphasize the need for a tailored decision-making process based on specific clinical scenarios, patient characteristics, procedural requirements, and surgeon expertise. It also discusses potential future advancements in flap assessment, including the integration of artificial intelligence and emerging technologies.

Injured worker participation in assessment during the acute phase of workers compensation rehabilitation: a scoping review

PURPOSE

Rates of return to work (RTW) are declining in the Australian workers compensation system alongside significant economic and social costs, disputes, and secondary psychological injury. Non-medical assessment of workplace injuries now considers psychosocial and workplace factors, and worker participation in the assessment process is limited. This scoping review examines studies regarding non-medical assessment during the acute phase of rehabilitation in terms of costs, disputes, secondary psychological injury, and worker participation.

METHOD

An electronic and manual search of relevant articles across four databases was conducted using PRISMA guidelines, followed by quality assessment.

RESULTS

Of the 1,630 studies retrieved, 12 met the inclusion criteria with most focused on assessment for risk of obstructed or delayed RTW.

CONCLUSIONS

Non-medical assessment in the acute stage of rehabilitation identifies risk for delayed or complicated RTW, overlooking potential for the process of assessment to contribute to disputes and development of secondary psychological injury. Doubt around the capacity of workers to participate objectively in assessment persists. These are aspects of assessment worthy of further exploration for their impact on RTW outcomes.

Using Computer Vision to Annotate Video-Recoded Direct Observation of Physical Behavior

Direct observation is a ground-truth measure for physical behavior, but the high cost limits widespread use. The purpose of this study was to develop and test machine learning methods to recognize aspects of physical behavior and location from videos of human movement: Adults (N = 26, aged 18-59 y) were recorded in their natural environment for two, 2- to 3-h sessions. Trained research assistants annotated videos using commercially available software including the following taxonomies: (1) sedentary versus non-sedentary (two classes); (2) activity type (four classes: sedentary, walking, running, and mixed movement); and (3) activity intensity (four classes: sedentary, light, moderate, and vigorous). Four machine learning approaches were trained and evaluated for each taxonomy. Models were trained on 80% of the videos, validated on 10%, and final accuracy is reported on the remaining 10% of the videos not used in training. Overall accuracy was as follows: 87.4% for Taxonomy 1, 63.1% for Taxonomy 2, and 68.6% for Taxonomy 3. This study shows it is possible to use computer vision to annotate aspects of physical behavior, speeding up the time and reducing labor required for direct observation. Future research should test these machine learning models on larger, independent datasets and take advantage of analysis of video fragments, rather than individual still images.

Biomechanical Assessment Methods Used in Chronic Stroke: A Scoping Review of Non-Linear Approaches

Non-linear and dynamic systems analysis of human movement has recently become increasingly widespread with the intention of better reflecting how complexity affects the adaptability of motor systems, especially after a stroke. The main objective of this scoping review was to summarize the non-linear measures used in the analysis of kinetic, kinematic, and EMG data of human movement after stroke. PRISMA-ScR guidelines were followed, establishing the eligibility criteria, the population, the concept, and the contextual framework. The examined studies were published between 1 January 2013 and 12 April 2023, in English or Portuguese, and were indexed in the databases selected for this research: PubMed®, Web of Science®, Institute of Electrical and Electronics Engineers®, Science Direct® and Google Scholar®. In total, 14 of the 763 articles met the inclusion criteria. The non-linear measures identified included entropy (n = 11), fractal analysis (n = 1), the short-term local divergence exponent (n = 1), the maximum Floquet multiplier (n = 1), and the Lyapunov exponent (n = 1). These studies focused on different motor tasks: reaching to grasp (n = 2), reaching to point (n = 1), arm tracking (n = 2), elbow flexion (n = 5), elbow extension (n = 1), wrist and finger extension upward (lifting) (n = 1), knee extension (n = 1), and walking (n = 4). When studying the complexity of human movement in chronic post-stroke adults, entropy measures, particularly sample entropy, were preferred. Kinematic assessment was mainly performed using motion capture systems, with a focus on joint angles of the upper limbs.

Efficacy of a Virtual 3D Simulation-Based Digital Training Module for Building Dental Technology Students' Long-Term Competency in Removable Partial Denture Design: Prospective Cohort Study

Background

Removable partial denture (RPD) design is crucial to long-term success in dental treatment, but shortcomings in RPD design training and competency acquisition among dental students have persisted for decades. Digital production is increasing in prevalence in stomatology, and a digital RPD (D-RPD) module, under the framework of the certified Objective Manipulative Skill Examination of Dental Technicians (OMEDT) system reported in our previous work, may improve on existing RPD training models for students.

Objective

We aimed to determine the efficacy of a virtual 3D simulation-based progressive digital training module for RPD design compared to traditional training.

Methods

We developed a prospective cohort study including dental technology students at the Stomatology College of Chongqing Medical University. Cohort 1 received traditional RPD design training (7 wk). Cohort 2 received D-RPD module training based on text and 2D sketches (7 wk). Cohort 3 received D-RPD module pilot training based on text and 2D sketches (4 wk) and continued to receive training based on 3D virtual casts of real patients (3 wk). RPD design tests based on virtual casts were conducted at 1 month and 1 year after training. We collected RPD design scores and the time spent to perform each assessment.

Results

We collected the RPD design scores and the time spent to perform each assessment at 1 month and 1 year after training. The study recruited 109 students, including 58 (53.2%) female and 51 male (56.8%) students. Cohort 1 scored the lowest and cohort 3 scored the highest in both tests (cohorts 1-3 at 1 mo: mean score 65.8, SD 21.5; mean score 81.9, SD 6.88; and mean score 85.3, SD 8.55, respectively; P<.001; cohorts 1-3 at 1 y: mean score 60.3, SD 16.7; mean score 75.5, SD 3.90; and mean score 90.9, SD 4.3, respectively; P<.001). The difference between cohorts in the time spent was not statistically significant at 1 month (cohorts 1-3: mean 2407.8, SD 1370.3 s; mean 1835.0, SD 1329.2 s; and mean 1790.3, SD 1195.5 s, respectively; P=.06) but was statistically significant at 1 year (cohorts 1-3: mean 2049.16, SD 1099.0 s; mean 1857.33, SD 587.39 s; and mean 2524.3, SD 566.37 s, respectively; P<.001). Intracohort comparisons indicated that the differences in scores at 1 month and 1 year were not statistically significant for cohort 1 (95% CI -2.1 to 13.0; P=.16), while cohort 3 obtained significantly higher scores 1 year later (95% CI 2.5-8.7; P=.001), and cohort 2 obtained significantly lower scores 1 year later (95% CI -8.8 to -3.9; P<.001).

Conclusions

Cohort 3 obtained the highest score at both time points with retention of competency at 1 year, indicating that progressive D-RPD training including virtual 3D simulation facilitated improved competency in RPD design. The adoption of D-RPD training may benefit learning outcomes.

Convergent Validity Between the Motor Domain of PediaTracTM and Ages and Stages in Term and Preterm Infants at 2, 4, 6, and 9 Months of Age

The primary aim of this study was to evaluate the convergent validity of the Motor domain (MOT) of PediaTracTM v3.0, an online developmental tracking instrument based on caregiver reports, with fine and gross motor domains (ASQ-FM and ASQ-GM) of the Ages and Stages Questionnaire (ASQ-3) in infants between 2- and 9 months of age. Participants were caregivers of 571 infants born term or preterm (gestational age <37 weeks) enrolled in a multi-site psychometric study of PediaTracTM. Findings revealed significant correlations between MOT and ASQ-3 scores at 2, 4, 6, and 9 months across time periods, term-preterm status, and biological sex. A significantly higher percentage of infants born preterm, compared with those born at term, was identified as a moderate or high risk on both the ASQ-3 and PediaTrac. Future investigations are warranted to further examine the psychometric properties of the MOT domain, including sensitivity, specificity, and positive and negative predictive value.

Recommendations of the French Society of Rheumatology for the management in current practice of patients with Polymyalgia Rheumatica

OBJECTIVE

To develop recommendations for the routine management of patients with polymyalgia rheumatica (PMR) Methods: Following standard procedures, a systematic review of the literature by 5 supervised junior rheumatologists, based on the questions selected by the steering committee (5 senior rheumatologists), was used as the basis for working meetings, followed by a one-day plenary meeting with the working group (15 members), leading to the development of the wording and determination of the strength of the recommendations and the level of agreement of the experts.

RESULTS

Five general principles and 19 recommendations were drawn up. Three recommendations relate to diagnosis and the use of imaging, and 5 to the assessment of the disease, its activity and co-morbidities. Non-pharmacological therapies are the subject of one recommendation. Three recommendations concern initial treatment based on general corticosteroid therapy, 5 concern the reduction of corticosteroid therapy and follow-up, and 2 concern corticosteroid dependence and steroid-sparing treatments (anti-IL-6).

CONCLUSION

These recommendations take account of current data on PMR, with the aim of reducing exposure to corticosteroid therapy and its side effects in a fragile population. They are intended to be practical, to help practitioners in the day-to-day management of patients with PMR.

The Body Image Virtual Reality Assessment (BIVRA): Measuring the body representation through virtual reality

Our physical and psychological well-being is significantly influenced by how we perceive our body, in addition to our thoughts and emotions associated with it. Dysfunctional body perceptions and attitudes play a key role in the development and maintenance of severe conditions such as eating disorders in both males and females. Given its relevance, some attempts have been made to improve body image assessment methods in terms of perceptual accuracy and body satisfaction taking advantage of technological advances such as virtual reality. However, existing applications have mainly focused on women and clinical conditions. In this study, we presented the Body Image Virtual Reality Assessment (BIVRA), a virtual reality figure rating scale to assess body image in both male and female subjects. We tested BIVRA's ability to measure perceptual accuracy and compared its results with a standardized body satisfaction questionnaire. Additionally, we investigated gender differences. BIVRA was found to be effective in assessing body image. We observed that a perceptually based task successfully captured both low and high levels of body representations, shedding light on the significant gender differences. The association between BIVRA and the body satisfaction questionnaires was moderated by gender, with a stronger association for women. While further validation of BIVRA is needed to fully exploit its potential, our results suggest that the integration of virtual reality into the assessment of body image and related disorders may significantly enhance our understanding of individuals struggling with body image issues and has the potential to advance current methods and techniques.

Studies of Social Anxiety Using Ambulatory Assessment: Systematic Review

BACKGROUND

There has been an increased interest in understanding social anxiety (SA) and SA disorder (SAD) antecedents and consequences as they occur in real time, resulting in a proliferation of studies using ambulatory assessment (AA). Despite the exponential growth of research in this area, these studies have not been synthesized yet.

OBJECTIVE

This review aimed to identify and describe the latest advances in the understanding of SA and SAD through the use of AA.

METHODS

Following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines, a systematic literature search was conducted in Scopus, PubMed, and Web of Science.

RESULTS

A total of 70 articles met the inclusion criteria. The qualitative synthesis of these studies showed that AA permitted the exploration of the emotional, cognitive, and behavioral dynamics associated with the experience of SA and SAD. In line with the available models of SA and SAD, emotion regulation, perseverative cognition, cognitive factors, substance use, and interactional patterns were the principal topics of the included studies. In addition, the incorporation of AA to study psychological interventions, multimodal assessment using sensors and biosensors, and transcultural differences were some of the identified emerging topics.

CONCLUSIONS

AA constitutes a very powerful methodology to grasp SA from a complementary perspective to laboratory experiments and usual self-report measures, shedding light on the cognitive, emotional, and behavioral antecedents and consequences of SA and the development and maintenance of SAD as a mental disorder.

Battle of the sections: Student outcomes and course feedback support combined prosection and dissection laboratory formats to maximize student success

Gross anatomy laboratories frequently utilize dissection or prosection formats within medical curricula. Practical examination scores are consistent across the formats, yet these examinations assessed larger anatomical structures. In contrast, a single report noted improved scores when prosection was used in the hand and foot regions, areas that are more difficult to dissect. The incorporation of prosected donors within "Head and Neck" laboratories provided an opportunity to further characterize the impact of prosection in a structurally complex area. Retrospective analysis of 21 Head and Neck practical examination questions was completed to compare scores among cohorts that utilized dissection exclusively or incorporated prosection. Mean scores of practical examination questions were significantly higher in the prosection cohort (84.27% ± 12.69) as compared with the dissection cohort (75.59% ± 12.27) (p < 0.001). Of the 12 questions that performed better in the prosection cohort (88.42% ± 8.21), 10 items mapped to deeper anatomical regions. By comparison, eight of nine questions in the dissection cohort outperformed (88.44% ± 3.34) the prosection cohort (71.74% ± 18.11), and mapped to anatomically superficial regions. Despite the mean score increase with positional location of the questions, this effect was not statically significant across cohorts (p = 1.000), suggesting that structure accessibility in anatomically complex regions impacts performance. Student feedback cited structure preservation (71.5%) and time savings (55.8%) as advantages to prosection; however, dissection was the perceived superior and preferred laboratory format (88.6%). These data support combined prosection and dissection formats for improving student recognition of deeply positioned structures and maximizing student success.

On the relation between oral contraceptive use and self-control

In two studies we examined the relation between oral contraceptive (OC) use and self-reported levels of self-control in undergraduate women using OCs (Study 1: OC group N = 399, Study 2: OC group N = 288) and naturally cycling women not using any form of hormonal contraceptives (Study 1: Non-OC group N = 964, Study 2: Non-OC group N = 997). We assessed the self-overriding aspect of self-control using the Brief Self-Control Scale (BSCS) and strategies for self-regulation using the Regulatory Mode Scale (RMS), which separately measures the tendency to assess one's progress towards a goal (assessment), and the tendency to engage in activities that move one towards an end goal (locomotion). In Study 1, we found no significant differences between OC and non-OC groups in their levels of self-overriding or self-regulatory assessment. However, we found that those in the OC group reported significantly greater levels of self-regulatory locomotion compared to those in the non-OC group, even after controlling for depression symptoms and the semester of data collection. The findings from Study 2 replicated the findings from Study 1 in a different sample of participants, with the exception that OC use was also related to higher levels of assessment in Study 2. These results indicate that OC use is related to increases in self-regulatory actions in service of goal pursuit and perhaps the tendency to evaluate progress towards goals.

Using Motivation Assessment as a Teaching Tool for Large Undergraduate Courses: Reflections From the Teaching Team

Introduction

Student motivation is a critical predictor of academic achievement, engagement, and success in higher education. Motivating students is a crucial aspect of effective teaching.

Statement of the Problem

Although there is a wealth of research on student motivation, practical guidance for putting theory into practice in challenging teaching environments (i.e., large-format introductory courses) is lacking. We discuss a first step toward motivating students: understanding how motivated they are and using that information to inform teaching.

Literature Review

Anxiety, impeded motivation, and high student-to-teacher ratio are all challenges associated with teaching foundational introductory courses, such as statistics. The Expectancy-Value-Cost model of motivation provides theoretical background to assist with these courses. We discuss the implementation and use of motivation assessments as a teaching tool.

Teaching Implications

Motivation assessments are feasible and useful while teaching large-format introductory courses. Instructor reflections lend insights as to how to use these assessments to improve pedagogy.

Observer-based and computerized measures of the patient's mentalization in psychotherapy: A scoping review

OBJECTIVE

In recent decades, mentalizing has found its permanent place both in therapeutic practice and in psychotherapy research. Inconsistent results and null results are often found. Therefore, the different methodological approaches should be examined in more detail. A scoping review was conducted to provide an overview of the approaches that measure the patient's mentalizing ability based on therapy sessions or in the course of psychotherapy.

METHOD

For the scoping review, a literature search was conducted in four databases. A total of 3217 records were identified.

RESULTS

We included 84 publications from 43 independent studies. Most studies used the Reflective Functioning Scale and applied the scale to therapy sessions or the Adult Attachment Interview. The other identified approaches used a computerized text analysis measure or clinician-report measures. Mostly good psychometric properties of the measures were reported. The Reflective Functioning Scale applied to the Adult Attachment Interview was the only measure that proved to be sensitive to change.

CONCLUSION

More economical variants to the time-consuming Reflective Functioning Scale applied to the Adult Attachment Interview are being developed continuously. In some cases, there is no standardized approach, or the measures are used only sporadically and require further and more comprehensive psychometric evaluations.

A Systematic Review of Empirical Studies Measuring Training Effects on Biases Evidenced by Professionals toward Intimate Partner Violence

A professional's response to a client's disclosure of intimate partner violence (IPV) is shown to significantly impact client outcomes. The quality of a professional's response is largely influenced by that professional's beliefs or biases surrounding IPV. This systematic review examined empirical studies conducted in North America and published between 2000 and 2020 evaluating training effects on biases held by professional groups toward victim-survivors of IPV. Search and extraction were conducted in accordance with preferred reporting items for systematic reviews and meta-analyses standards across seven electronic databases. A total of 17 studies met inclusion criteria. Participant groups included professionals from medical, academic, and social/community service disciplines. All included studies reported significant gains on at least one measure of bias. Upon visual inspection, we found no correlations between characteristics of training interventions and reported outcomes on measures of bias. We discuss results in terms of challenges to measuring bias and functional relationships between training interventions, measures of bias, and professional behavior. Variation presented across studies within and between disciplines in regards to training methodology and measurement of bias. Experts in the field of IPV call for a more cohesive approach. We propose the behavior analytic conceptualization of bias as a framework through which interdisciplinary efforts might be unified toward addressing IPV-related biases. Through this lens, we discuss environmental cues within professional settings that might be influencing problematic IPV-related bias. We offer preliminary recommendations for curricular enhancements. We advocate for revision of terms commonly used in IPV-related research and intervention to better reflect and honor diversity across persons experiencing IPV.

Decision making capacity for treatment in psychiatric inpatients: a systematic review and meta-analysis

Decision-making capacity (DMC) among psychiatric inpatients is a pivotal clinical concern. A review by Okai et al. (2007) suggested that most psychiatric inpatients have DMC for treatment, and its assessment is reliable. Nevertheless, the high heterogeneity and mixed results from other studies mean there is considerable uncertainty around this topic. This study aimed to update Okai's research by conducting a systematic review with meta-analysis to address heterogeneity. We performed a systematic search across four databases, yielding 5351 results. We extracted data from 20 eligible studies on adult psychiatric inpatients, covering DMC assessments from 2006 to May 2022. A meta-analysis was conducted on 11 papers, and a quality assessment was performed. The study protocol was registered on PROSPERO (ID: CRD42022330074). The proportion of patients with DMC for treatment varied widely based on treatment setting, the specific decision and assessment methods. Reliable capacity assessment was feasible. The Mini-Mental State Examination (MMSE), Global Assessment of Function (GAF), and Brief Psychiatric Rating Scale (BPRS) predicted clinical judgments of capacity. Schizophrenia and bipolar mania were linked to the highest incapacity rates, while depression and anxiety symptoms were associated with better capacity and insight. Unemployment was the only sociodemographic factor correlated with incapacity. Assessing mental capacity is replicable, with most psychiatric inpatients able to make treatment decisions. However, this capacity varies with admission stage, formal status (involuntary or voluntary), and information provided. The severity of psychopathology is linked to mental capacity, though detailed psychopathological data are limited.

Occupation-Based Assessments in Pediatric Occupational Therapy Practice

In pediatric occupational therapy, there is insufficient evidence examining assessment tool selection by occupational therapists and how assessment tools contribute to occupation-based practice. To examine the perceptions of occupation-based assessment tool selection by pediatric occupational therapists, a phenomenological research study was conducted with six pediatric occupational therapy practitioners. Three themes emerged from participants' perspectives: the centrality of occupation, selecting the just right tool, and practice implications. Participants recognized the need to integrate occupation-based assessments into practice but reported decreased opportunities secondary to training, available supplies, lack of awareness of foundational constructs, and organizational expectations. The use of occupation-based assessments positively enhances pediatric occupational therapists' clinical practice by upholding the core occupational beliefs of the profession throughout all phases of service delivery.

Occupational therapy in maternal health: Exploring the Barkin Index of Maternal Functioning as a potential tool

INTRODUCTION

Transitioning into the role of a mother encompasses many physical and psychosocial changes, affecting the way a woman may function. Maternal health is an emerging area of practice for occupational therapists, and therefore, screening and assessment tools to support work in this area are needed. The Barkin Index of Maternal Functioning (BIMF) is a quantitative outcome measure that is used by health professionals to assess maternal functioning. Currently, its ability to measure occupational performance is unclear.

METHODS

Utilising a mixed methods design, this study analysed the extent to which the BIMF assesses maternal function from an occupational perspective. Thirteen first-time mothers with a baby 12 months of age or younger participated in the study. Results from the BIMF were compared with themes developed from semi-structured qualitative interviews that explored the occupational experiences of first-time mothers.

FINDINGS

Seven themes were developed from the interviews. The BIMF addressed three themes, including changes to engagement in basic activities of daily living and leisure, transitioning into motherhood, emotions, self-efficacy, and social support. However, four themes were not captured by the BIMF, including changes to partner relationships, identity shift, influence of 'person' factors, and changes to social experiences in early motherhood.

CONCLUSION

Findings suggest that a new tool with a holistic perspective of mothers as occupational beings is needed to be able to identify occupational performance issues and the potential need for occupational therapy support. This study identified key experiences of occupational performance for new mothers.

Harmonizing the structured interview for psychosis-risk syndromes (SIPS) and the comprehensive assessment of at-risk mental states (CAARMS): An initial approach

The two most used semi-structured psychometric instruments that define criteria for being at clinical high risk (CHR) for psychosis are the Comprehensive Assessment of At-Risk Mental States (CAARMS) and the Structured Interview for Psychosis-Risk Syndromes (SIPS). Although very similar there are important differences between these two measures. Developing harmonized psychometric criteria for defining CHR and associated outcomes would be beneficial for future research. This article describes the first step in this process by reporting on a NIMH workshop held in Washington DC, in February 2019 that was attended by experts in the field. The aim of this workshop was to examine the similarities and differences between the two measures and consider how the harmonization process could proceed.

Quality of evidence supporting the role of hyperbaric oxygen therapy for diabetic foot ulcers

The goal of this overview of systematic reviews (SRs) and meta-analyses (MAs) was to methodically gather, evaluate and summarize the data supporting the use of hyperbaric oxygen therapy (HBOT) to treat diabetic foot ulcers (DFUs). The Cochrane Library, Embase, PubMed, Web of Science and Embase were all searched thoroughly to identify SRs/MAs that qualified. AMSTAR-2 tool, PRISMA checklists and GRADE system were applied by two reviewers independently to assess the methodological quality, reporting and evidence quality of the included SRs/MAs, respectively. Eleven SRs/MAs were enrolled in this overview. According to AMSTAR-2, a very low methodological quality assessment was given to the included SRs/MAs due to the limitations of items 2, 4 and 7. For the PRISMA, the overall quality of reporting is not satisfactory due to missing reporting on protocol, search, as well as additional analysis. The majority of outcomes had low- to moderate-quality evidence, and no high-quality evidence was found to support the role of HBOT for DFUs, according to GRADE. To conclude, the potential of HBOT in treating DFUs is supported by evidence of low to moderate quality. More rigorously designed, high-level studies are needed in the future to determine the evidence for HBOT for DFU, including the timing, frequency and duration of HBOT interventions.

A brief version of the Scale of Emotional Development - Short

BACKGROUND

The Scale of Emotional Development - Short (SED-S) captures the level of emotional development in persons with a disorder of intellectual development (DID) with 200 items on five developmental levels. The study aims to develop a brief version of the SED-S.

METHODS

Based on item analysis (proportions, χ2 -test, Spearman's ρ and corrected item-total correlation), a brief version of the SED-S was developed in a sample of 224 adults with a DID (n1 ) and validated in a second independent matched sample (n2  = 223).

RESULTS

Item reliability ranged per item set from Cronbach's α = 0.835 to 0.924. Weighted kappa resulted in κω  = 0.743 (P < 0.001, 95% confidence interval = 0.690-0.802). Overall agreement of the brief version with the original SED-S was PO  = 0.7. The brief version of the SED-S showed weaknesses in distinguishing level 2 from the adjacent levels.

CONCLUSIONS

The brief version of the SED-S showed good reliability and moderate to good validity results. Items of phase 2 and, to some degree, of phase 5 should be revised to further improve the psychometric properties of the scale.

Revising the Pragmatics Profile of Everyday Communication Skills for traumatic brain injury: An international Delphi study

BACKGROUND

Assessment tools that assess pragmatic skills in adults with a mild-severe traumatic brain injury (TBI) are hard to access, not person-centred and have a high risk of clinician bias. The Pragmatics Profile is an informant report tool that was originally designed to assess pragmatic skills in people with a developmental disability.

AIMS

The aim of this study was to seek consensus from a panel of experts and create a version of the Pragmatics Profile for the TBI population.

METHODS AND PROCEDURES

A three-round modified Delphi methodology panel of 13 experts were invited to comment anonymously on the suitability of each question from the Pragmatics Profile modified for those with TBI until ≥ 80% agreement was reached.

OUTCOMES AND RESULTS

The Pragmatics Profile (TBI) included 66 questions that achieved consensus after three rounds of the Delphi panel. Qualitative analysis illuminated themes relating to adults with TBI and the need to include contextual factors.

CONCLUSIONS AND IMPLICATIONS

The outcome of this project was a revised version of the Pragmatics Profile which is suitable for adults with a mild-severe TBI, informed by experts and freely available online. Future research exploring the tool's utility and acceptability is the next step in its evaluation.

WHAT THIS PAPER ADDS

What is already known on this subject Assessment of the everyday functional use of language is challenging but vital. This is particularly true for those who have traumatic brain injury (TBI) where the communication outcomes can be highly variable and may include difficulties with conversational turn-taking, topic maintenance and reading social cues. There are limited tools available to clinicians and those tend to be rating scales or checklists which have a high risk of clinician bias. Available tools have a limited ability to capture the individual's personal social communication goals. What this paper adds to existing knowledge This study created an online Pragmatics Profile (PP) for TBI based on experts' opinions. This paper details the themes that emerged during the process of revising the PP for those with TBI. What are the potential or actual clinical implications of this work? The PP-TBI adds to the toolkit for speech and language therapists working with people with TBI. It meets recent recommendations in the literature to create an interview-based tool. The versatility of an online tool combined with revised input from a panel of experts increases the likelihood that clinicians will utilise this tool. Given the long-term use of the original PP by clinicians for almost 30 years and a focus on personalised care, the format and approach are also likely to be acceptable to clinicians.

Is there scope to do better? Clinical communication with adolescents and young adults with cancer-A scoping review

INTRODUCTION

How to communicate effectively with adolescent and young adults with cancer (AYACs) is a research priority. In a UK-wide survey of young people with cancer's research priorities, communication was a striking cross-cutting theme. It is increasingly recognised that AYACs have experiences and communication needs that differ significantly from those of younger children and older adults. The purpose of this review is to explore the features of effective clinical communication with AYACs.

METHODS

A literature search was undertaken to identify and map the available evidence using a broad scope to get an overview of the pertinent literature, identify knowledge gaps and clarify concepts. The searches yielded 5825 records, generating 4040 unique articles. These were screened and 71 full articles were read by four researchers with disagreements resolved by discussion leaving 29 included articles. Narrative synthesis was undertaken in relation to each of the research questions.

RESULTS

Three key themes were identified: being an adolescent/young adult, supporters, and healthcare professionals (HCPs). AYACs need to feel that HCPs understand their unique perspective. They want to be involved, this changes over time and in different contexts. Supporters are a central tenet, are most often parents and undertake several roles which are not always universally supportive. HCPs enable involvement of AYACs, and this needs to be actively promoted. AYACs preference for their level of involvement requires continual assessment. The three themes are interlinked and exist within the wider scope of the triadic encounter and cancer experience.

CONCLUSION

Supporters, most often parents were a key feature across the data and were seemingly paradoxical in nature. Triadic communication, the presence of a third person, is a central tenet of communication with AYACs and we propose a conceptual model to represent the nuances, components, and facets of this complex communication.

Sudden Unexpected Postnatal Collapse: Review and Management

Sudden unexpected postnatal collapse (SUPC) of healthy newborns is a catastrophic event caused by cardiorespiratory collapse in a healthy newborn. The most common cause of SUPC is poor positioning of the newborn during skin-to-skin contact or breastfeeding when the newborn is not being observed by a health professional, attentive parent, or caretaker. Maternal/newborn health care professionals need to know about the essential information, definitions, incidence, risk factors, clinical presentation, outcomes, and prevention and management strategies to minimize the occurrence and impact of SUPC. A sample SUPC hospital policy is included in the manuscript.

Testing feasibility of relevant outcome measures in an inpatient setting to demonstrate the value of occupational therapy

INTRODUCTION

Measures of participation restrictions in daily life occupations are not typically used and may aid discharge planning and demonstrate the impact of occupational therapy services in inpatient settings. The overall aim of this mixed-methods study was to test the feasibility of relevant outcome measures by (1) investigating which of the three identified measures-the Home Support Needs Assessment, the Personal Care Participation Assessment and Resource Tool, and the Functional Autonomy Measurement System-best identifies meaningful changes in participation restrictions in daily life occupations required for community life; and (2) investigating the acceptability, usefulness, and feasibility of each measure to support inpatient practice.

METHODS

Occupational therapists (n = 3) completed the three measures with patient participants (n = 12) at admission and discharge. Each occupational therapist participated in a semi-structured interview. Outcome measure responses were summarised statistically. Qualitative data were analysed using reflexive thematic analysis.

FINDINGS

Total scores on all three measures changed significantly between admission and discharge (P < 0.002). Three themes reflected the occupational therapist participants' perceptions of the acceptability, usefulness, and feasibility of the outcome measures: 'Clinically and Professionally Meaningful Tools', 'Becoming Familiar', and 'Fostering My Daily Work'.

CONCLUSION

Each measure demonstrated a meaningful change. Selection and successful implementation of an outcome measure depends on its local acceptability to occupational therapists and organisational practices. All three measures are promising tools to address a measurement gap in occupational therapy practice. Future research could embed one measure into practice using knowledge translation methods, with a large-scale evaluation of the value of occupational therapy.

Correlation between theoretical knowledge and the difference between self- and teaching doctor-assessment

OBJECTIVES

The right intuition for self-assessment without overestimating or underestimating oneself compared to theoretical knowledge is a skill that requires conscious practice and is very often paradoxically opposed to the level of knowledge. Self-assessment is an essential skill for dental professionals for lifelong learning and improvement. The objective of our study was to assess the correlation between theoretical knowledge and the difference between self- and teaching doctor-assessment.

METHODS

The app "digital course organizer" for organization and assessment was used for the self- and teaching doctor-assessment of students for each day of patient treatment during the clinical courses at a university hospital. The difference between the self- and teaching doctor-assessment was compared to the score of an initial theoretical written test at the beginning of the eighth semester to assess the correlation between overestimation or underestimation and theoretical knowledge.

RESULTS

A total of 309 dental students over four semesters in the clinical study phase (fourth and fifth years; eighth and 10th semesters) participated in the investigation. The overall view of all values showed very low correlations (<0.2) of the assessment difference values of both practical courses for the initial written test.

CONCLUSION

There were very low correlations between the initial written test (theoretical knowledge) and the difference between self- and teaching doctor-assessment as well as no evidence of overestimation and underestimation.

Informant sex/gender moderates associations between reported functioning and memory performance in Mexican American adults

Objective: In neuropsychological evaluations, assessing cognitive functioning is often achieved using objective neuropsychological measures, whereas subjective informant reports are typically obtained to determine manifest daily functioning. Informant reports of participant functioning and their associations with objective participant performance on neuropsychological testing have been shown to vary based on informant characteristics. However, associations among informant characteristics, reported functioning, and neuropsychological performance have not been adequately examined with Mexican American or other Hispanic/Latino samples, despite these populations' disproportionately higher rates of dementia due to Alzheimer's disease and related disorders. Method: We examined associations of informant characteristics with informant reports of participant functioning (assessed via the Functional Activities Questionnaire [FAQ]), and potential moderating effects of these characteristics on associations between reported functioning and participant performance on neuropsychological testing, for Mexican American adult participants in the National Alzheimer's Coordinating Center cohort (n = 294). Results: Female informants reported significantly worse participant functioning compared to male informants (p = .035, r = .126). Moreover, significant associations between reported functioning and memory performance were observed for participants with female informants, but not for those with male informants (p = .024, r = .138). Higher levels of informant education were associated with significantly worse participant functioning (p = .011, r = .151). However, informant education did not moderate associations between reported functioning and neuropsychological performance (ps > .05). Conclusions: Compared to male informants, female informants may provide subjective reports of Mexican American participant functioning that more closely corroborate objective participant performance in memory.

A Look at Demographics and Transition to Virtual Assessments: An Analysis of Bias in the American Board of Surgery General Surgery Certifying Exams

OBJECTIVE

The goals of this study were (1) to assess if examiner ratings in the American Board of Surgery (ABS) General Surgery Cetifying Exam (CE) are biased based on the gender, race, and ethnicity of the candidate or the examiners, and (2) if the format of delivering of the exams, in-person or virtual, affects how examiners rate candidates.

DESIGN

We included every candidate-examiner combination for first time takers of the general surgery oral exam. Total scores and pass/fail outcomes based on the 4 scores given by examiners to candidates were analyzed using multilevel models, with candidates as random effects. Explanatory variables included the gender, race, and ethnicity of candidates and examiners, and the format of the exam (in-person or virtual). Candidates' first attempt scores on the ABS General Surgery Qualifying Exam (QE) were also included in the models to control for the baseline knowledge of the candidate. Three sets of models were evaluated for each demographic variable (gender, race, ethnicity) due to missingness in data. p-values and coefficients of determination R2 were used to quantify the statistical and practical significance of the model coefficients (an existent relationship between the explored variables on CE scores was considered statistically and practically significant if the p-value was lower than 0.01 and R2 higher than 1%).

PARTICIPANTS

All first-time takers of the American Board of Surgery General Surgery Certifying Exam from 2016 to 2022 that had demographic data, and the examiners that participated in those exams.

RESULTS

The number of candidates/examiners for the 3 sets of models was 8665/514 (gender), 5906/465 (race), and 4678/295 (ethnicity). The demographic variables, format of the exam, or their interactions were not found to significantly relate to examiner-candidate ratings or pass/fail outcomes. The only variable that was significantly related to CE scores was candidates' QE scores, which was added to the models as a measure of candidates' initial knowledge; this held for all models for total scores (F[1,8659] = 1069.89, p-value < 0.01, R2 = 5% [gender models], F(1,5696.3) = 589.13, p-value < 0.01, R2 = 5% [race models], F(1,4459.5) = 278.33, p-value < 0.01, R2 = 5% [ethnicity models]), and pass/fail outcomes (CI = 1.61-1.73, p-value < 0.01, R2 = 3% [gender models], CI = 1.67-1.85, p-value < 0.01, R2 = 3% [race models], CI = 2.17-2.90, p-value < 0.01, R2 = 3% [ethnicity models]).

CONCLUSIONS

This study shows that there is not a relationship between candidate and examiner gender, race, or ethnicity, and exam outcomes based on statistical models looking at examiner-candidate ratings and pass/fail outcomes. In addition, the delivery of the certifying exam in a virtual format appears to have no statistical impact on outcomes compared to in-person delivery. This suggests that the ABS is performing well in both demographic bias and virtual space.

Gender and Professional Title Use in Internal Medicine Resident Narrative Assessments

Background: Residency is a time of personal and professional growth. Resident assessment and feedback are an integral part of that process. However, assessment may be influenced by various types of bias, including gender bias. Women are less likely than men to be identified by their professional titles in many settings. The use of professional titles for residents in written assessments is unknown and may be a marker of bias. Objective: To assess for differences and trends regarding the use of professional and personal titles in formal resident assessments related to gender-based resident-faculty pairs. Methods: Electronic assessments of postgraduate year 1 (PGY1) internal medicine residents from the 2019-2020 academic year were used. Professional title use was analyzed, as it relates to resident-faculty gendered dyads, among other variables. The primary outcome of professional title usage was split into a binary variable by professional versus other titles and analyzed using logistic regression and random-effects model. Results: We analyzed 1,363 unique electronic assessments (37.8% from female faculty). Female residents were more likely to be addressed by a professional title than their male colleagues (odds ratio [OR], 1.7; confidence interval [CI], 1.2-2.4; p = 0.02). We found no difference in professional title usage based on resident-faculty gendered dyads. After adjusting for repeated faculty and resident encounters with random-effects model, secondary analysis found no significant difference in evaluation of word count between gendered dyads. Conclusions: The analysis found no significant difference in professional title usage based on resident-faculty dyads. In our analysis, female residents were significantly more likely to have their professional title used on assessments than male residents.