26
|
Barcala-Furelos R, González-Represas A, Rey E, Martínez-Rodríguez A, Kalén A, Marques O, Rama L. Is Low-Frequency Electrical Stimulation a Tool for Recovery after a Water Rescue? A Cross-Over Study with Lifeguards. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2020; 17:ijerph17165854. [PMID: 32806727 PMCID: PMC7460120 DOI: 10.3390/ijerph17165854] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/15/2020] [Revised: 07/26/2020] [Accepted: 08/10/2020] [Indexed: 11/16/2022]
Abstract
This study aimed to evaluate the degree to which transcutaneous electrical stimulation (ES) enhanced recovery following a simulated water rescue. Twenty-six lifeguards participated in this study. The rescue consisted of swimming 100 m with fins and rescue-tube: 50 m swim approach and 50 m tow-in a simulated victim. Blood lactate clearance, rated perceived effort (RPE), and muscle contractile properties were evaluated at baseline, after the water rescue, and after ES or passive-recovery control condition (PR) protocol. Tensiomiography, RPE, and blood lactate basal levels indicated equivalence between both groups. There was no change in tensiomiography from pre to post-recovery and no difference between recovery protocols. Overall-RPE, legs-RPE and arms-RPE after ES (mean ± SD; 2.7 ± 1.53, 2.65 ± 1.66, and 2.30 ± 1.84, respectively) were moderately lower than after PR (3.57 ± 2.4, 3.71 ± 2.43, and 3.29 ± 1.79, respectively) (p = 0.016, p = 0.010, p = 0.028, respectively). There was a significantly lower blood lactate level after recovery in ES than in PR (mean ± SD; 4.77 ± 1.86 mmol·L-1 vs. 6.27 ± 3.69 mmol·L-1; p = 0.045). Low-frequency ES immediately after a water rescue is an effective recovery strategy to clear out blood lactate concentration.
Collapse
|
27
|
Abstract
OBJECTIVE To diagnose egocentric neglect after stroke, the spatial bias of performance on cancellation tasks is typically compared to a single cutoff. This standard procedure relies on the assumption that the measurement error of cancellation performance does not depend on non-spatial impairments affecting the total number of cancelled targets. Here we assessed the impact of this assumption on false-positive diagnoses. METHOD We estimated false positives by simulating cancellation data using a binomial model. Performance was summarised by the difference in left and right cancelled targets (R-L) and the Centre of Cancellation (CoC). Diagnosis was based on a fixed cutoff versus cutoffs adjusted for the total number of cancelled targets and on single test performance versus unanimous or proportional agreement across multiple tests. Finally, we compared the simulation findings to empirical cancellation data acquired from 651 stroke patients. RESULTS Using a fixed cutoff, the rate of false positives depended on the total number of cancelled targets and ranged from 10% to 30% for R-L scores and from 10% to 90% for CoC scores. The rate of false positives increased even further when diagnosis was based on proportional agreement across multiple tests. Adjusted cutoffs and unanimous agreement across multiple tests were effective at controlling false positives. For empirical data, fixed versus adjusted cutoffs differ in estimation of neglect prevalence by 13%, and this difference was largest for patients with non-spatial impairments. CONCLUSIONS Our findings demonstrate the importance of considering non-spatial impairments when diagnosing neglect based on cancellation performance.
Collapse
|
28
|
Miarka B, Pérez DIV, Aedo-Muñoz E, da Costa LOF, Brito CJ. Technical-Tactical Behaviors Analysis of Male and Female Judo Cadets' Combats. Front Psychol 2020; 11:1389. [PMID: 32636789 PMCID: PMC7317020 DOI: 10.3389/fpsyg.2020.01389] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/19/2020] [Accepted: 05/25/2020] [Indexed: 11/13/2022] Open
Abstract
This brief research report showed technical-tactical behaviors of male and female judo cadets during combats, comparing the frequency and time of judo combat actions, techniques and penalties. The data was composed for 3,240 sequential technical-tactical behavior analysis from 108 female and 300 male cadet combats recorded of public judo championships. Combat, standing combat moments, approach action, gripping action, attack, groundwork actions and pause moment were observed and determinant technical-tactical behaviors (frequencies of actions, penalties and type of attacks) analysis were done with FRAMI software, followed by Mann-Whitney and Student's t-test, p ≤ 0.05. Our main results indicated that male cadets with 58.66s ± 50.26s demonstrated longer gripping action than female with 38.44s ± 30.44s, as standing combat (tachi-waza) had differences between male with 96.8s ± 72s and female athletes with 75.85s ± 56.97s. Moreover, male cadets had higher sacrifice techniques (sutemi-waza) actions than female athletes. This information could be used to a best performance associated with "psyching-up" as much as it could be used on physical training and technical-tactical ability of female and male cadets.
Collapse
|
29
|
Guneysu Ozgur A, Wessel MJ, Olsen JK, Johal W, Ozgur A, Hummel FC, Dillenbourg P. Gamified Motor Training With Tangible Robots in Older Adults: A Feasibility Study and Comparison With the Young. Front Aging Neurosci 2020; 12:59. [PMID: 32317957 PMCID: PMC7146054 DOI: 10.3389/fnagi.2020.00059] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2019] [Accepted: 02/19/2020] [Indexed: 11/13/2022] Open
Abstract
Background: An increasing lifespan and the resulting change in our expectations of later life stages are dependent on a good health state. This emphasizes the importance of the development of strategies to further strengthen healthy aging. One important aspect of good health in later life stages is sustained skilled motor function. Objective: Here, we tested the effectiveness of robotic upper limb motor training in a game-like scenario assessing game-based learning and its transfer potential. Methods: Thirty-six healthy participants (n = 18 elderly participants, n = 18 young controls) trained with a Pacman-like game using a hand-held Cellulo robot on 2 consecutive days. The game-related movements were conducted on a printed map displaying a maze and targets that had to be collected. Gradually, the task difficulty was adjusted between games by modifying or adding different game elements (e.g., speed and number of chasing ghosts, additional rules, and haptic feedback). Transfer was assessed by scoring simple robot manipulation on two different trajectories. Results: Elderly participants were able to improve their game performance over time [t(874) = 2.97, p < 0.01]. The applied game elements had similar effects on both age groups. Importantly, the game-based learning was transferable to simple robot manipulation that resembles activities of daily life. Only minor age-related differences were present (smaller overall learning gain and different effects of the wall-crash penalty rule in the elderly group). Conclusions: Gamified motor training with the Cellulo system has the potential to translate into an efficient and relatively low-cost robotic motor training tool for promoting upper limb function to promote healthy aging.
Collapse
|
30
|
Hultin M, Jonsson K, Härgestam M, Lindkvist M, Brulin C. Reliability of instruments that measure situation awareness, team performance and task performance in a simulation setting with medical students. BMJ Open 2019; 9:e029412. [PMID: 31515425 PMCID: PMC6747650 DOI: 10.1136/bmjopen-2019-029412] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/25/2019] [Revised: 08/06/2019] [Accepted: 08/07/2019] [Indexed: 11/30/2022] Open
Abstract
OBJECTIVES The assessment of situation awareness (SA), team performance and task performance in a simulation training session requires reliable and feasible measurement techniques. The objectives of this study were to test the Airways-Breathing-Circulation-Disability-Exposure (ABCDE) checklist and the Team Emergency Assessment Measure (TEAM) for inter-rater reliability, as well as the application of Situation Awareness Global Assessment Technique (SAGAT) for feasibility and internal consistency. DESIGN Methodological approach. SETTING Data collection during team training using full-scale simulation at a university clinical training centre. The video-recorded scenarios were rated independently by four raters. PARTICIPANTS 55 medical students aged 22-40 years in their fourth year of medical studies, during the clerkship in anaesthesiology and critical care medicine, formed 23 different teams. All students answered the SAGAT questionnaires, and of these students, 24 answered the follow-up postsimulation questionnaire (PSQ). TEAM and ABCDE were scored by four professionals. MEASURES The ABCDE and TEAM were tested for inter-rater reliability. The feasibility of SAGAT was tested using PSQ. SAGAT was tested for internal consistency both at an individual level (SAGAT) and a team level (Team Situation Awareness Global Assessment Technique (TSAGAT)). RESULTS The intraclass correlation was 0.54/0.83 (single/average measurements) for TEAM and 0.55/0.83 for ABCDE. According to the PSQ, the items in SAGAT were rated as relevant to the scenario by 96% of the participants. Cronbach's alpha for SAGAT/TSAGAT for the two scenarios was 0.80/0.83 vs 0.62/0.76, and normed χ² was 1.72 vs 1.62. CONCLUSION Task performance, team performance and SA could be purposefully measured, and the reliability of the measurements was good.
Collapse
|
31
|
Bello FD, Brito CJ, Amtmann J, Miarka B. Ending MMA Combat, Specific Grappling Techniques According to the Type of the Outcome. J Hum Kinet 2019; 67:271-280. [PMID: 31523324 PMCID: PMC6714373 DOI: 10.2478/hukin-2018-0081] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022] Open
Abstract
This study compared grappling motor actions of male mixed martial arts (MMA) athletes considering outcome types from Ultimate Fighting Championship ( UFC) bouts. A validated protocol of technical-tactical analysis was utilized as in previous studies addressing MMA performance analysis, and Kruskall Wallis and U Mann-Whitney tests were applied to compare effects of types of outcome decisions (Split vs. Unanimous Decision vs. Knockout-KO/Technical-knockout-TKO vs. Submission). Unanimous Decision showed higher frequencies of takedowns attempted/round than KO/TKO and Submission outcomes (p ≤ 0.05; 1.9 ± 1.9 vs. 1.3 ± 1.4 vs. 1.0 ± 1.1 attempts). Bouts with Split Decision demonstrated higher takedowns/round than bouts ended by Submission (p = 0.048; 0.4 ± 0.7 vs. 0.2 ± 0.6 attempts). TKO/KO showed lower values of sweeps/round (p = 0.008, 0.0 ± 0.0 vs. 0.1 ± 0.3 attempts) and takedowns attempted/round (p = 0.014, 1.3 ± 1.4 vs. 2.0 ± 1.6 attempts) than bouts ending by Split Decision. The Submission outcome showed a higher frequency of submissions attempted/round than KO/TKO and Unanimous Decision (p ≤ 0.041, 0.3 ± 0.7 vs 0.2 ± 0.5 vs 0.2 ± 0.5). These results show a large specificity in the type of grappling attack/situation according to the strategy to end the combat. These results also show that the grappling strategy and tactics are variable depending on the strengths and weaknesses of the athletes, and can be used by coaches and athletes to develop specific training programs.
Collapse
|
32
|
Willis M, Duckworth P, Coulter A, Meyer ET, Osborne M. The Future of Health Care: Protocol for Measuring the Potential of Task Automation Grounded in the National Health Service Primary Care System. JMIR Res Protoc 2019; 8:e11232. [PMID: 30964437 PMCID: PMC6477572 DOI: 10.2196/11232] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2018] [Revised: 10/30/2018] [Accepted: 11/11/2018] [Indexed: 02/06/2023] Open
Abstract
Background Recent advances in technology have reopened an old debate on which sectors will be most affected by automation. This debate is ill served by the current lack of detailed data on the exact capabilities of new machines and how they are influencing work. Although recent debates about the future of jobs have focused on whether they are at risk of automation, our research focuses on a more fine-grained and transparent method to model task automation and specifically focus on the domain of primary health care. Objective This protocol describes a new wave of intelligent automation, focusing on the specific pressures faced by primary care within the National Health Service (NHS) in England. These pressures include staff shortages, increased service demand, and reduced budgets. A critical part of the problem we propose to address is a formal framework for measuring automation, which is lacking in the literature. The health care domain offers a further challenge in measuring automation because of a general lack of detailed, health care–specific occupation and task observational data to provide good insights on this misunderstood topic. Methods This project utilizes a multimethod research design comprising two phases: a qualitative observational phase and a quantitative data analysis phase; each phase addresses one of the two project aims. Our first aim is to address the lack of task data by collecting high-quality, detailed task-specific data from UK primary health care practices. This phase employs ethnography, observation, interviews, document collection, and focus groups. The second aim is to propose a formal machine learning approach for probabilistic inference of task- and occupation-level automation to gain valuable insights. Sensitivity analysis is then used to present the occupational attributes that increase/decrease automatability most, which is vital for establishing effective training and staffing policy. Results Our detailed fieldwork includes observing and documenting 16 unique occupations and performing over 130 tasks across six primary care centers. Preliminary results on the current state of automation and the potential for further automation in primary care are discussed. Our initial findings are that tasks are often shared amongst staff and can include convoluted workflows that often vary between practices. The single most used technology in primary health care is the desktop computer. In addition, we have conducted a large-scale survey of over 156 machine learning and robotics experts to assess what tasks are susceptible to automation, given the state-of-the-art technology available today. Further results and detailed analysis will be published toward the end of the project in early 2019. Conclusions We believe our analysis will identify many tasks currently performed manually within primary care that can be automated using currently available technology. Given the proper implementation of such automating technologies, we expect considerable staff resources to be saved, alleviating some pressures on the NHS primary care staff. International Registered Report Identifier (IRRID) DERR1-10.2196/11232
Collapse
|
33
|
Miarka B, Brito CJ, Amtmann J, Córdova C, Bello FD, Camey S. Suggestions for Judo Training with Pacing Strategy and Decision Making by Judo Championship Phases. J Hum Kinet 2018; 64:219-232. [PMID: 30429913 PMCID: PMC6231334 DOI: 10.1515/hukin-2017-0196] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022] Open
Abstract
The present study aimed to compare pacing and decision making of athletes competing in judo, with particular attention paid to effort-pause ratios occurring in the championship phases of the Olympic Games and non-Olympic Games. The sample was composed of 53,403 sequential actions analyzed during 611 performances of the non-Olympic Games (eliminatory n = 330, quarterfinals n = 60, semi-final n = 88, repechage n = 21, third place playoff n = 26, and final n = 79) and 163 from the Olympic Games (eliminatory n = 71, quarterfinals n = 13, semi-final n = 26, repechage n = 20, third place playoff n = 24, and final n = 14). The analysis of effort-pause ratios included separating bouts into states of approach, gripping, attack, groundwork and pause, according to frequency and time. A Markov multi-state model and analysis of variance were applied (p ≤ 0.05). Approach time presented differences of the eliminatory Olympic Games (7.3 ± 3.2 s) versus final non-Olympic Games (6.0 ± 2.2s), and the third place playoff Olympic Games (8.1 ± 2.3 s) versus semi-final (6.2 ± 2.4 s) and third place playoff (5.9 ± 2.1 s) of the non-Olympic Games, and the semi-final Olympic Games (8.6 ± 2.3 s) versus eliminatory (6.5 ± 2.3 s), quarter-finals (6.5 ± 1.7 s), semi-final (6.2 ± 2.4 s), repechage (6.2 ± 2.2 s), third place playoff (5.9 ± 2.1 s), and final (6.0 ± 2.0 s) of the non-Olympic Games. Pause time presented differences of the semi-final Olympic Games (6.8 ± 2.1 s) versus eliminatory (5.1 ± 3.1 s). The present data suggest a focus on pacing strategy during championship phases, which mimic the requirements of judo combats.
Collapse
|
34
|
Padulo J, Nikolaidis PT, Cular D, Dello Iacono A, Vando S, Galasso M, Lo Storto D, Ardigò LP. The Effect of Heart Rate on Jump-Shot Accuracy of Adolescent Basketball Players. Front Physiol 2018; 9:1065. [PMID: 30123140 PMCID: PMC6085478 DOI: 10.3389/fphys.2018.01065] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2018] [Accepted: 07/17/2018] [Indexed: 11/13/2022] Open
Abstract
Basketball is a team sport, where fundamental skills - fundamentals - are key determinants for success. Jump-shot (JS) is a basketball fundamental used frequently during game. It is interesting to spread light on the relationship between effort intensity and JS ability. Study aim was to investigate different heart rates (HRs) effect on JS accuracy (JS%) in 22 male youth (15.7 ± 0.9 years) players. Experimental sessions consisted of 10 JSs from five spots 5 m from basket at three different HRs: rest (0HR) and after warm-up (50% [50HR] and 80% maximal HR [80HR]). Analysis of variance showed differences in JS% over sessions (42.27 ± 14.78% at 0HR, 38.18 ± 10.53% at 50HR, and 30.00 ± 16.62% at 80HR; P = 0.018). Least significant difference test did not show any significant difference between 50HR and 0HR JS% (P = 0.343), while 80HR elicited significantly lower values with respect to both 0HR (P = 0.006) and 50HR (P = 0.049). Study provided practical indications on maintaining high JS%: preliminary warm-up (even if injury-protecting) does not improve JS%, because between 50HR and 0HR difference was not significant; and 80HR significantly decreases JS%. Therefore, to maximize JS scoring players have to rest as much as possible during game-play pauses, and coaches should manage timeouts and substitutions accordingly, especially during final minutes of close games.
Collapse
|
35
|
Theis S, Rasche PWV, Bröhl C, Wille M, Mertens A. Task-Data Taxonomy for Health Data Visualizations: Web-Based Survey With Experts and Older Adults. JMIR Med Inform 2018; 6:e39. [PMID: 29986844 PMCID: PMC6056737 DOI: 10.2196/medinform.9394] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2017] [Revised: 03/14/2018] [Accepted: 04/03/2018] [Indexed: 11/13/2022] Open
Abstract
Background Increasingly, eHealth involves health data visualizations to enable users to better understand their health situation. Selecting efficient and ergonomic visualizations requires knowledge about the task that the user wants to carry out and the type of data to be displayed. Taxonomies of abstract tasks and data types bundle this knowledge in a general manner. Task-data taxonomies exist for visualization tasks and data. They also exist for eHealth tasks. However, there is currently no joint task taxonomy available for health data visualizations incorporating the perspective of the prospective users. One of the most prominent prospective user groups of eHealth are older adults, but their perspective is rarely considered when constructing tasks lists. Objective The aim of this study was to construct a task-data taxonomy for health data visualizations based on the opinion of older adults as prospective users of eHealth systems. eHealth experts served as a control group against the bias of lacking background knowledge. The resulting taxonomy would then be used as an orientation in system requirement analysis and empirical evaluation and to facilitate a common understanding and language in eHealth data visualization. Methods Answers from 98 participants (51 older adults and 47 eHealth experts) given in an online survey were quantitatively analyzed, compared between groups, and synthesized into a task-data taxonomy for health data visualizations. Results Consultation, diagnosis, mentoring, and monitoring were confirmed as relevant abstract tasks in eHealth. Experts and older adults disagreed on the importance of mentoring (χ24=14.1, P=.002) and monitoring (χ24=22.1, P<.001). The answers to the open questions validated the findings from the closed questions and added therapy, communication, cooperation, and quality management to the aforementioned tasks. Here, group differences in normalized code counts were identified for “monitoring” between the expert group (mean 0.18, SD 0.23) and the group of older adults (mean 0.08, SD 0.15; t96=2431, P=.02). Time-dependent data was most relevant across all eHealth tasks. Finally, visualization tasks and data types were assigned to eHealth tasks by both experimental groups. Conclusions We empirically developed a task-data taxonomy for health data visualizations with prospective users. This provides a general framework for theoretical concession and for the prioritization of user-centered system design and evaluation. At the same time, the functionality dimension of the taxonomy for telemedicine—chosen as the basis for the construction of present taxonomy—was confirmed.
Collapse
|
36
|
Chen J, Oh PJ, Cheng N, Shah A, Montez J, Jarc A, Guo L, Gill IS, Hung AJ. Use of Automated Performance Metrics to Measure Surgeon Performance during Robotic Vesicourethral Anastomosis and Methodical Development of a Training Tutorial. J Urol 2018; 200:895-902. [PMID: 29792882 DOI: 10.1016/j.juro.2018.05.080] [Citation(s) in RCA: 40] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/08/2018] [Indexed: 01/12/2023]
Abstract
PURPOSE We sought to develop and validate automated performance metrics to measure surgeon performance of vesicourethral anastomosis during robotic assisted radical prostatectomy. Furthermore, we sought to methodically develop a standardized training tutorial for robotic vesicourethral anastomosis. MATERIALS AND METHODS We captured automated performance metrics for motion tracking and system events data, and synchronized surgical video during robotic assisted radical prostatectomy. Nonautomated performance metrics were manually annotated by video review. Automated and nonautomated performance metrics were compared between experts with 100 or more console cases and novices with fewer than 100 cases. Needle driving gestures were classified and compared. We then applied task deconstruction, cognitive task analysis and Delphi methodology to develop a standardized robotic vesicourethral anastomosis tutorial. RESULTS We analyzed 70 vesicourethral anastomoses with a total of 1,745 stitches. For automated performance metrics experts outperformed novices in completion time (p <0.01), EndoWrist® articulation (p <0.03), instrument movement efficiency (p <0.02) and camera manipulation (p <0.01). For nonautomated performance metrics experts had more optimal needle to needle driver positioning, fewer needle driving attempts, a more optimal needle entry angle and less tissue trauma (each p <0.01). We identified 14 common robotic needle driving gestures. Random gestures were associated with lower efficiency (p <0.01), more attempts (p <0.04) and more trauma (p <0.01). The finalized tutorial contained 66 statements and figures. Consensus among 8 expert surgeons was achieved after 2 rounds, including among 58 (88%) after round 1 and 8 (12%) after round 2. CONCLUSIONS Automated performance metrics can distinguish surgeon expertise during vesicourethral anastomosis. The expert vesicourethral anastomosis technique was associated with more efficient movement and less tissue trauma. Standardizing robotic vesicourethral anastomosis and using a methodically developed tutorial may help improve robotic surgical training.
Collapse
|
37
|
Berendonk C, Rogausch A, Gemperli A, Himmel W. Variability and dimensionality of students' and supervisors' mini-CEX scores in undergraduate medical clerkships - a multilevel factor analysis. BMC MEDICAL EDUCATION 2018; 18:100. [PMID: 29739387 PMCID: PMC5941409 DOI: 10.1186/s12909-018-1207-1] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/22/2017] [Accepted: 04/20/2018] [Indexed: 05/28/2023]
Abstract
BACKGROUND The mini clinical evaluation exercise (mini-CEX)-a tool used to assess student-patient encounters-is increasingly being applied as a learning device to foster clinical competencies. Although the importance of eliciting self-assessment for learning is widely acknowledged, little is known about the validity of self-assessed mini-CEX scores. The aims of this study were (1) to explore the variability of medical students' self-assessed mini-CEX scores, and to compare them with the scores obtained from their clinical supervisors, and (2) to ascertain whether learners' self-assessed mini-CEX scores represent a global dimension of clinical competence or discrete clinical skills. METHODS In year 4, medical students conducted one to three mini-CEX per clerkship in gynaecology, internal medicine, paediatrics, psychiatry and surgery. Students and clinical supervisors rated the students' performance on a 10-point scale (1 = great need for improvement; 10 = little need for improvement) in the six domains history taking, physical examination, counselling, clinical judgement, organisation/efficiency and professionalism as well as in overall performance. Correlations between students' self-ratings and ratings from clinical supervisors were calculated (Pearson's correlation coefficient) based on averaged scores per domain and overall. To investigate the dimensionality of the mini-CEX domain scores, we performed factor analyses using linear mixed models that accounted for the multilevel structure of the data. RESULTS A total of 1773 mini-CEX from 164 students were analysed. Mean scores for the six domains ranged from 7.5 to 8.3 (student ratings) and from 8.8 to 9.3 (supervisor ratings). Correlations between the ratings of students and supervisors for the different domains varied between r = 0.29 and 0.51 (all p < 0.0001). Mini-CEX domain scores revealed a single-factor solution for both students' and supervisors' ratings, with high loadings of all six domains between 0.58 and 0.83 (students) and 0.58 and 0.84 (supervisors). CONCLUSIONS These findings put a question mark on the validity of mini-CEX domain scores for formative purposes, as neither the scores obtained from students nor those obtained from clinical supervisors unravelled specific strengths and weaknesses of individual students' clinical competence.
Collapse
|
38
|
Thrane G, Sunnerhagen KS, Persson HC, Opheim A, Alt Murphy M. Kinematic upper extremity performance in people with near or fully recovered sensorimotor function after stroke. Physiother Theory Pract 2018; 35:822-832. [PMID: 29658813 DOI: 10.1080/09593985.2018.1458929] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/17/2022]
Abstract
Background: Clinical scales for upper extremity motor function may not capture improvement among higher functioning people with stroke. Objective: To describe upper extremity kinematics in people with stroke who score within the upper 10% of the Fugl-Meyer Assessment (FMA-UE) and explore the ceiling effects of the FMA-UE. Design: A cross-sectional study design was used. Participants: People with stroke were included from the Stroke Arm Longitudinal Study at University of Gothenburg together with 30 healthy controls. The first analysis included participants who achieved FMA-UE score > 60 within the first year of stroke (assessed at 3 days, 2 weeks, 4 weeks, 3 months, or 12 months post stroke). The second analysis included participants with submaximal FMA-UE (60-65 points, n = 24) or maximal FMA-UE score (66 points, n = 21) at 3 months post stroke. Measurements: The kinematic analysis of a standardized drinking task included movement time, velocity and strategy, joint angles of the elbow, and shoulder and trunk displacement. Results: The high FMA-UE stroke group showed deficits in seven of eight kinematic variables. The submaximal FMA-UE stroke group was slower, had lower tangential and angular peak velocity, and used more trunk displacement than the controls. In addition, the maximal FMA-UE stroke group showed larger trunk displacement and arm abduction during drinking and lower peak angular velocity of the elbow. Conclusions: Participants with near or fully recovered sensorimotor function after stroke still show deficits in movement kinematics; however, the FMA-UE may not be able to detect these impairments.
Collapse
|
39
|
Critical incident technique analysis applied to perianesthetic cardiac arrests at a university teaching hospital. Vet Anaesth Analg 2018; 45:345-350. [PMID: 29627202 DOI: 10.1016/j.vaa.2018.01.001] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2017] [Revised: 11/22/2017] [Accepted: 01/02/2018] [Indexed: 11/23/2022]
Abstract
OBJECTIVE To apply the critical incident technique (CIT) methodology to a series of perianesthetic cardiac arrest events at a university teaching hospital to describe the factors that contributed to cardiac arrest. STUDY DESIGN CIT qualitative analysis of a case series. ANIMALS A group of 16 dogs and cats that suffered a perioperative cardiac arrest between November 2013 and November 2016. METHODS If an arrest occurred, the event was discussed among the anesthesiologists. The discussion included a description of the case, a description of the sequence of events leading up to the arrest and a discussion of what could have been done to affect the outcome. A written description of the case and the event including animal signalment and a timeline of events was provided by the supervising anesthesiologist following discussion among the anesthesiologists. Only dogs or cats were included. After the data collection period, information from the medical record was collected. A qualitative document analysis was performed on the summaries provided about each case by the supervising anesthesiologist, the medical record and any supporting documents. Each case was then classified into one or more of the following: animal, human, equipment, drug and procedural factors for cardiac arrest. RESULTS The most common factor was animal (n=14), followed by human (n=12), procedural (n=4), drugs (n=1) and equipment (n=1). The majority (n=11) of animals had multiple factors identified. CONCLUSIONS AND CLINICAL RELEVANCE Cardiac arrests during anesthesia at a referral teaching hospital were primarily a result of animal and human factors. Arrests because of procedural, drug and equipment factors were uncommon. Most animals experienced more than one factor and two animals arrested after a change in recumbency. Future work should focus on root cause analysis and interventions designed to minimize all factors, particularly human ones.
Collapse
|
40
|
Schembre SM, Liao Y, Robertson MC, Dunton GF, Kerr J, Haffey ME, Burnett T, Basen-Engquist K, Hicklen RS. Just-in-Time Feedback in Diet and Physical Activity Interventions: Systematic Review and Practical Design Framework. J Med Internet Res 2018; 20:e106. [PMID: 29567638 PMCID: PMC5887039 DOI: 10.2196/jmir.8701] [Citation(s) in RCA: 71] [Impact Index Per Article: 11.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2017] [Revised: 12/19/2017] [Accepted: 12/22/2017] [Indexed: 01/14/2023] Open
Abstract
Background The integration of body-worn sensors with mobile devices presents a tremendous opportunity to improve just-in-time behavioral interventions by enhancing bidirectional communication between investigators and their participants. This approach can be used to deliver supportive feedback at critical moments to optimize the attainment of health behavior goals. Objective The goals of this systematic review were to summarize data on the content characteristics of feedback messaging used in diet and physical activity (PA) interventions and to develop a practical framework for designing just-in-time feedback for behavioral interventions. Methods Interventions that included just-in-time feedback on PA, sedentary behavior, or dietary intake were eligible for inclusion. Feedback content and efficacy data were synthesized descriptively. Results The review included 31 studies (15/31, 48%, targeting PA or sedentary behavior only; 13/31, 42%, targeting diet and PA; and 3/31, 10%, targeting diet only). All studies used just-in-time feedback, 30 (97%, 30/31) used personalized feedback, and 24 (78%, 24/31) used goal-oriented feedback, but only 5 (16%, 5/31) used actionable feedback. Of the 9 studies that tested the efficacy of providing feedback to promote behavior change, 4 reported significant improvements in health behavior. In 3 of these 4 studies, feedback was continuously available, goal-oriented, or actionable. Conclusions Feedback that was continuously available, personalized, and actionable relative to a known behavioral objective was prominent in intervention studies with significant behavior change outcomes. Future research should determine whether all or some of these characteristics are needed to optimize the effect of feedback in just-in-time interventions.
Collapse
|
41
|
Ardigò LP, Kuvacic G, Iacono AD, Dascanio G, Padulo J. Effect of Heart rate on Basketball Three-Point Shot Accuracy. Front Physiol 2018; 9:75. [PMID: 29467676 PMCID: PMC5808225 DOI: 10.3389/fphys.2018.00075] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2017] [Accepted: 01/22/2018] [Indexed: 11/18/2022] Open
Abstract
The three-point shot (3S) is a fundamental basketball skill used frequently during a game, and is often a main determinant of the final result. The aim of the study was to investigate the effect of different metabolic conditions, in terms of heart rates, on 3S accuracy (3S%) in 24 male (Under 17) basketball players (age 16.3 ± 0.6 yrs). 3S performance was specifically investigated at different heart rates. All sessions consisted of 10 consecutive 3Ss from five different significant field spots just beyond the FIBA three-point line, i.e., about 7 m from the basket (two counter-clockwise “laps”) at different heart rates: rest (0HR), after warm-up (50%HRMAX [50HR]), and heart rate corresponding to 80% of its maximum value (80%HRMAX [80HR]). We found that 50HR does not significantly decrease 3S% (−15%, P = 0.255), while 80HR significantly does when compared to 0HR (−28%, P = 0.007). Given that 50HR does not decrease 3S% compared to 0HR, we believe that no preliminary warm-up is needed before entering a game in order to specifically achieve a high 3S%. Furthermore, 3S training should be performed in conditions of moderate-to-high fatigued state so that a high 3S% can be maintained during game-play.
Collapse
|
42
|
Chung RD, Hunter-Smith DJ, Spychal RT, Ramakrishnan VV, Rozen WM. A systematic review of intraoperative process mapping in surgery. Gland Surg 2017; 6:715-725. [PMID: 29302490 DOI: 10.21037/gs.2017.11.02] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Process mapping has been identified as a strategy to improve surgical efficiency but has been inconsistently applied in the literature and underutilised in surgical practice. In this journal, we recently described our utilisation of these approaches when applied to breast reconstruction. We showed that in surgery as complex as autologous breast reconstruction, process mapping can improve efficiency, and may improve surgical teaching, education and audit. The intraoperative period specifically is an area that can be applied not only to breast reconstruction, but to a much broader range of surgical procedures. A systematic review was undertaken of the databases Ovid MEDLINE, Allied and Complementary Medicine Database, Embase and PsychINFO. Manual searching of the references from articles identified was also conducted. Data items relating to the review aims were extracted from articles' methods, applications, and outcomes. A descriptive analysis was carried out to synthesise the information on the current usage of process mapping in the intraoperative period. Seventeen of 1,488 studies were eligible for review, with all of non-randomised study design. Studies had overlap in components of the intraoperative period to which process mapping was applied. Common areas of improvement were identified. Outcome measures were assessed in ten studies that implemented interventions based on the improvement areas to increase surgical efficiency. As such, process mapping has been used as part of larger quality improvement methods, albeit with inconsistent nomenclature, to improve surgical efficiency. While it has been applied to a range of surgical specialties, there is a lack of application to the surgical component of the intraoperative period. Greater consistency in the reporting and description of process mapping will enable further research for evidence of its benefits.
Collapse
|
43
|
Long E, Cincotta DR, Grindlay J, Sabato S, Fauteux-Lamarre E, Beckerman D, Carroll T, Quinn N. A quality improvement initiative to increase the safety of pediatric emergency airway management. Paediatr Anaesth 2017; 27:1271-1277. [PMID: 29063722 DOI: 10.1111/pan.13275] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 09/28/2017] [Indexed: 02/05/2023]
Abstract
BACKGROUND Emergency airway management is commonly associated with life-threatening hypoxia and hypotension which may be preventable. AIMS The aim of this quality improvement study was to reduce the frequency of intubation-related hypoxia and hypotension. METHODS This prospective quality improvement study was conducted over 4 years in the Emergency Department of The Royal Children's Hospital, Melbourne, Australia. A preintervention cohort highlighted safety gaps and was used to design study interventions, including an emergency airway algorithm, standardized airway equipment, a preintubation checklist and equipment template, endtidal carbon dioxide monitoring, postintubation team debriefing, and multidisciplinary team training. Following implementation, a postintervention cohort was used to monitor the impact of study interventions on clinical process and patient outcome. Process measures were as follows: use of a preintubation checklist, verbalization of an airway plan, adequate resuscitation prior to intubation, induction agent dose titration, use of apneic oxygenation, and use of endtidal carbon dioxide to confirm endotracheal tube position. The primary outcome measure was first pass success rate without hypoxia or hypotension. Potential harms from study interventions were monitored. RESULTS Forty-six intubations were included over one calendar year in the postintervention cohort (compared to 71 in the preintervention cohort). Overall clinical uptake of the 6 processes measures was 85%. First pass success rate without hypoxia or hypotension was 78% in the postintervention cohort compared with 49% in the preintervention cohort (absolute risk reduction: 29.0%; 95% confidence interval 12.3%-45.6%, number needed to treat: 3.5). No significant harms from study interventions were identified. CONCLUSION Quality improvement initiatives targeting emergency airway management may be successfully implemented in the emergency department and are associated with a reduction in adverse intubation-related events.
Collapse
|
44
|
Lumsden J, Skinner A, Coyle D, Lawrence N, Munafo M. Attrition from Web-Based Cognitive Testing: A Repeated Measures Comparison of Gamification Techniques. J Med Internet Res 2017; 19:e395. [PMID: 29167090 PMCID: PMC5719230 DOI: 10.2196/jmir.8473] [Citation(s) in RCA: 24] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2017] [Revised: 09/25/2017] [Accepted: 10/09/2017] [Indexed: 11/25/2022] Open
Abstract
BACKGROUND The prospect of assessing cognition longitudinally and remotely is attractive to researchers, health practitioners, and pharmaceutical companies alike. However, such repeated testing regimes place a considerable burden on participants, and with cognitive tasks typically being regarded as effortful and unengaging, these studies may experience high levels of participant attrition. One potential solution is to gamify these tasks to make them more engaging: increasing participant willingness to take part and reducing attrition. However, such an approach must balance task validity with the introduction of entertaining gamelike elements. OBJECTIVE This study aims to investigate the effects of gamelike features on participant attrition using a between-subjects, longitudinal Web-based testing study. METHODS We used three variants of a common cognitive task, the Stop Signal Task (SST), with a single gamelike feature in each: one variant where points were rewarded for performing optimally; another where the task was given a graphical theme; and a third variant, which was a standard SST and served as a control condition. Participants completed four compulsory test sessions over 4 consecutive days before entering a 6-day voluntary testing period where they faced a daily decision to either drop out or continue taking part. Participants were paid for each session they completed. RESULTS A total of 482 participants signed up to take part in the study, with 265 completing the requisite four consecutive test sessions. No evidence of an effect of gamification on attrition was observed. A log-rank test showed no evidence of a difference in dropout rates between task variants (χ22=3.0, P=.22), and a one-way analysis of variance of the mean number of sessions completed per participant in each variant also showed no evidence of a difference (F2,262=1.534, P=.21, partial η2=0.012). CONCLUSIONS Our findings raise doubts about the ability of gamification to reduce attrition from longitudinal cognitive testing studies.
Collapse
|
45
|
Hoenig HM, Amis K, Edmonds C, Morgan MS, Landerman L, Caves K. Testing fine motor coordination via telehealth: Effects of video characteristics on reliability and validity. J Telemed Telecare 2017; 24:365-372. [PMID: 28350283 DOI: 10.1177/1357633x17700032] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/08/2023]
Abstract
Background There is limited research about the effects of video quality on the accuracy of assessments of physical function. Methods A repeated measures study design was used to assess reliability and validity of the finger-nose test (FNT) and the finger-tapping test (FTT) carried out with 50 veterans who had impairment in gross and/or fine motor coordination. Videos were scored by expert raters under eight differing conditions, including in-person, high definition video with slow motion review and standard speed videos with varying bit rates and frame rates. Results FTT inter-rater reliability was excellent with slow motion video (ICC 0.98-0.99) and good (ICC 0.59) under the normal speed conditions. Inter-rater reliability for FNT 'attempts' was excellent (ICC 0.97-0.99) for all viewing conditions; for FNT 'misses' it was good to excellent (ICC 0.89) with slow motion review but substantially worse (ICC 0.44) on the normal speed videos. FTT criterion validity (i.e. compared to slow motion review) was excellent (β = 0.94) for the in-person rater and good ( β = 0.77) on normal speed videos. Criterion validity for FNT 'attempts' was excellent under all conditions ( r ≥ 0.97) and for FNT 'misses' it was good to excellent under all conditions ( β = 0.61-0.81). Conclusions In general, the inter-rater reliability and validity of the FNT and FTT assessed via video technology is similar to standard clinical practices, but is enhanced with slow motion review and/or higher bit rate.
Collapse
|
46
|
Bjerregård Madsen J, Kaila A, Vehviläinen-Julkunen K, Miettinen M. Time allocation and temporal focus in nursing management: an integrative review. J Nurs Manag 2016; 24:983-993. [PMID: 27411357 DOI: 10.1111/jonm.12411] [Citation(s) in RCA: 23] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/23/2016] [Indexed: 11/30/2022]
Abstract
AIM To describe the time allocation and temporal focus in nursing management. BACKGROUND There is limited information about the time allocation and temporal focus of nursing management activities. The role of nurse administrators is changing, resulting in challenges related to time management. METHODS Published literature in 2005-2014 related to the time allocation or temporal focus of nurse administrators' management activities was retrieved from five databases, and an integrative review was conducted. Data extraction, quality assessment and quantitative content analysis were performed for eight reviewed articles. RESULTS Daily reactive management activities and administrative routines were dominant in the nurse administrators' work, and strategic, proactive activities were scarce. Their daily work was fragmented by a variety of activities and numerous interruptions. CONCLUSION Little information exists about time allocation or temporal focus in nurse administrators' management activities. Further research on this topic is needed. The evidence was fairly modest, although the studies' results were generally similar. IMPLICATIONS FOR NURSING MANAGEMENT These results can be used to clarify the job descriptions of nurse administrators and to plan and focus their education and training. Organisations need to use evidence to standardise the job descriptions of different levels of nurse managers and directors.
Collapse
|
47
|
Garg A, Yadav SS, Tomar V, Priyadarshi S, Giri V, Vyas N, Agarwal N. Prospective Evaluation of Learning Curve of Urology Residents for Percutaneous Nephrolithotomy. UROLOGY PRACTICE 2016; 3:230-235. [PMID: 37592550 DOI: 10.1016/j.urpr.2015.06.009] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
Abstract
INTRODUCTION We studied the learning curve for percutaneous nephrolithotomy of urology residents according to stone complexity. METHODS The learning curve of 8 residents with no previous experience of solo percutaneous nephrolithotomy was studied. Stones were classified according to complexity using the Guy stone score. Competence was reviewed using 4 markers, namely operative time, fluoroscopic time, complication rate using the modified Clavien grading system and success rate. Analysis was done in 3-month cohorts to determine how and when competence and excellence were achieved during 1 year of training for various grades of stone. The results of resident surgeons were compared with those of experienced endourologist. RESULTS Resident surgeons achieved a plateau in mean operative time and fluoroscopic time for grade I stones after 30 to 35 cases but not for more complex stones. Similarly complications were decreased significantly only in grade I stone cases. Resident surgeons also achieved an almost excellent success rate of 87% for grade I stones only. CONCLUSIONS This study of the learning curve of residents suggests that competence and near excellence is reached after 30 to 35 cases for grade I stones. However the learning curve for complex stones (grades II to IV) is steeper and requires more experience.
Collapse
|
48
|
Morita PP, Cafazzo JA. Challenges and Paradoxes of Human Factors in Health Technology Design. JMIR Hum Factors 2016; 3:e11. [PMID: 27025862 PMCID: PMC4811664 DOI: 10.2196/humanfactors.4653] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2015] [Revised: 10/31/2015] [Accepted: 11/25/2015] [Indexed: 11/13/2022] Open
Abstract
Usability testing allows human factors professionals to identify and mitigate issues with the design and use of medical technology. The test results, however, can be paradoxical and therefore be misinterpreted, limiting their usefulness. The paradoxical findings can lead to products that are not aligned with the needs and constraints of their users. We herein report on our observations of the paradox of expertise, the paradox of preference versus performance, and the paradox of choice. Each paradox explored is in the perspective of the design of medical technology, the issues that need to be considered in the interpretation of the test results, as well as suggestions on how to avoid the pitfalls in the design of medical technology. Because these paradoxes can influence product design at various stages of product development, it is important to be aware of the effects to interpret the findings properly.
Collapse
|
49
|
Al-Jundi W, Wild J, Ritchie J, Daniels S, Robertson E, Beard J. Assessing the Nontechnical Skills of Surgical Trainees: Views of the Theater Team. JOURNAL OF SURGICAL EDUCATION 2016; 73:222-9. [PMID: 26868312 DOI: 10.1016/j.jsurg.2015.10.008] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/08/2015] [Revised: 08/10/2015] [Accepted: 10/12/2015] [Indexed: 05/27/2023]
Abstract
OBJECTIVE This study aims to explore the views of members of theater teams regarding the proposed introduction of a workplace-based assessment of nontechnical skills of surgeons (NOTSS) into the Intercollegiate Surgical Curriculum Programme in the United Kingdom. In addition, the previous training and familiarity of the members of the surgical theater team with the concept and assessment of NOTSS would be evaluated. DESIGN A regional survey of members of theater teams (consultant surgeons, anesthetists, scrub nurses, and trainees) was performed at 1 teaching and 2 district general hospitals in South Yorkshire. RESULTS There were 160 respondents corresponding to a response rate of 81%. The majority (77%) were not aware of the NOTSS assessment tool with only 9% of respondents reporting to have previously used the NOTSS tool and just 3% having received training in NOTSS assessment. Overall, 81% stated that assessing NOTSS was as important as assessing technical skills. Trainees attributed less importance to nontechnical skills than the other groups (p ≤ 0.016). Although opinion appears divided as to whether the presence of a consultant surgeon in theater could potentially make it difficult to assess a trainee's leadership skills and decision-making capabilities, overall 60% agree that the routine use of NOTSS assessment would enhance safety in the operating theater and 80% agree that the NOTSS tool should be introduced to assess the nontechnical skills of trainees in theater. However, a significantly lower proportion of trainees (45%) agreed on the latter compared with the other groups (p = 0.001). CONCLUSIONS Our survey demonstrates acceptability among the theater team for the introduction of the NOTSS tool into the surgical curriculum. However, lack of familiarity highlights the importance of faculty training for assessors before such an introduction.
Collapse
|
50
|
Rogausch A, Beyeler C, Montagne S, Jucker-Kupper P, Berendonk C, Huwendiek S, Gemperli A, Himmel W. The influence of students' prior clinical skills and context characteristics on mini-CEX scores in clerkships--a multilevel analysis. BMC MEDICAL EDUCATION 2015; 15:208. [PMID: 26608836 PMCID: PMC4658793 DOI: 10.1186/s12909-015-0490-3] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/31/2015] [Accepted: 11/19/2015] [Indexed: 05/23/2023]
Abstract
BACKGROUND In contrast to objective structured clinical examinations (OSCEs), mini-clinical evaluation exercises (mini-CEXs) take place at the clinical workplace. As both mini-CEXs and OSCEs assess clinical skills, but within different contexts, this study aims at analyzing to which degree students' mini-CEX scores can be predicted by their recent OSCE scores and/or context characteristics. METHODS Medical students participated in an end of Year 3 OSCE and in 11 mini-CEXs during 5 different clerkships of Year 4. The students' mean scores of 9 clinical skills OSCE stations and mean 'overall' and 'domain' mini-CEX scores, averaged over all mini-CEXs of each student were computed. Linear regression analyses including random effects were used to predict mini-CEX scores by OSCE performance and characteristics of clinics, trainers, students and assessments. RESULTS A total of 512 trainers in 45 clinics provided 1783 mini-CEX ratings for 165 students; OSCE results were available for 144 students (87%). Most influential for the prediction of 'overall' mini-CEX scores was the trainers' clinical position with a regression coefficient of 0.55 (95%-CI: 0.26-0.84; p < .001) for residents compared to heads of department. Highly complex tasks and assessments taking place in large clinics significantly enhanced 'overall' mini-CEX scores, too. In contrast, high OSCE performance did not significantly increase 'overall' mini-CEX scores. CONCLUSION In our study, Mini-CEX scores depended rather on context characteristics than on students' clinical skills as demonstrated in an OSCE. Ways are discussed which focus on either to enhance the scores' validity or to use narrative comments only.
Collapse
|