Critical appraisal of continuing medical education in the rheumatic diseases for primary care physicians

Evaluating pharmacists' ability to counsel on tobacco cessation using two standardized patient scenarios

OBJECTIVES

To evaluate the impact that role-playing two pre/post standardized patient scenarios within a tobacco cessation training program had on pharmacists' counseling skills. Second, to analyze the validity of the observation coding tool used to evaluate pharmacist's role-play performance.

METHODS

Pharmacists performed two role-playing scenarios which incorporated national guidelines, the 5A's counseling process, and the "preparation" and "action" phases of the transtheoretical model. Pharmacists' performance was evaluated with an observation coding tool.

RESULTS

Pharmacists' (n=25) counseling performance improved significantly post-training (p<0.02: Action Scenario; p<0.004: Preparation Scenario). More than 50% of pharmacists provided patient-directed tobacco consultation services in the one year following training. The observation tool score for the "action phase" scenario was highly associated with pharmacists' subsequent delivery of tobacco cessation services in community practice.

CONCLUSION

Role-playing facilitated pharmacists' skill development. The evaluation tool and Action Scenario may be powerful for predicting pharmacists' delivery of tobacco cessation services.

PRACTICE IMPLICATIONS

Incorporating role-playing and structured tools for performance evaluation can help enhance pharmacist performance during training and predict service delivery in community practice. Together they could facilitate tailored feedback to help pharmacists struggling with the difficult task of extending cognitive service roles in practice.

Cochrane reviews used more rigorous methods than non-Cochrane reviews: survey of systematic reviews in physiotherapy

OBJECTIVE

To describe the quality and methods of systematic reviews of physiotherapy interventions, compare Cochrane and non-Cochrane reviews, and establish the interrater reliability of the Overview Quality Assessment Questionnaire (OQAQ) quality assessment tool.

STUDY DESIGN AND SETTING

A survey of 200 published systematic reviews was done. Two independent raters assessed the search strategy, assessment of trial quality, outcomes, pooling, conclusions, and overall quality (OQAQ). The study was carried out in the University research center.

RESULTS

In these reviews, the five most common databases searched were MEDLINE, EMBASE, Cochrane Library, CINAHL, and Cochrane Review Group Registers. The Cochrane allocation concealment system and Jadad Scale were most frequently used to assess trial quality. Cochrane reviews searched more databases and were more likely to assess trial quality, report dichotomous outcomes for individual trials, and conduct a meta-analysis than non-Cochrane reviews. Non-Cochrane reviews were more likely to conclude that there was a beneficial effect of treatment. Cochrane reviews were of higher quality than non-Cochrane reviews. There has been an increase in the quality of systematic reviews over time. The OQAQ has fair to good interrater reliability.

CONCLUSION

The quality of systematic reviews in physiotherapy is improving, and the use of Cochrane Collaboration procedures appears to improve the methods and quality.

Adjustment of meta-analyses on the basis of quality scores should be abandoned

OBJECTIVE

To find if a particular quality score was better than others at validly scoring the quality of randomized controlled trials, both by examining the consistency of dividing studies into high and low quality and using a large study as a reference standard.

STUDY DESIGN AND SETTING

Observational study of meta-analyses from the Cochrane Library. These had to have binary outcomes that included more than 10 studies, one or more of which randomized more than 500 people into each group.

RESULTS

Eighteen systematic reviews, with 65 meta-analyses using binary outcomes, were included and the included trials were scored for 43 different quality scores. None of these scores was better at dividing the studies in to low and high quality, and none of the scores was better over the 65 meta-analyses in making the result closer to the reference standard.

CONCLUSION

None of the quality scores found appeared to measure quality validly. It is a mistake to assign meaning to the result of a quality score.

Benefits of a programme taking advantage of patient-instructors to teach and assess musculoskeletal skills in medical students

AIM

To evaluate a rheumatoid arthritis patient-instructor-based formation-assessment programme for its ability to improve and assess musculoskeletal knowledge and skills in third-year medical students.

METHODS

(1) The quality of our musculoskeletal teaching was assessed before patient-instructor intervention through an open-questions test (pre-test) and performance record forms (PRFs) filled in by the patient-instructors. (2) The improvement afforded by patient-instructors was evaluated through a second (identical) open-questions test (post-test). (3) The resulting skills in the students were further assessed by an individual patient-instructors physical status record form (PSRF), filled in by the students.

RESULTS

Pre-tests and post-tests showed an improvement in correct answers from a mean score of 39% to 47%. The history-taking questions that obtained <50% scores in the pre-test mostly dealt with the consequences of a chronic illness. Intervention of patient-instructors especially improved knowledge of the psychosocial aspects and side effects of drugs. With regard to physical examination, patient-instructors makedly improved the identification of assessment of signs of active and chronic inflammation. PRF analysis showed that 10 of 28 questions answered by <50% of the students were related to disease characteristics of rheumatoid arthritis, extra-articular signs, side effects of drugs and psychosocial aspects. Analysis of the PSRF indicated that the weakness of our students' physical examination abilities in particular is related to recognising the types of swelling and differentiating tenderness from pain on motion.

CONCLUSION

This study proves the considerable benefits of the involvement of patient-instructors in the teaching and assessment of clinical skills in students.

Effects of D-002, a product isolated from beeswax, on gastric symptoms of patients with osteoarthritis treated with piroxicam: a pilot study

Non-steroidal anti-inflammatory drugs (NSAIDs) are indicated for treatment of rheumatoid arthritis and osteoarthritis, but often induce gastric adverse experiences (AE), including gastric ulcers and complications. Inhibitors of proton pump and H(2) antagonists are very effective for duodenal ulcer; meanwhile, cytoprotective drugs are more effective for gastric ulcer. D-002 is a mixture of higher aliphatic alcohols obtained from beeswax, wherein triacontanol is the most abundant. D-002 induces anti-ulcer effects through a cytoprotective mechanism, being more effective in protecting against ethanol- and NSAID-induced ulcers. The present double-blind, placebo-controlled clinical study was undertaken to investigate the effects of D-002 on gastric symptoms associated to piroxicam use on patients suffering osteoarthritis. Fifty-nine patients, all taking piroxicam, 20 mg/day, were randomized to placebo or D-002 (40 or 100 mg/day) for 14 days. The primary efficacy variable was the reduction on the frequency of patients with gastric AE compared with placebo. Pain evolution was investigated to discard any influence on D-002 on the analgesic effect of piroxicam. The frequency of patients treated with D-002, 40 and 100 mg/day, reporting acidity [0 of 18 (0%) and 1 of 21 (4.8%), respectively] was lower (P < .05) than in placebo [6 of 20 (30%)]. Also, the frequency of patients treated with 100 mg/day reporting some gastric AE [5 of 21 (23.8%)] was lower (P < .05) than in placebo [13 of 20 (65.0%)]. The analgesic effect of piroxicam was unaffected with D-002. Treatment was well tolerated. Two patients discontinued from the study because of gastrointestinal AE: one in the placebo group and the other treated with D-002, 40 mg/day. Other three patients discontinued because of other AE: mildly uncontrolled hypertension (one in the placebo group, one treated with D-002, 40 mg/day) and headache (one treated with D-200, 100 mg/day). It is concluded that D-002 could be useful for controlling gastric AE of patients treated with NSAIDs, although further studies with a larger sample size and longer follow-up are needed for definitive conclusions.

Evaluation of a problem-based learning workshop using pre- and post-test objective structured clinical examinations and standardized patients

BACKGROUND

Osteoporosis is a health care issue in which family physicians play a major role. Although awareness of osteoporosis is high, recent studies suggest that application of recent advances in its treatment to the clinical setting may be low. We have developed a problem-based learning intervention for osteoporosis in which paired rheumatologists and family physicians developed nine problem-solving clinical scenarios. An educational matrix was used to link specific case scenarios with individual teaching objectives, developed via a previous needs assessment. Family physicians participated in the workshop, developing best practice responses to the clinical scenarios with a trained facilitator and content expert.

METHODS

To assess the impact of this intervention, family physicians participated in a pre- and post-test evaluation, using objective structured clinical examinations and standardized patients. Objective structured clinical examination stations tested knowledge, skills, and judgment relating to osteoporosis with respect to risk factors, use of appropriate investigations including bone mineral densitometry (BMD), strategies for the prevention of osteoporosis (both pharmacologic and nonpharmacologic), treatment options for established osteoporosis (bisphosphonates and hormone replacement therapy), and management of recent osteoporosis fracture. Participants were evaluated using a predetermined score generated by their responses to objective structured clinical examinations and standardized patients (max. score = 101). Evaluations were conducted anonymously, although participants had access to their own pre- and post-test results for personal feedback. The impact of the workshop was assessed by comparing pre- and post-test responses by group, by individual, and by station.

RESULTS

Participants demonstrated a significant improvement in their post-workshop scores. Of 40 participants, 26 showed improvement in score (> +10), 13 showed modest change (+1 to +10), and 1 showed a marked decrease (> -10). The greatest improvements were seen in the management of the male osteoporosis patient, determination of risk factors for osteoporosis, and the use and interpretation of bone mineral densitometry. Family physicians reported general satisfaction with the content and format of both the workshop and the evaluation process.

IMPLICATIONS

We conclude that this type of problem-based learning intervention workshop results in improved knowledge, skills, and judgment in the management of osteoporosis by family physicians as objectively assessed using a pre- and post-test format including objective structured clinical examinations and standardized patients.

Specialist management: needs and benefits

In increasingly cost-conscious, accountable and integrated health-care systems, the appropriate role of speciality care is under scrutiny. The data on the impact of rheumatologist care on outcomes in patients with rheumatoid arthritis (RA) is limited and inconclusive. However, based on a review of processes of care known to be related to superior patient outcomes it is suggested that rheumatologists should be the lead physicians in patients with RA. Rheumatologists but usually not generalists have the experience necessary to make an early diagnosis and to initiate appropriate disease modifying anti-rheumatic drug (DMARD) treatment. Rheumatologists have an in-depth understanding of new assessment methods to optimize medical treatment and to make best use of and co-ordinate multi-disciplinary care. To avoid delay of diagnosis and initiation of treatment, patients with polyarthritis should be referred to rheumatologists as soon as possible. This requires that access to rheumatologist care is guaranteed.

Can a specialty society educate its members to think differently about clinical decisions? Results of a randomized trial

OBJECTIVE

Measure the effect of specialty society-developed continuing medical education (CME) on clinical decision making.

DESIGN

Randomized controlled trial.

SETTING

National sample of neurologists.

PARTICIPANTS

Of 492 neurologists randomly selected from an ongoing American Academy of Neurology CME program, 248 were randomized to receive a mailed CME course, and 244 did not receive it.

INTERVENTION

A mailed educational course on movement disorders, developed by the specialty society, containing information on diseases and practice recommendations with illustrative case presentations.

MEASUREMENTS AND MAIN RESULTS

We assessed adherence to 16 practice recommendations on disease detection, diagnostic test use, and treatments by mailed survey sent to all subjects 4.5 months after the intervention group received the course (73% response rate). The survey contained detailed clinical scenarios to measure self-reported clinical decision making and short open-ended questions to measure factual knowledge. More intervention participants (up to 2.6 times more) than control subjects reported clinical decision making adherent to 9 of the 16 recommendations (p < .05). For 4 of the other 7 recommendations, adherence exceeded 85% in both groups. Within the intervention group, neurologists who read the educational course were 2 to 6 times more likely to be adherent than neurologists who did not. The intervention group had better factual knowledge than control subjects in six of seven areas (p < .01).

CONCLUSIONS

This educational course improved neurologists' reported decision making. Specialty society-developed CME that utilizes a similar format may enhance the effectiveness of mailed CME information to improve physicians' approach to clinical decisions.