Quality assessment of health counseling: performance of health advisors in cardiovascular prevention

Development of fidelity of delivery and enactment measures for interventions in communication disorders

OBJECTIVES

This study was part of a process evaluation for a single-blind, randomized controlled pilot study comparing Better Conversations with Primary Progressive Aphasia (BCPPA), an approach to communication partner training, with no speech and language therapy treatment. It was necessary to explore fidelity of delivery (delivery of intervention components) and intervention enactment (participants' use of intervention skills in the form of conversation behaviours comprising facilitators, that enhance the conversational flow, and barriers, that impeded the flow of conversation). This study aimed to: (1) Outline an adapted methodological process that uses video observation, to measure both fidelity of delivery and enactment. (2) Measure the extent to which the BCPPA pilot study was delivered as planned, and enacted.

DESIGN

Observational methods were used alongside statistical analysis to explore the fidelity of intervention and enactment using video recordings obtained from the BCPPA pilot study.

METHODS

A 5-step methodology, was developed to measure fidelity of delivery and enactment for the BCPPA study using video-recorded data. To identify delivery of intervention components, a random sample of eight video recorded and transcribed BCPPA intervention sessions was coded. To examine the enactment of conversation behaviours, 108 transcribed 10 -min-video recorded conversations were coded from 18 participants across the control and intervention group.

RESULTS

Checklists and guidelines for measurement of fidelity of treatment delivery and coding spreadsheets and guidelines for measurement of enactment are presented. Local collaborators demonstrated 87.2% fidelity to the BCPPA protocol. Participants in the BCPPA treatment group increased their use of facilitator behaviours enacted in conversation from a mean of 13.5 pre-intervention to 14.2 post-intervention, whilst control group facilitators decreased from a mean of 15.5 to 14.4, over the same timescale.

CONCLUSIONS

This study proposes a novel and robust methods, using video recorded intervention sessions and conversation samples, to measure both fidelity of intervention delivery and enactment. The learnings from this intervention are transferable to other communication interventions.

Developing an implementation fidelity checklist for a vocational rehabilitation intervention

BACKGROUND

Despite growing numbers of studies reporting the efficacy of complex interventions and their implementation, many studies fail to report information on implementation fidelity or describe how fidelity measures used within the study were developed. This study aimed to develop a fidelity checklist for measuring the implementation fidelity of an early, stroke-specialist vocational rehabilitation intervention (ESSVR) in the RETAKE trial.

METHODS

To develop the fidelity measure, previous checklists were reviewed to inform the assessment structure, and core intervention components were extracted from intervention descriptions into a checklist, which was ratified by eight experts in fidelity measurement and complex interventions. Guidance notes were generated to assist with checklist completion. To test the measure, two researchers independently applied the checklist to fifteen stroke survivor intervention case notes using retrospective observational case review. The scoring was assessed for interrater reliability.

RESULTS

A fidelity checklist containing 21 core components and 6 desirable components across 4 stages of intervention delivery was developed with corresponding guidance notes. Interrater reliability of each checklist item ranged from moderate to perfect (Cohen's kappa 0.69-1).

CONCLUSIONS

The resulting checklist to assess implementation fidelity is fit for assessing the delivery of vocational rehabilitation for stroke survivors using retrospective observational case review. The checklist proved its utility as a measure of fidelity and may be used to inform the design of future implementation strategies.

TRIAL REGISTRATION

ISRCTN, ISRCTN12464275. Registered on 13 March 2018.

Fitness facility staff demonstrate high fidelity when implementing an evidence-based diabetes prevention program

Translating evidence-based diabetes prevention programs into the community is needed to make promising interventions accessible to individuals at-risk of type 2 diabetes. To increase the likelihood of successful translation, implementation evaluations should be conducted to understand program outcomes and provide feedback for future scale-up sites. The purpose of this research was to examine the delivery of, and engagement with, an evidence-based diet and exercise diabetes prevention program when delivered by fitness facility staff within a community organization. Ten staff from a community organization were trained to deliver the diabetes prevention program. Between August 2019-March 2020, 26 clients enrolled in the program and were assigned to one of the ten staff. Three fidelity components were accessed. First, staff completed session-specific fidelity checklists (n = 156). Second, two audio-recorded counseling sessions from all clients underwent an independent coder fidelity check (n = 49). Third, staff recorded client goals on session-specific fidelity checklists and all goals were independently assessed for (a) staff goal-setting fidelity, (b) client intervention receipt, and (c) client goal enactment by two coders (n = 285). Average self-reported fidelity was 90% for all six sessions. Independent coder scores for both counseling sessions were 83% and 81%. Overall staff helped clients create goals in line with program content and had a goal achievement of 78%. The program was implemented with high fidelity by staff at a community organization and clients engaged with the program. Findings increase confidence that program effects are due to the intervention itself and provide feedback to refine implementation strategies to support future scale-up efforts.

Management of abnormal invasive placenta in a low- and medium-resource setting

The purpose of this review is to describe the panorama of placenta accreta spectrum (PAS) disorder management in low- and middle-income countries, providing information that allows for the improvement of maternal and perinatal outcomes in the management of this pathology. This spectrum of disorders is associated with implications of high morbidity and mortality, both maternal and perinatal, which is why clinical practice guidelines based on management are produced in settings where there is a wide range of available resources. This situation often contrasts with what the reality is in low-resource countries. Prenatal diagnosis of placental accreta is essential to carry out adequate surgical planning in centres where multidisciplinary teams are in place, which improve results and reduce complications. These ideal scenarios should be developed in countries with more significant difficulties in the availability of human and technological resources, through teamwork in the different hospital centres and the adequate transfer of patients at higher risk to centres with the best interdisciplinary management skills.

Developing quality fidelity and engagement measures for complex health interventions

OBJECTIVES

To understand whether interventions are effective, we need to know whether the interventions are delivered as planned (with fidelity) and engaged with. To measure fidelity and engagement effectively, high-quality measures are needed. We outline a five-step method which can be used to develop quality measures of fidelity and engagement for complex health interventions. We provide examples from a fidelity study conducted within an evaluation of an intervention aimed to increase independence in dementia.

METHODS

We propose five steps that can be systematically used to develop fidelity checklists for researchers, providers, and participants to measure fidelity and engagement. These steps include the following: (1) reviewing previous measures, (2) analysing intervention components and developing a framework outlining the content of the intervention, (3) developing fidelity checklists and coding guidelines, (4) obtaining feedback about the content and wording of checklists and guidelines, and (5) piloting and refining checklists and coding guidelines to assess and improve reliability.

RESULTS

Three fidelity checklists that can be used reliably were developed to measure fidelity of and engagement with, the Promoting Independence in Dementia (PRIDE) intervention. As these measures were designed to be used by researchers, providers, and participants, we developed two versions of the checklists: one for participants and one for researchers and providers.

CONCLUSIONS

The five steps that we propose can be used to develop psychometrically robust and implementable measures of fidelity and engagement for complex health interventions that can be used by different target audiences. By considering quality when developing measures, we can be more confident in the interpretation of intervention outcomes drawn from fidelity and engagement studies. Statement of contribution What is already known on the subject? Fidelity and engagement can be measured using a range of methods, such as observation and self-report. Studies seldom report psychometric and implementation qualities of fidelity measures. What does this study add? A method for developing fidelity and engagement measures for complex health interventions. Guidance on how to consider quality when developing fidelity and engagement measures.

Measuring fidelity of delivery of the Community Occupational Therapy in Dementia-UK intervention

Background

Interpreting data about intervention effectiveness requires an understanding of which intervention components were delivered and whether they were delivered as planned (fidelity of delivery). These studies aimed to develop a reliable measure for assessing fidelity of delivery of the Community Occupational Therapy in Dementia-UK intervention (COTiD-UK) (Study 1) and measure fidelity of delivery of COTiD-UK across sessions, sites and occupational therapists (Study 2).

Methods

The studies used a longitudinal observational design nested within a multi-site randomised controlled trial. Where practicable, all intervention sessions were audio-recorded. Fidelity checklists and coding guidelines were developed, piloted and refined until good agreement was achieved between two coders. Ten percent of sessions were purposively sampled from 12 sites and 31 occupational therapists. Transcripts were coded using checklists developed in Study 1; 10% of sets of intervention session transcripts were double coded to ensure that agreement was maintained. Percentages of components that were delivered were calculated for each session, site and occupational therapist.

Results

A reliable measure of fidelity of delivery for COTiD-UK was developed after several rounds of piloting and amendments. COTiD-UK was delivered with moderate fidelity across all six sessions (range: 52.4–75.5%). The mean range of fidelity varied across sites (26.7–91.2%) and occupational therapists (26.7–94.1%).

Conclusions

A reliable, systematic method for measuring fidelity of delivery of COTiD-UK was developed and applied, and can be adapted for use in similar interventions. As COTiD-UK was delivered with moderate fidelity, there is a reasonable degree of confidence that intervention effects were attributable to COTiD-UK.

Primary care management of cardiovascular risk for people with severe mental illnesses: the Primrose research programme including cluster RCT

Background

Effective interventions are needed to prevent cardiovascular disease (CVD) in people with severe mental illnesses (SMI) because their risk of CVD is higher than that of the general population.

Objectives

(1) Develop and validate risk models for predicting CVD events in people with SMI and evaluate their cost-effectiveness, (2) develop an intervention to reduce levels of cholesterol and CVD risk in SMI and (3) test the clinical effectiveness and cost-effectiveness of this new intervention in primary care.

Design

Mixed methods with patient and public involvement throughout. The mixed methods were (1) a prospective cohort and risk score validation study and cost-effectiveness modelling, (2) development work (focus groups, updated systematic review of interventions, primary care database studies investigating statin prescribing and effectiveness) and (3) cluster randomised controlled trial (RCT) assessing the clinical effectiveness and cost-effectiveness of a new practitioner-led intervention, and fidelity assessment of audio-recorded appointments.

Setting

General practices across England.

Participants

All studies included adults with SMI (schizophrenia, bipolar disorder or other non-organic psychosis). The RCT included adults with SMI and two or more CVD risk factors.

Interventions

The intervention consisted of 8–12 appointments with a practice nurse/health-care assistant over 6 months, involving collaborative behavioural approaches to CVD risk factors. The intervention was compared with routine practice with a general practitioner (GP).

Main outcome measures

The primary outcome for the risk score work was CVD events, in the cost-effectiveness modelling it was quality-adjusted life-years (QALYs) and in the RCT it was level of total cholesterol.

Data sources

Databases studies used The Health Improvement Network (THIN). Intervention development work included focus groups and systematic reviews. The RCT collected patient self-reported and routine NHS GP data. Intervention appointments were audio-recorded.

Results

Two CVD risk score models were developed and validated in 38,824 people with SMI in THIN: the Primrose lipid model requiring cholesterol levels, and the Primrose body mass index (BMI) model with no blood test. These models performed better than published Cox Framingham models. In health economic modelling, the Primrose BMI model was most cost-effective when used as an algorithm to drive statin prescriptions. Focus groups identified barriers to, and facilitators of, reducing CVD risk in SMI including patient engagement and motivation, staff confidence, involving supportive others, goal-setting and continuity of care. Findings were synthesised with evidence from updated systematic reviews to create the Primrose intervention and training programme. THIN cohort studies in 16,854 people with SMI demonstrated that statins effectively reduced levels of cholesterol, with similar effect sizes to those in general population studies over 12–24 months (mean decrease 1.2 mmol/l). Cluster RCT: 76 GP practices were randomised to the Primrose intervention (n = 38) or treatment as usual (TAU) (n = 38). The primary outcome (level of cholesterol) was analysed for 137 out of 155 participants in Primrose and 152 out of 172 in TAU. There was no difference in levels of cholesterol at 12 months [5.4 mmol/l Primrose vs. 5.5 mmol/l TAU; coefficient 0.03; 95% confidence interval (CI) –0.22 to 0.29], nor in secondary outcomes related to cardiometabolic parameters, well-being or medication adherence. Mean cholesterol levels decreased over 12 months in both arms (–0.22 mmol/l Primrose vs. –0.39 mmol/l TAU). There was a significant reduction in the cost of inpatient mental health attendances (–£799, 95% CI –£1480 to –£117) and total health-care costs (–£895, 95% CI –£1631 to –£160; p = 0.012) in the intervention group, but no significant difference in QALYs (–0.011, 95% CI –0.034 to 0.011). A total of 69% of patients attended two or more Primrose appointments. Audiotapes revealed moderate fidelity to intervention delivery (67.7%). Statin prescribing and adherence was rarely addressed.

Limitations

RCT participants and practices may not represent all UK practices. CVD care in the TAU arm may have been enhanced by trial procedures involving CVD risk screening and feedback.

Conclusions

SMI-specific CVD risk scores better predict new CVD if used to guide statin prescribing in SMI. Statins are effective in reducing levels of cholesterol in people with SMI in UK clinical practice. This primary care RCT evaluated an evidence-based practitioner-led intervention that was well attended by patients and intervention components were delivered. No superiority was shown for the new intervention over TAU for level of cholesterol, but cholesterol levels decreased over 12 months in both arms and the intervention showed fewer inpatient admissions. There was no difference in cholesterol levels between the intervention and TAU arms, which might reflect better than standard general practice care in TAU, heterogeneity in intervention delivery or suboptimal emphasis on statins.

Future work

The new risk score should be updated, deployed and tested in different settings and compared with the latest versions of CVD risk scores in different countries. Future research on CVD risk interventions should emphasise statin prescriptions more. The mechanism behind lower costs with the Primrose intervention needs exploring, including SMI-related training and offering frequent support to people with SMI in primary care.

Trial registration

Current Controlled Trials ISRCTN13762819.

Funding

This project was funded by the National Institute for Health Research (NIHR) Programme Grants for Applied Research programme and will be published in full in Programme Grants for Applied Research; Vol. 7, No. 2. See the NIHR Journals Library website for further project information. Professor David Osborn is supported by the University College London Hospital NIHR Biomedical Research Centre and he was also in part supported by the NIHR Collaboration for Leadership in Applied Health Research and Care (CLAHRC) North Thames at Barts Health NHS Trust.

Measures of fidelity of delivery of, and engagement with, complex, face-to-face health behaviour change interventions: A systematic review of measure quality

PURPOSE

Understanding the effectiveness of complex, face-to-face health behaviour change interventions requires high-quality measures to assess fidelity of delivery and engagement. This systematic review aimed to (1) identify the types of measures used to monitor fidelity of delivery of, and engagement with, complex, face-to-face health behaviour change interventions and (2) describe the reporting of psychometric and implementation qualities.

METHODS

Electronic databases were searched, systematic reviews and reference lists were hand-searched, and 21 experts were contacted to identify articles. Studies that quantitatively measured fidelity of delivery of, and/or engagement with, a complex, face-to-face health behaviour change intervention for adults were included. Data on interventions, measures, and psychometric and implementation qualities were extracted and synthesized using narrative analysis.

RESULTS

Sixty-six studies were included: 24 measured both fidelity of delivery and engagement, 20 measured fidelity of delivery, and 22 measured engagement. Measures of fidelity of delivery included observation (n = 17; 38.6%), self-report (n = 15; 34%), quantitatively rated qualitative interviews (n = 1; 2.3%), or multiple measures (n = 11; 25%). Measures of engagement included self-report (n = 18; 39.1%), intervention records (n = 11; 24%), or multiple measures (n = 17; 37%). Fifty-one studies (77%) reported at least one psychometric or implementation quality; 49 studies (74.2%) reported at least one psychometric quality, and 17 studies (25.8%) reported at least one implementation quality.

CONCLUSION

Fewer than half of the reviewed studies measured both fidelity of delivery of, and engagement with complex, face-to-face health behaviour change interventions. More studies reported psychometric qualities than implementation qualities. Interpretation of intervention outcomes from fidelity of delivery and engagement measurements may be limited due to a lack of reporting of psychometric and implementation qualities. Statement of contribution What is already known on this subject? Evidence of fidelity and engagement is needed to understand effectiveness of complex interventions Evidence of fidelity and engagement are rarely reported High-quality measures are needed to measure fidelity and engagement What does this study add? Evidence that indicators of quality of measures are reported in some studies Evidence that psychometric qualities are reported more frequently than implementation qualities A recommendation for intervention evaluations to report indicators of quality of fidelity and engagement measures.

Feasibility and acceptability of a telephone- and face-to-face-delivered counseling intervention for smoking cessation in Dutch patients with coronary heart disease

Intensive behavioral counseling interventions combined with nicotine replacement therapy have increased smoking abstinence rates in cardiac patients, but little is known about their feasibility when initiated upon hospital admission and continued post-discharge. The current study was an evaluation of the use, appreciation, and fidelity of two post-discharge counseling interventions designed for cardiac patients to quit smoking that differed in their delivery mode. In a controlled trial with cross-over randomization at the cardiac unit level, hospitalized smokers in eight cardiac units of eight Dutch hospitals were assigned either telephone counseling (n = 223) or nurse-administered face-to-face counseling (n = 157) using the Ask-Advise-Refer strategy. Eligible patients also received nicotine replacement therapy. Data based on counselors' registration forms and patients' telephone surveys at 6-month follow-up were analyzed. Most patients (>90%) participated in at least one counseling session, and the majority participated in at least five out of a maximum of seven sessions. Higher levels of adherence to either the telephone or face-to-face counseling sessions were associated with higher smoking abstinence rates at the 6-month follow-up, whereas higher nicotine patch use was not associated with abstinence. Patients positively evaluated the content, duration, and number of sessions, and rated the face-to-face counseling significantly better than the telephone counseling for quitting smoking. The counselors largely complied with the intervention protocols. The current intervention offers evidence of feasibility and may improve outpatient continuity of smoking care. Monitoring the use and delivery of such complex interventions is recommended to promote effective dissemination in cardiac practice.

Effects of health counseling on behavioural risk factors in a high-risk cardiology outpatient population: a randomized clinical trial

BACKGROUND

An evaluation study of an individual lifestyle advice intervention to reduce cardiovascular risk behaviours (high fat consumption, smoking, physical inactivity).

METHODS

A randomized, controlled trial at the cardiology outpatient clinic of the University Hospital Maastricht. Participants were at high risk of incurring a cardiovascular event. Changes in risk behaviours and behavioural determinants were assessed with self-administered validated questionnaires.

RESULTS

Questionnaires were completed by 1270 patients at baseline, 1169 after 4 months (92%), and 1032 after 18 months (81.3%). After 4 months, intention-to-treat analyses revealed a decrease in fat consumption (-5.6%, P = 0.000), a reduction in the percentage of smokers [odds ratio (OR) 0.57, 95% confidence intervals (CI) 0.33-0.97] and a trend towards a maintained physical activity level (OR 1.28, 95% CI 0.97-1.70). No long-term effects were found.

CONCLUSION

The lifestyle advice intervention was potentially effective in changing cardiovascular risk behaviours, but should be further improved to be effective in secondary cardiovascular prevention. The main limitations of the study were related to the randomization procedure and the self-selection of patients and cardiologists.

Making the connection-factors influencing implementation of evidence supported and non-evaluated lifestyle interventions in healthcare: a multiple case study

Many implementation barriers relate to lifestyle interventions (LIs) being developed by scientists. Exploring whether implementation of non-evaluated LIs is less complicated, might offer insight how to improve the use of effective interventions. This study aimed to identify influencing factors for implementation and compare factors between evidence supported and non-evaluated LIs. Evidence-supported (n = 7) and non-evaluated LIs (n = 7) in hospitals, general practices and community care organizations were included as cases. Semi-structured interviews (n = 46) were conducted. Additionally, documents (n = 207) were collected describing intervention, implementation process, and policy. We used a stepwise approach to inductively identify factors, organize them by diffusion phase, and an existing framework. A total of 37 factors were identified. 'Dissemination' factors were mainly observed in evidence-supported LIs. 'Compatibility to existing structures' ('adoption'), 'funding' and 'connection to existing care processes' ('implementation') was factors identified in all cases. 'Quality control' and 'ongoing innovation' ('maintenance') were reported in evidence-supported interventions. In all domains of the framework factors were observed. Factors identified in this study are in line with the literature. The findings do not support the assumption that implementation of non-evaluated LIs is perceived as less complex.

Evaluating health worker performance in Benin using the simulated client method with real children

BACKGROUND

The simulated client (SC) method for evaluating health worker performance utilizes surveyors who pose as patients to make surreptitious observations during consultations. Compared to conspicuous observation (CO) by surveyors, which is commonly done in developing countries, SC data better reflect usual health worker practices. This information is important because CO can cause performance to be better than usual. Despite this advantage of SCs, the method's full potential has not been realized for evaluating performance for pediatric illnesses because real children have not been utilized as SCs. Previous SC studies used scenarios of ill children that were not actually brought to health workers. During a trial that evaluated a quality improvement intervention in Benin (the Integrated Management of Childhood Illness [IMCI] strategy), we conducted an SC survey with adult caretakers as surveyors and real children to evaluate the feasibility of this approach and used the results to assess the validity of CO.

METHODS

We conducted an SC survey and a CO survey (one right after the other) of health workers in the same 55 health facilities. A detailed description of the SC survey process was produced. Results of the two surveys were compared for 27 performance indicators using logistic regression modeling.

RESULTS

SC and CO surveyors observed 54 and 185 consultations, respectively. No serious problems occurred during the SC survey. Performance levels measured by CO were moderately higher than those measured by SCs (median CO - SC difference = 16.4 percentage-points). Survey differences were sometimes much greater for IMCI-trained health workers (median difference = 29.7 percentage-points) than for workers without IMCI training (median difference = 3.1 percentage-points).

CONCLUSION

SC surveys can be done safely with real children if appropriate precautions are taken. CO can introduce moderately large positive biases, and these biases might be greater for health workers exposed to quality improvement interventions.

TRIAL NUMBER

http://clinicaltrials.gov Identifier NCT00510679.

Effects of a brief cardiovascular prevention program by a health advisor in primary care; the 'Hartslag Limburg' project, a cluster randomized trial

OBJECTIVE

To determine in primary care patients at high risk for a cardiovascular event, the effects on biomedical risk factors for and incidence of cardiovascular events, of a brief cardiovascular prevention program executed by a health advisor.

DESIGN

cluster randomized controlled trial with 1275 patients (24 general practices) in and around Maastricht, the Netherlands (1999-2004).

INTERVENTION

health advisors were to complete computerized cardiovascular risk profiles, provide multi-factorial tailored health education and advice, and communicate with GP's to optimize treatment.

OUTCOME

differences in changes in risk factors between baseline and follow up at 6, 18, and 36 months and incidence of cardiovascular events at 36 months.

PROCESS

Because of logistic reasons risk profiles were put on paper instead of in the computerized patient files. On average patients attended 2.3 counseling sessions. Interaction with GPs was less productive than expected.

OUTCOME

Effect after six months on BMI (-0.20 kg/m(2) (95% CI -0.38 to -0.01, p=0.039), Cohen's d: -0.18), and after 18 months on HDL-cholesterol (+0.05 mmol/l (95% CI +0.01 to +0.09, p=0.014), Cohen's d: 0.14). No other (subgroup) effects were found.

CONCLUSION

Given the lack of clinically meaningful effects, implementation of this intervention in its present form is not justified.

Antenatal counseling in maternal and newborn care: use of job aids to improve health worker performance and maternal understanding in Benin

Background

Antenatal care provides an important opportunity to improve maternal understanding of care during and after pregnancy. Yet, studies suggest that communication is often insufficient. This research examined the effect of a job aids-focused intervention on quality of counseling and maternal understanding of care for mothers and newborns.

Methods

Counseling job aids were developed to support provider communication to pregnant women. Fourteen health facilities were randomized to control or intervention, where providers were trained to use job aids and provided implementation support. Direct observation of antenatal counseling sessions and patient exit interviews were undertaken to assess quality of counseling and maternal knowledge. Providers were also interviewed regarding their perceptions of the tools. Data were collected before and after the job aids intervention and analyzed using a difference-in-differences analysis to quantify relative changes over time.

Results

Mean percent of recommended messages provided to pregnant women significantly improved in the intervention arm as compared to the control arm in birth preparedness (difference-in-differences [Δ_I-C] = +17.9, 95%CI: 6.7,29.1), danger sign recognition (Δ_I-C = +26.0, 95%CI: 14.6,37.4), clean delivery (Δ_I-C = +21.7, 95%CI: 10.9,32.6), and newborn care (Δ_I-C = +26.2, 95%CI: 13.5,38.9). Significant gains were also observed in the mean percent of communication techniques applied (Δ_I-C = +28.8, 95%CI: 22.5,35.2) and duration (minutes) of antenatal consultations (Δ_I-C = +5.9, 95%CI: 3.0,8.8). No relative increase was found for messages relating to general prenatal care (Δ_I-C = +8.2, 95%CI: -2.6,19.1). The proportion of pregnant women with correct knowledge also significantly improved for birth preparedness (Δ_I-C = +23.6, 95%CI: 9.8,37.4), danger sign recognition (Δ_I-C = +28.7, 95%CI: 14.2,43.2), and clean delivery (Δ_I-C = +31.1, 95%CI: 19.4,42.9). There were no significant changes in maternal knowledge of general prenatal (Δ_I-C = -6.4, 95%CI: -21.3,8.5) or newborn care (Δ_I-C = +12.7, 95%CI: -6.1,31.5). Job aids were positively perceived by providers and pregnant women, although time constraints remained for health workers with other clinical responsibilities.

Conclusions

This study demonstrates that a job aids-focused intervention can be integrated into routine antenatal care with positive outcomes on provider communication and maternal knowledge. Efforts are needed to address time constraints and other communication barriers, including introduction of on-going quality assessment for long-term sustainability.

Cardiovascular prevention in the Hartslag Limburg project: effects of a high-risk approach on behavioral risk factors in a general practice population

BACKGROUND

This study describes a general-practice-based high-risk cardiovascular prevention approach in Maastricht, The Netherlands (1999-2003). The intervention consisted of a complete registration of risk factors, optimization of medical treatment and health counseling on high fat consumption, smoking and physical inactivity.

METHODS

Behavioral effects were assessed in a trial, randomization by practice and usual care as control. Validated questionnaires were completed by 1300 patients at baseline, 1174 after 4 months (90.3%) and 1046 (80.5%) after 18 months.

RESULTS

After 4 months, intention-to-treat analyses revealed a decrease in saturated fat intake of 1.3 points (scale ranging from 7 to 30 points, p=0.000). This was partly sustained after 18 months (-0.5 points, p=0.014). After 18 months, obese intervention patients were more likely to be sufficiently physically active than their control counterparts (OR=1.90, p=0.023). No intervention effects were found for smoking.

CONCLUSION

Given the multiple factor and multiple component high-risk approach, the intervention had modest effects on only some of the behavioral risk factors addressed. Process data showed that the registration of risk factors and the optimization of medical treatment were only partly implemented, that the health counseling component could be further improved and that the intervention could benefit from additional health promoting strategies.

Patients' opinions on health counseling in the Hartslag Limburg cardiovascular prevention project: perceived quality, satisfaction, and normative concerns

OBJECTIVE

To assess patients' opinions on a new service in the Dutch health care system, viz., health counseling about behavioral risks and possible lifestyle changes. This was introduced within the framework of the Hartslag Limburg prevention project and was offered to patients at high risk of cardiovascular diseases.

METHODS

A questionnaire survey to measure quality, satisfaction, and normative concerns. Questionnaires were distributed among 1,301 patients after they had completed the counseling and returned by 1,056 of them (response rate 81.2%).

RESULTS

Patients generally reported rather high levels of quality and satisfaction. They regarded the service as a welcome addition to usual care. However, the accompanying effect studies will have to provide more solid evidence for the effectiveness of the counseling.

CONCLUSION

It was concluded that the service was highly acceptable to the patients, but that the health advisors should be careful not to induce less favorable normative concerns.

PRACTICE IMPLICATIONS

A quality and satisfaction survey should consist of well-validated instruments, context-specific items, and qualitative measures as well.