Evaluation of a Web-based intervention providing tailored advice for self-management of minor respiratory symptoms: exploratory randomized controlled trial

Poor respiratory health outcomes associated with high illness worry and alexithymia: Eleven-year prospective cohort study among the working-age population

OBJECTIVE

Poor respiratory health outcomes have been associated with poorer physical health and higher psychological distress. The aim of this study was to investigate whether illness worry, alexithymia or low sense of coherence predict i) the onset of new respiratory disease, ii) respiratory symptoms or iii) lung function among the working-age population, independently of comorbidity mood-, anxiety, or alcohol abuse disorders.

METHODS

The study was conducted among a nationally representative sample of the Finnish population (BRIF8901) aged 30-54 years (N = 2310) in 2000-2001 and was followed up in 2011. Individuals with a diagnosed respiratory disease or a severe psychiatric disorder at baseline were excluded. Lung function was measured by a spirometry test and psychiatric disorders were diagnosed using a structured clinical interview. Structured questionnaires were used to measure self-reported respiratory symptoms and diseases, illness worry, alexithymia, and sense of coherence.

RESULTS

High illness worry predicted an 11-year incidence of asthma (OR 1.47, 95% CI 1.09-1.99, p = 0.01). Alexithymia predicted shortness of breath (OR 1.32, 95% CI 1.13-1.53, p < 0.01) and 11-year incidence of COPD (OR 2.84, 95% CI 1.37-5.88, p < 0.01), even after several adjustments for physical and mental health. Psychological dispositions did not associate with lung function in 2011.

CONCLUSIONS

In the general population, psychological factors that modify health behaviour predicted adverse respiratory health outcomes independently of lung function after 11 years of follow-up. This indicates that considering them part of personalized treatment planning is important for promoting health-related behaviour among the working-age population.

A Digital Intervention for Respiratory Tract Infections (Internet Dr): Process Evaluation to Understand How to Support Self-care for Minor Ailments

Background

Approximately 57 million physician appointments annually in the United Kingdom are for minor ailments. These illnesses could be self-cared for, which would potentially lower patients’ anxiety, increase their confidence, and be more convenient. In a randomized controlled trial of the Internet Dr digital intervention, patients with access to the intervention had fewer consultations for respiratory tract infections (RTIs). Having established intervention efficacy, further examination of trial data is required to understand how the intervention works.

Objective

This paper reports a process evaluation of Internet Dr usage by the intervention group. The evaluation aims to demonstrate how meaningful usage metrics (ie, interactions that are specific and relevant to the intervention) can be derived from the theoretical principles underlying the intervention, then applied to examine whether these interactions are effective in supporting self-care for RTIs, for whom, and at what time.

Methods

The Internet Dr trial recorded patients’ characteristics and usage data over 24 weeks. At follow-up, users reported whether their levels of enablement to cope with their illness changed over the trial period. The Medical Research Council process evaluation guidance and checklists from the framework for Analyzing and Measuring Usage and Engagement Data were applied to structure research questions examining associations between usage and enablement.

Results

Viewing pages containing advice on caring for RTIs were identified as a meaningful metric for measuring intervention usage. Almost half of the users (616/1491, 42.31%) viewed at least one advice page, with most people (478/616, 77.6%) accessing them when they initially enrolled in the study. Users who viewed an advice page reported increased enablement to cope with their illness as a result of having participated in the study compared with users who did not (mean 2.12, SD 2.92 vs mean 1.65, SD 3.10; mean difference 0.469, 95% CI 0.082-0.856). The target population was users who had visited their general practitioners for an RTI in the year before the trial, and analyses revealed that this group was more likely to access advice pages (odds ratio 1.35, 95% CI 1.159-1.571; P<.001).

Conclusions

The process evaluation identifies viewing advice pages as associated with increased enablement to self-care, even when accessed in the absence of a RTI, meaning that dissemination activities need not be restricted to targeting users who are ill. The intervention was effective at reaching the target population of users who had previously consulted their general practitioners. However, attrition before reaching advice pages was high, highlighting the necessity of prioritizing access during the design phase. These findings provide guidance on how the intervention may be improved and disseminated and have wider implications for minor ailment interventions.

Telemedicine for Follow-up Management of Patients After Liver Transplantation: Cohort Study

Background

Technical capabilities for performing liver transplantation have developed rapidly; however, the lack of available livers has prompted the utilization of edge donor grafts, including those donated after circulatory death, older donors, and hepatic steatosis, thereby rendering it difficult to define optimal clinical outcomes.

Objective

We aimed to investigate the efficacy of telemedicine for follow-up management after liver transplantation.

Methods

To determine the efficacy of telemedicine for follow-up after liver transplantation, we performed a clinical observation cohort study to evaluate the rate of recovery, readmission rate within 30 days after discharge, mortality, and morbidity. Patients (n=110) who underwent liver transplantation (with livers from organ donation after citizen's death) were randomly assigned to receive either telemedicine-based follow-up management for 2 weeks in addition to the usual care or usual care follow-up only. Patients in the telemedicine group were given a robot free-of-charge for 2 weeks of follow-up. Using the robot, patients interacted daily, for approximately 20 minutes, with transplant specialists who assessed respiratory rate, electrocardiogram, blood pressure, oxygen saturation, and blood glucose level; asked patients about immunosuppressant medication use, diet, sleep, gastrointestinal function, exercise, and T-tube drainage; and recommended rehabilitation exercises.

Results

No differences were detected between patients in the telemedicine group (n=52) and those in the usual care group (n=50) regarding age (P=.17), the model for end-stage liver disease score (MELD, P=.14), operation time (P=.51), blood loss (P=.07), and transfusion volume (P=.13). The length and expenses of the initial hospitalization (P=.03 and P=.049) were lower in the telemedicine group than they were in the usual care follow-up group. The number of patients with MELD score ≥30 before liver transplantation was greater in the usual care follow-up group than that in the telemedicine group. Furthermore, the readmission rate within 30 days after discharge was markedly lower in the telemedicine group than in the usual care follow-up group (P=.02). The postoperative survival rates at 12 months in the telemedicine group and the usual care follow-up group were 94.2% and 90.0% (P=.65), respectively. Warning signs of complications were detected early and treated in time in the telemedicine group. Furthermore, no significant difference was detected in the long-term visit cumulative survival rate between the two groups (P=.50).

Conclusions

Rapid recovery and markedly lower readmission rates within 30 days after discharge were evident for telemedicine follow-up management of patients post–liver transplantation, which might be due to high-efficiency in perioperative and follow-up management. Moreover, telemedicine follow-up management promotes the self-management and medication adherence, which improves patients’ health-related quality of life and facilitates achieving optimal clinical outcomes in post–liver transplantation.

Peaks in online inquiries into pharyngitis-related symptoms correspond with annual incidence rates

OBJECTIVE

To assess whether web-based public inquiries into pharyngitis-related search terms follow annual incidence peaks of acute pharyngitis in various countries from both hemispheres.

METHODS

Google Trends (GT) was utilized for systematic acquisition of pharyngitis-related search terms (sore throat, cough, fever, cold). Six countries from both hemispheres including four English (United Kingdom, United States, Canada, and Australia) and two non-English speaking countries (Austria and Germany) were selected for further analysis. Time series data on relative search interest for pharyngitis-related search terms, covering a timeframe between 2004 and 2019 were extracted. Following reliability analysis using the intra-class correlation coefficient, the cosinor time series analysis was utilized to determine annual peaks in public-inquiries.

RESULTS

The extracted datasets of GT proved to be highly reliable with correlation coefficients ranging from 0.83 to 1.0. Graphical visualization showed annual seasonal peaks for pharyngitis-related search terms in all included countries. The cosinor time series analysis revealed these peaks to be statistically significant during winter months (all p < 0.001).

CONCLUSION

Our study revealed seasonal variations for pharyngitis-related terms which corresponded to winter incidence peaks of acute pharyngitis. These results highlight the need for easily accessible information on diagnosis, therapy, and red-flag symptoms for this common disease. Accurately informed patients might contribute to a reduction of unnecessary clinic visits and potentially cutback the futile antibiotic overuse.

Digital and online symptom checkers and health assessment/triage services for urgent health problems: systematic review

OBJECTIVES

In England, the NHS111 service provides assessment and triage by telephone for urgent health problems. A digital version of this service has recently been introduced. We aimed to systematically review the evidence on digital and online symptom checkers and similar services.

DESIGN

Systematic review.

DATA SOURCES

We searched Medline, Embase, the Cochrane Library, Cumulative Index to Nursing and Allied Health Literature (CINAHL), Health Management Information Consortium, Web of Science and ACM Digital Library up to April 2018, supplemented by phrase searches for known symptom checkers and citation searching of key studies.

ELIGIBILITY CRITERIA

Studies of any design that evaluated a digital or online symptom checker or health assessment service for people seeking advice about an urgent health problem.

DATA EXTRACTION AND SYNTHESIS

Data extraction and quality assessment (using the Cochrane Collaboration version of QUADAS for diagnostic accuracy studies and the National Heart, Lung and Blood Institute tool for observational studies) were done by one reviewer with a sample checked for accuracy and consistency. We performed a narrative synthesis of the included studies structured around pre-defined research questions and key outcomes.

RESULTS

We included 29 publications (27 studies). Evidence on patient safety was weak. Diagnostic accuracy varied between different systems but was generally low. Algorithm-based triage tended to be more risk averse than that of health professionals. There was very limited evidence on patients' compliance with online triage advice. Study participants generally expressed high levels of satisfaction, although in mainly uncontrolled studies. Younger and more highly educated people were more likely to use these services.

CONCLUSIONS

The English 'digital 111' service has been implemented against a background of uncertainty around the likely impact on important outcomes. The health system may need to respond to short-term changes and/or shifts in demand. The popularity of online and digital services with younger and more educated people has implications for health equity.

PROSPERO REGISTRATION NUMBER

CRD42018093564.

Digital and online symptom checkers and assessment services for urgent care to inform a new digital platform: a systematic review

Background

Digital and online symptom checkers and assessment services are used by patients seeking guidance about health problems. NHS England is planning to introduce a digital platform (NHS111 Online) to operate alongside the NHS111 urgent-care telephone service. This review focuses on digital and online symptom checkers for urgent health problems.

Objectives

This systematic review was commissioned to provide NHS England with an independent review of previous research in this area to inform strategic decision-making and service design.

Data sources

Focused searches of seven bibliographic databases were performed and supplemented by phrase searching for names of symptom checker systems and citation searches of key included studies. The bibliographic databases searched were MEDLINE, EMBASE, The Cochrane Library, CINAHL (Cumulative Index to Nursing and Allied Health Literature), HMIC (Health Management Information Consortium), Web of Science and the Association of Computing Machinery (ACM) Digital Library, from inception up to April 2018.

Review methods

Brief inclusion criteria were (1) population – general population seeking information online or digitally to address an urgent health problem; (2) intervention – any online or digital service designed to assess symptoms, provide health advice and direct patients to appropriate services; and (3) comparator – telephone or face-to-face assessment, comparative performance in tests or simulations (studies with no comparator were included if they reported relevant outcomes). Outcomes of interest included safety, clinical effectiveness, costs or cost-effectiveness, diagnostic and triage accuracy, use of and contacts with health services, compliance with advice received, patient/carer satisfaction, and equity and inclusion. Inclusion was not restricted by study design. Screening studies for inclusion, data extraction and quality assessment were carried out by one reviewer with a sample checked for accuracy and consistency. Final decisions on study inclusion were taken by consensus of the review team. A narrative synthesis of the included studies was performed and structured around the predefined research questions and key outcomes. The overall strength of evidence for each outcome was classified as ‘stronger’, ‘weaker’, ‘conflicting’ or ‘insufficient’, based on study numbers and design.

Results

In total, 29 publications describing 27 studies were included. Studies were diverse in their design and methodology. The overall strength of the evidence was weak because it was largely based on observational studies and with a substantial component of non-peer-reviewed grey literature. There was little evidence to suggest that symptom checkers are unsafe, but studies evaluating their safety were generally short term and small scale. Diagnostic accuracy was highly variable between different systems but was generally low. Algorithm-based triage tended to be more risk averse than that of health professionals. Inconsistent evidence was found on effects on service use. There was very limited evidence on patients’ reactions to online triage advice. The studies showed that younger and more highly educated people are more likely to use these services. Study participants generally expressed high levels of satisfaction with digital and online triage services, albeit in uncontrolled studies.

Limitations

Findings from symptom checker systems for specific conditions may not be applicable to more general systems and vice versa. Studies of symptom checkers as part of electronic consultation systems in general practice were also included, which is a slightly different setting from a general ‘digital 111’ service. Most studies were screened by one reviewer.

Conclusions

Major uncertainties surround the probable impact of digital 111 services on most outcomes. It will be important to monitor and evaluate the services using all available data sources and by commissioning high-quality research.

Future work

Priorities for research include comparisons of different systems, rigorous economic evaluations and investigations of patient pathways.

Study registration

The study is registered as PROSPERO CRD42018093564.

Funding

The National Institute for Health Research Health Services and Delivery Research programme.

Effectiveness of psychological interventions to improve quality of life in people with long-term conditions: rapid systematic review of randomised controlled trials

Background

Long-term conditions may negatively impact multiple aspects of quality of life including physical functioning and mental wellbeing. The rapid systematic review aimed to examine the effectiveness of psychological interventions to improve quality of life in people with long-term conditions to inform future healthcare provision and research.

Methods

EBSCOhost and OVID were used to search four databases (PsychInfo, PBSC, Medline and Embase). Relevant papers were systematically extracted by one researcher using the predefined inclusion/exclusion criteria based on titles, abstracts, and full texts. Randomized controlled trial psychological interventions conducted between 2006 and February 2016 to directly target and assess people with long-term conditions in order to improve quality of life were included. Interventions without long-term condition populations, psychological intervention and/or patient-assessed quality of life were excluded.

Results

From 2223 citations identified, 6 satisfied the inclusion/exclusion criteria. All 6 studies significantly improved at least one quality of life outcome immediately post-intervention. Significant quality of life improvements were maintained at 12-months follow-up in one out of two studies for each of the short- (0–3 months), medium- (3–12 months), and long-term (≥ 12 months) study duration categories.

Conclusions

All 6 psychological intervention studies significantly improved at least one quality of life outcome immediately post-intervention, with three out of six studies maintaining effects up to 12-months post-intervention. Future studies should seek to assess the efficacy of tailored psychological interventions using different formats, durations and facilitators to supplement healthcare provision and practice.

The role of tele-medicine in patients with respiratory diseases

INTRODUCTION

Tele-medicine is a clinical application connecting a patient with specialized care consultants by means of electronic platforms, potentially able to improve patients' self-management and allow for the care of patients with limited access to health services. This article summarizes the use of tele-medicine as a tool in managing patients suffering from some pathological respiratory conditions. Areas covered: We searched papers published between 1990 and 2017 dealing with tele-medicine and respiratory diseases, chronic obstructive pulmonary disease, asthma, interstitial lung disease, chronic respiratory failure, neuromuscular diseases, critical illness, home mechanical ventilation, and also legal and economic issues. Controlled trials report different results on feasibility, cost-effectiveness, and safety of tele-medicine. Expert commentary: Progress in tele-medicine widens the horizons in respiratory medicine: this tool may potentially reduce health care costs by moving some medical interventions from centralized locations in to patient's home, also allowing for the delivery of care in countries with limited access to it. Legal, safety, and privacy problems, as well as reimbursement issues, must still be defined and solved. At present time, we still need much more evidence to consider this modality as a real option in the management of these patients.

Tele-medicine in respiratory diseases

Information and Communication Technologies applied to health care and advances in sensor and data transmission technology allowed tele-medicine based programs of care also for patients with respiratory diseases.

Different sensors, transmission devices and interventions are used in tele-medicine for some indications. Patients suffering from Chronic Obstructive Pulmonary Disease, asthma, neuromuscular diseases, ventilator assisted individuals and those undergoing pulmonary rehabilitation programs may benefit from this approach.

The legal problems are still unsolved. Economic advantages for health care systems, though potentially high, are still poorly investigated.

Despite the hopes, we need more evidence before this modality can be considered as a real progress in the management of patients with respiratory diseases. On one hand, these technologies can improve the care of patients with difficult access to services, particularly those in rural/remote areas, on the other hand, there is the risk that they will be used only to reduce standard services in health systems of developed countries.

Effects on Engagement and Health Literacy Outcomes of Web-Based Materials Promoting Physical Activity in People With Diabetes: An International Randomized Trial

Background

Developing accessible Web-based materials to support diabetes self-management in people with lower levels of health literacy is a continuing challenge.

Objective

The objective of this international study was to develop a Web-based intervention promoting physical activity among people with type 2 diabetes to determine whether audiovisual presentation and interactivity (quizzes, planners, tailoring) could help to overcome the digital divide by making digital interventions accessible and effective for people with all levels of health literacy. This study also aimed to determine whether these materials can improve health literacy outcomes for people with lower levels of health literacy and also be effective for people with higher levels of health literacy.

Methods

To assess the impact of interactivity and audiovisual features on usage, engagement, and health literacy outcomes, we designed two versions of a Web-based intervention (one interactive and one plain-text version of the same content) to promote physical activity in people with type 2 diabetes. We randomly assigned participants from the United Kingdom, Austria, Germany, Ireland, and Taiwan to either an interactive or plain-text version of the intervention in English, German, or Mandarin. Intervention usage was objectively recorded by the intervention software. Self-report measures were taken at baseline and follow-up (immediately after participants viewed the intervention) and included measures of health literacy, engagement (website satisfaction and willingness to recommend the intervention to others), and health literacy outcomes (diabetes knowledge, enablement, attitude, perceived behavioral control, and intention to undertake physical activity).

Results

In total, 1041 people took part in this study. Of the 1005 who completed health literacy information, 268 (26.67%) had intermediate or low levels of health literacy. The interactive intervention overall did not produce better outcomes than did the plain-text version. Participants in the plain-text intervention group looked at significantly more sections of the intervention (mean difference –0.47, 95% CI –0.64 to –0.30, P<.001), but this did not lead to better outcomes. Health literacy outcomes, including attitudes and intentions to engage in physical activity, significantly improved following the intervention for participants in both intervention groups. These improvements were similar across higher and lower health literacy levels and in all countries. Participants in the interactive intervention group had acquired more diabetes knowledge (mean difference 0.80, 95% CI 0.65-0.94, P<.001). Participants from both groups reported high levels of website satisfaction and would recommend the website to others.

Conclusions

Following established practice for simple, clear design and presentation and using a person-based approach to intervention development, with in-depth iterative feedback from users, may be more important than interactivity and audiovisual presentations when developing accessible digital health interventions to improve health literacy outcomes.

ClinicalTrial

International Standard Randomized Controlled Trial Number (ISRCTN): 43587048; http://www.isrctn.com/ISRCTN43587048. (Archived by WebCite at http://www.webcitation.org/6nGhaP9bv)

Telemedicine in chronic obstructive pulmonary disease

Telemedicine is a medical application of advanced technology to disease management. This modality may provide benefits also to patients with chronic obstructive pulmonary disease (COPD). Different devices and systems are used. The legal problems associated with telemedicine are still controversial. Economic advantages for healthcare systems, though potentially high, are still poorly investigated. A European Respiratory Society Task Force has defined indications, follow-up, equipment, facilities, legal and economic issues of tele-monitoring of COPD patients including those undergoing home mechanical ventilation.

We need much more evidence before telemedicine can be considered as real progress in the management of COPD patientshttp://ow.ly/Rko8305tpnJ

Primary care randomised controlled trial of a tailored interactive website for the self-management of respiratory infections (Internet Doctor)

OBJECTIVE

To assess an internet-delivered intervention providing advice to manage respiratory tract infections (RTIs).

DESIGN

Open pragmatic parallel group randomised controlled trial.

SETTING

Primary care in UK.

PARTICIPANTS

Adults (aged ≥18) registered with general practitioners, recruited by postal invitation.

INTERVENTION

Patients were randomised with computer-generated random numbers to access the intervention website (intervention) or not (control). The intervention tailored advice about the diagnosis, natural history, symptom management (particularly paracetamol/ibuprofen use) and when to seek further help.

OUTCOMES

Primary: National Health Service (NHS) contacts for those reporting RTIs from monthly online questionnaires for 20 weeks. Secondary: hospitalisations; symptom duration/severity.

RESULTS

Results 3044 participants were recruited. 852 in the intervention group and 920 in the control group reported one or more RTIs, among whom there a modest increase in NHS Direct contacts in the intervention group (intervention 44/1734 (2.5%) versus control 24/1842 (1.3%); multivariate Risk Ratio (RR) 2.53 (95% CI 1.10 to 5.82, p=0.029)). Conversely reduced contact with doctors occurred (283/1734 (16.3%) vs 368/1845 (20.0%); risk ratio 0.71, 0.53 to 0.95, p=0.019). Reduction in contacts occurred despite slightly longer illness duration (11.3 days versus 10.9 days respectively; multivariateestimate 0.48 days longer (-0.16 to 1.12, p=0.141) and more days of illness rated moderately bad or worse illness (0.53 days; 0.12 to 0.94, p=0.012). The estimate of slower symptom resolution in the intervention group was attenuated when controlling for whether individuals had used webpages which advocated ibuprofen use (length of illness 0.22 days, −0.51 to 0.95, p=0.551; moderately bad or worse symptoms 0.36 days, −0.08 to 0.80, p=0.105). There was no evidence of increased hospitalisations (risk ratio 0.13; 0.02 to 1.01; p=0.051).

CONCLUSIONS

An internet-delivered intervention for the self-management of RTIs modifies help-seeking behaviour, and does not result in more hospital admissions due to delayed help seeking. Advising the use of ibuprofen may not be helpful.

TRIAL REGISTRATION NUMBER

ISRCTN91518452.

Can illness beliefs, from the common-sense model, prospectively predict adherence to self-management behaviours? A systematic review and meta-analysis

OBJECTIVE

To determine whether people's beliefs about their illness, conceptualised by the common sense model (CSM), can prospectively predict adherence to self-management behaviours (including, attendance, medication, diet and exercise) in adults with acute and chronic physical illnesses.

DESIGN AND MAIN OUTCOME MEASURES

Electronic databases were searched in September 2014, for papers specifying the use of the 'CSM' in relation to 'self-management', 'rehabilitation' and 'adherence' in the context of physical illness. Six hundred abstracts emerged. Data from 52 relevant studies were extracted. Twenty-one studies were meta-analysed, using correlation coefficients in random effects models. The remainder were descriptively synthesised.

RESULTS

The effect sizes for individual illness belief domains and adherence to self-management behaviours ranged from .04 to .13, indicating very weak, predictive relationships. Further analysis revealed that predictive relationships did not differ by the: type of self-management behaviour; acute or chronic illness; or duration of follow-up.

CONCLUSION

Individual illness belief domains, outlined by the CSM, did not predict adherence to self-management behaviours in adults with physical illnesses. Prospective relationships, controlling for past behaviour, also did not emerge. Other factors, including patients' treatment beliefs and inter-relationships between individual illness beliefs domains, may have influenced potential associations with adherence to self-management behaviours.

Measuring the effects of online health information: Scale validation for the e-Health Impact Questionnaire

OBJECTIVE

Health-related websites have developed to be much more than information sites: they are used to exchange experiences and find support as well as information and advice. This paper documents the development of a tool to compare the potential consequences and experiences a person may encounter when using health-related websites.

METHODS

Questionnaire items were developed following a review of relevant literature and qualitative secondary analysis of interviews relating to experiences of health. Item reduction steps were performed on pilot survey data (n=167). Tests of validity and reliability were subsequently performed (n=170) to determine the psychometric properties of the questionnaire.

RESULTS

Two independent item pools entered psychometric testing: (1) Items relating to general views of using the internet in relation to health and, (2) Items relating to the consequences of using a specific health-related website. Identified sub-scales were found to have high construct validity, internal consistency and test-retest reliability.

CONCLUSION

Analyses confirmed good psychometric properties in the eHIQ-Part 1 (11 items) and the eHIQ-Part 2 (26 items).

PRACTICE IMPLICATIONS

This tool will facilitate the measurement of the potential consequences of using websites containing different types of material (scientific facts and figures, blogs, experiences, images) across a range of health conditions.

The person-based approach to intervention development: application to digital health-related behavior change interventions

This paper describes an approach that we have evolved for developing successful digital interventions to help people manage their health or illness. We refer to this as the “person-based” approach to highlight the focus on understanding and accommodating the perspectives of the people who will use the intervention. While all intervention designers seek to elicit and incorporate the views of target users in a variety of ways, the person-based approach offers a distinctive and systematic means of addressing the user experience of intended behavior change techniques in particular and can enhance the use of theory-based and evidence-based approaches to intervention development. There are two key elements to the person-based approach. The first is a developmental process involving qualitative research with a wide range of people from the target user populations, carried out at every stage of intervention development, from planning to feasibility testing and implementation. This process goes beyond assessing acceptability, usability, and satisfaction, allowing the intervention designers to build a deep understanding of the psychosocial context of users and their views of the behavioral elements of the intervention. Insights from this process can be used to anticipate and interpret intervention usage and outcomes, and most importantly to modify the intervention to make it more persuasive, feasible, and relevant to users. The second element of the person-based approach is to identify “guiding principles” that can inspire and inform the intervention development by highlighting the distinctive ways that the intervention will address key context-specific behavioral issues. This paper describes how to implement the person-based approach, illustrating the process with examples of the insights gained from our experience of carrying out over a thousand interviews with users, while developing public health and illness management interventions that have proven effective in trials involving tens of thousands of users.

Optimizing engagement with Internet-based health behaviour change interventions: comparison of self-assessment with and without tailored feedback using a mixed methods approach

OBJECTIVES

Internet-based health behaviour interventions have variable effects on health-related outcomes. Effectiveness may be improved by optimizing the design of interventions. This study examined the specific effect on engagement of providing two different design features - tailoring and self-assessment.

DESIGN

Three versions of an Internet-delivered intervention to support the self-care of mild bowel problems were developed that provided (1) self-assessment without tailored feedback, (2) self-assessment with tailored feedback, and (3) generic information only.

METHODS

A qualitative study explored participants' engagement with each version of the intervention (N = 24). A larger quantitative study systematically compared participants' use of the intervention and self-reported engagement using a partial factorial design (n = 178).

RESULTS

Findings from the qualitative study suggested that self-assessment without tailored feedback appeared to be less acceptable to participants because it was viewed as offering no personal benefit in the absence of personalized advice. In the quantitative study, self-assessment without tailored feedback was associated with greater dropout than when provided in conjunction with tailored feedback. There were significant group differences in participants' engagement with the intervention and perceptions of the intervention. Self-assessment without tailored feedback was rated as marginally less engaging and was associated with fewer positive perceptions than the generic information condition.

CONCLUSIONS

The acceptability of self-assessment or monitoring components may be optimized by also providing tailored feedback. Without tailored feedback, these components do not appear to be any more engaging than generic information provision. Statement of contribution What is already known on this subject? Digital interventions can be effective for improving a range of health outcomes and behaviours. There is huge variation in the success of different interventions using different combinations of design features. What does this study add? This study used a systematic experimental design to identify the effect on engagement of providing interactive intervention design features alone and in combination. Intervention engagement was better when self-assessment was provided in conjunction with tailored feedback.

A study of automated self-assessment in a primary care student health centre setting

We evaluated the advice given by a prototype self-assessment triage system in a university student health centre. Students attending the health centre with a new problem used the automated self-assessment system prior to a face-to-face consultation with the general practitioner (GP). The system's rating of urgency was available to the GP, and following the consultation, the GP recorded their own rating of the urgency of the patient's presentation. Full data were available for 154 of the 207 consultations. Perfect agreement, where both the GP and the self-assessment system selected the same category of advice, occurred in 39% of consultations. The association between the GP assessment and the self-assessment rankings of urgency was low but significant (rho = 0.19, P = 0.016). The self-assessment system tended to be risk averse compared to the GP assessments, with advice for more urgent level of care seeking being recommended in 86 consultations (56%) and less urgent advice in only 8 (5%). This difference in assessment of urgency was significant (P < 0.001). The agreement between self-assessed and GP-assessed urgency was not associated with symptom site or socio-demographic characteristics of the user. Although the self-assessment system was more risk averse than the GPs, which resulted in a high proportion of patients being triaged as needing emergency or immediate care, the self-assessment system successfully identified a proportion of patients who were felt by the GP to have a self-limiting condition that did not need a consultation. In its prototype form, the self-assessment system was not a replacement for clinician assessment and further refinement is necessary.

Evaluation of a web-based intervention to reduce antibiotic prescribing for LRTI in six European countries: quantitative process analysis of the GRACE/INTRO randomised controlled trial

BACKGROUND

To reduce the spread of antibiotic resistance, there is a pressing need for worldwide implementation of effective interventions to promote more prudent prescribing of antibiotics for acute LRTI. This study is a process analysis of the GRACE/INTRO trial of a multifactorial intervention that reduced antibiotic prescribing for acute LRTI in six European countries. The aim was to understand how the interventions were implemented and to examine effects of the interventions on general practitioners' (GPs') and patients' attitudes.

METHODS

GPs were cluster randomised to one of three intervention groups or a control group. The intervention groups received web-based training in either use of the C-reactive protein (CRP) test, communication skills and use of a patient booklet, or training in both. GP attitudes were measured before and after the intervention using constructs from the Theory of Planned Behaviour and a Website Satisfaction Questionnaire. Effects of the interventions on patients were assessed by a post-intervention questionnaire assessing patient enablement, satisfaction with the consultation, and beliefs about the risks and need for antibiotics.

RESULTS

GPs in all countries and intervention groups had very positive perceptions of the intervention and the web-based training, and felt that taking part had helped them to reduce prescribing. All GPs perceived reducing prescribing as more important and less risky following the intervention, and GPs in the communication groups reported increased confidence to reduce prescribing. Patients in the communication groups who received the booklet reported the highest levels of enablement and satisfaction and had greater awareness that antibiotics could be unnecessary and harmful.

CONCLUSIONS

Our findings suggest that the interventions should be broadly acceptable to both GPs and patients, as well as feasible to roll out more widely across Europe. There are also some indications that they could help to engender changes in GP and patient attitudes that will be helpful in the longer-term, such as increased awareness of the potential disadvantages of antibiotics and increased confidence to manage LRTI without them. Given the positive effects of the booklet on patient beliefs and attitudes, it seems logical to extend the use of the patient booklet to all patients.

Management of irritable bowel syndrome in primary care: the results of an exploratory randomised controlled trial of mebeverine, methylcellulose, placebo and a self-management website

Background

Many patients with IBS suffer on-going symptoms. The evidence base is poor for IBS drugs but they are widely prescribed and advised in Guidelines. Cognitive Behavioural Therapy (CBT) can be helpful, but availability is poor in the NHS. We developed a web-based CBT self-management programme (Regul8) in partnership with patients and trialled it and common IBS medications in an exploratory factorial RCT to test trial procedures and provide information for a larger trial.

Methods

Patients, 16 to 60 years, with IBS symptoms fulfilling Rome III criteria were recruited via GP practices and randomised to over-encapsulated mebeverine, methylcellulose or placebo for 6 weeks and to 1 of 3 website conditions: Regul8 with a nurse telephone session and email support, Regul8 with minimal email support, or no website.

Results

135 patients recruited from 26 GP practices. Mean IBS SSS score 241.9 (sd 87.7), IBS-QOL 64 (sd 20) at baseline. 91% follow-up at 12 weeks. Mean IBS SSS decreased by 35 points from baseline to 12 weeks. There was no significant difference in IBS SSS or IBS-QOL score between medication or website groups at 12 weeks, or in medication groups at 6 weeks, or IBS-QOL in website groups at 6 weeks. However, IBS SSS at 6 weeks was lower in the No website group than the website groups (IBS SSS no website =162.8 (95% CI 137.4-188.3), website 197.0 (172.4 - 221.7), Website + telephone support 208.0 (183.1-233.0) p = 0.037).

Enablement and Subjects Global Assessment of relief (SGA) were significantly improved in the Regul8 groups compared to the non-website group at 12 weeks (Enablement = 0 in 56.8% of No website group, 18.4% website, 10.5% Website + support, p = 0.001) (SGA; 32.4% responders in No website group, 45.7% website group, 63.2% website + support group, p = 0.035).

Conclusions

This exploratory study demonstrates feasibility and high follow-up rates and provides information for a larger trial. Primary outcomes (IBS SS and IBS QOL) did not reach significance at 6 or 12 weeks, apart from IBS SSS being lower in the no-website group at 6 weeks - this disappeared by 12 weeks. Improved Enablement suggests patients with access to the Regul8 website felt better able to cope with their symptoms than the non-website group. Improved SGA score in the Regul8 groups may indicate some overall improvement not captured on other measures.

Trial registration

ClinicalTrials.gov Identifier (NCT number): NCT00934973.

Internet-based randomized controlled trials: a systematic review

BACKGROUND

The internet is increasingly being used to conduct randomized controlled trials (RCTs). Knowledge of the types of interventions evaluated and the methodological quality of these trials could inform decisions about whether to conduct future trials using conventional methods, fully online or a mixture of the two.

OBJECTIVE

To identify and describe the scope of internet-based RCTs for human health condition interventions and evaluate their methodological quality.

METHODS

A systematic review of RCTs of any health intervention conducted fully or primarily on the internet was carried out.

RESULTS

23 fully and 27 primarily internet-based RCTs were identified. The first was conducted in 2000. The majority of trials evaluated interventions that involved providing health information to participants, but a few evaluated self-administered interventions (eg, valerian, stretching). Methodological quality was variable and the methods were generally poorly reported. The risk of bias was low in only a small number of trials; most had substantial methodological shortcomings. Only one trial was identified as meeting all criteria for adequate methodological quality. A particular problem was high rates of loss to follow-up (fully online: mean 47%; primarily online: mean 36%).

CONCLUSIONS

It is theoretically possible but perhaps difficult to test the effectiveness of health interventions rigorously with RCTs conducted fully or primarily over the internet. The use of the internet to conduct trials is more suited to pragmatic rather than explanatory trials. The main limitation of these trials is that they typically experience high rates of loss to follow-up. Methodological standards now accepted for traditional RCTs needs to be evident for online RCTs as well, especially in reporting of their methods.

Electronic symptom reporting between patient and provider for improved health care service quality: a systematic review of randomized controlled trials. part 2: methodological quality and effects

Background

We conducted in two parts a systematic review of randomized controlled trials (RCTs) on electronic symptom reporting between patients and providers to improve health care service quality. Part 1 reviewed the typology of patient groups, health service innovations, and research targets. Four innovation categories were identified: consultation support, monitoring with clinician support, self-management with clinician support, and therapy.

Objective

To assess the methodological quality of the RCTs, and summarize effects and benefits from the methodologically best studies.

Methods

We searched Medline, EMBASE, PsycINFO, Cochrane Central Register of Controlled Trials, and IEEE Xplore for original studies presented in English-language articles between 1990 and November 2011. Risk of bias and feasibility were judged according to the Cochrane recommendation, and theoretical evidence and preclinical testing were evaluated according to the Framework for Design and Evaluation of Complex Interventions to Improve Health. Three authors assessed the risk of bias and two authors extracted the effect data independently. Disagreement regarding bias assessment, extraction, and interpretation of results were resolved by consensus discussions.

Results

Of 642 records identified, we included 32 articles representing 29 studies. No articles fulfilled all quality requirements. All interventions were feasible to implement in a real-life setting, and theoretical evidence was provided for almost all studies. However, preclinical testing was reported in only a third of the articles. We judged three-quarters of the articles to have low risk for random sequence allocation and approximately half of the articles to have low risk for the following biases: allocation concealment, incomplete outcome data, and selective reporting. Slightly more than one fifth of the articles were judged as low risk for blinding of outcome assessment. Only 1 article had low risk of bias for blinding of participants and personnel. We excluded 12 articles showing high risk or unclear risk for both selective reporting and blinding of outcome assessment from the effect assessment. The authors’ hypothesis was confirmed for 13 (65%) of the 20 remaining articles. Articles on self-management support were of higher quality, allowing us to assess effects in a larger proportion of studies. All except one self-management interventions were equally effective to or better than the control option. The self-management articles document substantial benefits for patients, and partly also for health professionals and the health care system.

Conclusion

Electronic symptom reporting between patients and providers is an exciting area of development for health services. However, the research generally is of low quality. The field would benefit from increased focus on methods for conducting and reporting RCTs. It appears particularly important to improve blinding of outcome assessment and to precisely define primary outcomes to avoid selective reporting. Supporting self-management seems to be especially promising, but consultation support also shows encouraging results.

Electronic symptom reporting between patient and provider for improved health care service quality: a systematic review of randomized controlled trials. part 1: state of the art

BACKGROUND

Over the last two decades, the number of studies on electronic symptom reporting has increased greatly. However, the field is very heterogeneous: the choices of patient groups, health service innovations, and research targets seem to involve a broad range of foci. To move the field forward, it is necessary to build on work that has been done and direct further research to the areas holding most promise. Therefore, we conducted a comprehensive review of randomized controlled trials (RCTs) focusing on electronic communication between patient and provider to improve health care service quality, presented in two parts. Part 2 investigates the methodological quality and effects of the RCTs, and demonstrates some promising benefits of electronic symptom reporting.

OBJECTIVE

To give a comprehensive overview of the most mature part of this emerging field regarding (1) patient groups, (2) health service innovations, and (3) research targets relevant to electronic symptom reporting.

METHODS

We searched Medline, EMBASE, PsycINFO, Cochrane Central Register of Controlled Trials, and IEEE Xplore for original studies presented in English-language articles published from 1990 to November 2011. Inclusion criteria were RCTs of interventions where patients or parents reported health information electronically to the health care system for health care purposes and were given feedback.

RESULTS

Of 642 records identified, we included 32 articles representing 29 studies. The included articles were published from 2002, with 24 published during the last 5 years. The following five patient groups were represented: respiratory and lung diseases (12 studies), cancer (6), psychiatry (6), cardiovascular (3), and diabetes (1). In addition to these, 1 study had a mix of three groups. All included studies, except 1, focused on long-term conditions. We identified four categories of health service innovations: consultation support (7 studies), monitoring with clinician support (12), self-management with clinician support (9), and therapy (1). Most of the research (21/29, 72%) was conducted within four combinations: consultation support innovation in the cancer group (5/29, 17%), monitoring innovation in the respiratory and lung diseases group (8/29, 28%), and self-management innovations in psychiatry (4/29, 14%) and in the respiratory and lung diseases group (4/29, 14%). Research targets in the consultation support studies focused on increased patient centeredness, while monitoring and self-management mainly aimed at documenting health benefits. All except 1 study aiming for reduced health care costs were in the monitoring group.

CONCLUSION

RCT-based research on electronic symptom reporting has developed enormously since 2002. Research including additional patient groups or new combinations of patient groups with the four identified health service innovations can be expected in the near future. We suggest that developing a generic model (not diagnosis specific) for electronic patient symptom reporting for long-term conditions may benefit the field.

Development of StopAdvisor: A theory-based interactive internet-based smoking cessation intervention

Reviews of internet-based behaviour-change interventions have shown that they can be effective but there is considerable heterogeneity and effect sizes are generally small. In order to advance science and technology in this area, it is essential to be able to build on principles and evidence of behaviour change in an incremental manner. We report the development of an interactive smoking cessation website, StopAdvisor, designed to be attractive and effective across the social spectrum. It was informed by a broad motivational theory (PRIME), empirical evidence, web-design expertise, and user-testing. The intervention was developed using an open-source web-development platform, 'LifeGuide', designed to facilitate optimisation and collaboration. We identified 19 theoretical propositions, 33 evidence- or theory-based behaviour change techniques, 26 web-design principles and nine principles from user-testing. These were synthesised to create the website, 'StopAdvisor' (see http://www.lifeguideonline.org/player/play/stopadvisordemonstration). The systematic and transparent application of theory, evidence, web-design expertise and user-testing within an open-source development platform can provide a basis for multi-phase optimisation contributing to an 'incremental technology' of behaviour change.

Management of irritable bowel syndrome in primary care: feasibility randomised controlled trial of mebeverine, methylcellulose, placebo and a patient self-management cognitive behavioural therapy website. (MIBS trial)

BACKGROUND

IBS affects 10-22% of the UK population. Abdominal pain, bloating and altered bowel habit affect quality of life, social functioning and time off work. Current GP treatment relies on a positive diagnosis, reassurance, lifestyle advice and drug therapies, but many suffer ongoing symptoms.A recent Cochrane review highlighted the lack of research evidence for IBS drugs. Neither GPs, nor patients have good evidence to inform prescribing decisions. However, IBS drugs are widely used: In 2005 the NHS costs were nearly £10 million for mebeverine and over £8 million for fibre-based bulking agents. CBT and self-management can be helpful, but poor availability in the NHS restricts their use. We have developed a web-based CBT self-management programme, Regul8, based on an existing evidence based self-management manual and in partnership with patients. This could increase access with minimal increased costs.

METHODS/DESIGN

The aim is to undertake a feasibility factorial RCT to assess the effectiveness of the commonly prescribed medications in UK general practice for IBS: mebeverine (anti-spasmodic) and methylcellulose (bulking-agent) and Regul8, the CBT based self-management website.135 patients aged 16 to 60 years with IBS symptoms fulfilling Rome III criteria, recruited via GP practices, will be randomised to 1 of 3 levels of the drug condition: mebeverine, methylcellulose or placebo for 6 weeks and to 1 of 3 levels of the website condition, Regul8 with a nurse telephone session and email support, Regul8 with minimal email support, or no website, thus creating 9 groups.

OUTCOMES

Irritable bowel symptom severity scale and IBS-QOL will be measured at baseline, 6 and 12 weeks as the primary outcomes. An intention to treat analysis will be undertaken by ANCOVA for a factorial trial.

DISCUSSION

This pilot will provide valuable information for a larger trial. Determining the effectiveness of commonly used drug treatments will help patients and doctors make informed treatment decisions regarding drug management of IBS symptoms, enabling better targeting of treatment. A web-based self-management CBT programme for IBS developed in partnership with patients has the potential to benefit large numbers of patients with low cost to the NHS. Assessment of the amount of email or therapist support required for the website will enable economic analysis to be undertaken.