The use of handheld computers in clinical trials

MULTIPROFESSIONAL ELECTRONIC PROTOCOL FOR DIGESTIVE SURGERY VALIDATION

Background:

The creation of a computerized clinical database with the ability to collect prospective information from patients and with the possibility of rescue and crossing data enables scientific studies of higher quality and credibility in less time.

Aim:

To validate, in a single master protocol, the clinical data referring to Surgery of Digestive System in a multidisciplinary way, incorporating in the SINPE^© platform, and to verify the incidence of digestive diseases based on the prospectively performed collections.

Method:

Organize in one software, in a standardized structure, all the pre-existing items in the SINPE^© database; the theoretical basis was computerized through the MIGRASINPE^© module creating a single multiprofessional master protocol for use as a whole.

Results:

The existing specific protocols were created and/or adapted - they correspond to the most prevalent digestive diseases - unifying them. The possibility of multiprofessional use was created by integrating all data collected from medicine, nursing, physiotherapy, nutrition and health management in a prospective way. The total was 4,281 collections, distributed as follows: extrahepatic biliary tract, n=1,786; esophagus, n=1015; anorectal, n=736; colon, n=550; small intestine, n=86; pancreas, n=71; stomach, n=23; liver, n=14.

Conclusions:

The validation of the unification and structuring in a single master protocol of the clinical data referring to the Surgery of the Digestive System in a multiprofessional and prospective way was possible and the epidemiological study carried out allowed to identify the most prevalent digestive diseases.

Photo-Assisted Dietary Method Improves Estimates of Dietary Intake Among People with Sleeve Gastrectomy

INTRODUCTION

Bariatric operations are effective obesity treatments because of the significant reductions in food intake after surgery, but weight regain remains a problem in a small group of patients after surgery. Estimating food intake is difficult due to dieting status, weight, gender, and challenges with estimating portion size. We aimed to evaluate the use of digital food photography in comparison to conventional methods among patients after sleeve gastrectomy.

METHODS

Participants used a mobile device (mHealth) to photo-document their dietary intake of all food and beverages consumed before and after eating. They also completed a 24 h food recall interview with a dietician.

RESULTS

Data from 383 eating occasions were analyzed. Food intake using 24 h recall was reported as 972.5 ± 77 kcal and estimates from photographs were 802.9 ± 63.4 kcal, with a difference of 169.6 ± 451.4 kcal (95% confidence interval (CI) of 41.4 to 297.9 kcal, p = 0.005). There was no difference for protein intake, but carbohydrate intake reported during the 24 h recall was 541.2 ± 298 kcal and estimates from photographs were 395.2 ± 219.6 kcal, with a difference of 145.8 ± 256.3 kcal (95% CI of 73.2 to 218.8 kcal, p = 0.0001).

CONCLUSION

After sleeve gastrectomy, patients reported eating more total calories and calories from carbohydrates compared to estimations using photographs. The implication for patients are that tools such as mHealth might be useful to optimize food intake and calories after sleeve gastrectomy, especially for those patients that may struggle with weight regain after surgery.

Evaluation of Electronic and Paper-Pen Data Capturing Tools for Data Quality in a Public Health Survey in a Health and Demographic Surveillance Site, Ethiopia: Randomized Controlled Crossover Health Care Information Technology Evaluation

BACKGROUND

Periodic demographic health surveillance and surveys are the main sources of health information in developing countries. Conducting a survey requires extensive use of paper-pen and manual work and lengthy processes to generate the required information. Despite the rise of popularity in using electronic data collection systems to alleviate the problems, sufficient evidence is not available to support the use of electronic data capture (EDC) tools in interviewer-administered data collection processes.

OBJECTIVE

This study aimed to compare data quality parameters in the data collected using mobile electronic and standard paper-based data capture tools in one of the health and demographic surveillance sites in northwest Ethiopia.

METHODS

A randomized controlled crossover health care information technology evaluation was conducted from May 10, 2016, to June 3, 2016, in a demographic and surveillance site. A total of 12 interviewers, as 2 individuals (one of them with a tablet computer and the other with a paper-based questionnaire) in 6 groups were assigned in the 6 towns of the surveillance premises. Data collectors switched the data collection method based on computer-generated random order. Data were cleaned using a MySQL program and transferred to SPSS (IBM SPSS Statistics for Windows, Version 24.0) and R statistical software (R version 3.4.3, the R Foundation for Statistical Computing Platform) for analysis. Descriptive and mixed ordinal logistic analyses were employed. The qualitative interview audio record from the system users was transcribed, coded, categorized, and linked to the International Organization for Standardization 9241-part 10 dialogue principles for system usability. The usability of this open data kit-based system was assessed using quantitative System Usability Scale (SUS) and matching of qualitative data with the isometric dialogue principles.

RESULTS

From the submitted 1246 complete records of questionnaires in each tool, 41.89% (522/1246) of the paper and pen data capture (PPDC) and 30.89% (385/1246) of the EDC tool questionnaires had one or more types of data quality errors. The overall error rates were 1.67% and 0.60% for PPDC and EDC, respectively. The chances of more errors on the PPDC tool were multiplied by 1.015 for each additional question in the interview compared with EDC. The SUS score of the data collectors was 85.6. In the qualitative data response mapping, EDC had more positive suitability of task responses with few error tolerance characteristics.

CONCLUSIONS

EDC possessed significantly better data quality and efficiency compared with PPDC, explained with fewer errors, instant data submission, and easy handling. The EDC proved to be a usable data collection tool in the rural study setting. Implementation organization needs to consider consistent power source, decent internet connection, standby technical support, and security assurance for the mobile device users for planning full-fledged implementation and integration of the system in the surveillance site.

Difficult vs. Severe Asthma: Definition and Limits of Asthma Control in the Pediatric Population

Evaluating the degree of disease control is pivotal when assessing a patient with asthma. Asthma control is defined as the degree to which manifestations of the disease are reduced or removed by therapy. Two domains of asthma control are identified in the guidelines: symptom control and future risk of poor asthma outcomes, including asthma attacks, accelerated decline in lung function, or treatment-related side effects. Over the past decade, the definition and the tools of asthma control have been substantially implemented so that the majority of children with asthma have their disease well controlled with standard therapies. However, a small subset of asthmatic children still requires maximal therapy to achieve or maintain symptom control and experience considerable morbidity. Childhood uncontrolled asthma is a heterogeneous group and represents a clinical and therapeutic challenge requiring a multidisciplinary systematic assessment. The identification of the factors that may contribute to the gain or loss of control in asthma is essential in differentiating children with difficult-to-treat asthma from those with severe asthma that is resistant to traditional therapies. The aim of this review is to focus on current concept of asthma control, describing monitoring tools currently used to assess asthma control in clinical practice and research, and evaluating comorbidities and modifiable and non-modifiable factors associated with uncontrolled asthma in children, with particular reference to severe asthma.

The Importance of Electronic Diary Studies for Occupational Therapy Research

Diary research methods are being used to assess many health-related conditions in both adult and pediatric populations. However, electronic diary data collection, ecological momentary assessment techniques, and multilevel statistical modeling are little used methodologies in occupational therapy research. It is important to add these methodologies to occupational therapy research; they offer prospective, flexible, and timely methods of evaluating the effects of conditions and diseases on occupational performance in many populations and across a variety of settings.

Design of Treatment Trials for Functional Gastrointestinal Disorders

This article summarizes recent progress and regulatory guidance on design of trials to assess the efficacy of new therapies for functional gastrointestinal disorders (FGIDs). The double-masked, placebo-controlled, parallel-group design remains the accepted standard for evaluating treatment efficacy. A control group is essential, and a detailed description of the randomization process and concealed allocation method must be included in the study report. The control will most often be placebo, but for therapeutic procedures and for behavioral treatment trials, respectively, a sham procedure and control intervention with similar expectation of benefit, but lacking the treatment principle, are recommended. Investigators should be aware of, and attempt to minimize, expectancy effects (placebo, nocebo, precebo). The primary analysis should be based on the proportion of patients in each treatment arm who satisfy a treatment responder definition or a prespecified clinically meaningful change in a patient-reported outcome measure. Data analysis should use the intention-to-treat principle. Reporting of results should follow the Consolidated Standards for Reporting Trials guidelines and include secondary outcome measures to support or explain the primary outcome and an analysis of harms data. Trials should be registered in a public location before initiation and results should be published regardless of outcome.

The Psoriatic Arthritis Impact of Disease 12-item questionnaire: equivalence, reliability, validity, and feasibility of the touch-screen administration versus the paper-and-pencil version

BACKGROUND

Over the last few years, there has been a shift toward a more patient-centered perspective of the disease by adopting patient-reported outcomes. Touch-screen formats are increasingly being used for data collection in routine care and research.

OBJECTIVES

The aim of this study is to examine the equivalence, reliability, validity and respondent preference for a computerized touch-screen version of the Psoriatic Arthritis Impact of Disease 12-item (PsAID-12) questionnaire in comparison with the original paper-and-pencil version, in a cohort of patients with psoriatic arthritis (PsA).

METHODS

One hundred and fifty-nine patients with PsA completed both the touch screen- and the conventional paper-and-pencil administered PsAID-12 questionnaire. Agreement between formats was assessed by intraclass correlation coefficients. Spearman's rho correlation coefficient was used to test convergent validity of the touch screen format of PsAID-12, while receiver operating characteristic curve analysis was performed to test discriminant validity. In order to assess the patient's preference, the participants filled in an additional questionnaire. The time taken to complete both formats was measured.

RESULTS

A high concordance between the responses to the two modes of the PsAID-12 tested was found, with no significant mean differences. Intraclass correlation coefficients between data obtained for touch-screen and paper versions ranged from 0.801 to 0.962. There was a very high degree of correlation between the touch-screen format of PsAID-12 and composite disease activity indices (all at a P level <0.0001), Health Assessment Questionnaire, and Physician Assessment of disease activity. The discriminatory power of the touch-screen format of PsAID-12, assessed using the minimal disease activity - Outcome Measurements in Rheumatology Clinical Trials criteria, was very good, with an area under the receiver operating characteristic curve of 0.937 and a resulting cutoff value of 2.5. The touch-screen questionnaire was readily accepted and preferred. The mean time spent for completing the questionnaire on touch screen was 2 minutes and on paper was 2.7 minutes.

CONCLUSION

The touch-screen mode of administration of PsAID-12 can be a feasible and suitable alternative to the paper-and-pencil mode for the assessment of patients with PsA.

A comparison of smartphones to paper-based questionnaires for routine influenza sentinel surveillance, Kenya, 2011-2012

BACKGROUND

For disease surveillance, manual data collection using paper-based questionnaires can be time consuming and prone to errors. We introduced smartphone data collection to replace paper-based data collection for an influenza sentinel surveillance system in four hospitals in Kenya. We compared the quality, cost and timeliness of data collection between the smartphone data collection system and the paper-based system.

METHODS

Since 2006, the Kenya Ministry of Health (MoH) with technical support from the Kenya Medical Research Institute/Centers for Disease Control and Prevention (KEMRI/CDC) conducted hospital-based sentinel surveillance for influenza in Kenya. In May 2011, the MOH replaced paper-based collection with an electronic data collection system using Field Adapted Survey Toolkit (FAST) on HTC Touch Pro2 smartphones at four sentinel sites. We compared 880 paper-based questionnaires dated Jan 2010-Jun 2011 and 880 smartphone questionnaires dated May 2011-Jun 2012 from the four surveillance sites. For each site, we compared the quality, cost and timeliness of each data collection system.

RESULTS

Incomplete records were more likely seen in data collected using pen-and-paper compared to data collected using smartphones (adjusted incidence rate ratio (aIRR) 7, 95% CI: 4.4-10.3). Errors and inconsistent answers were also more likely to be seen in data collected using pen-and-paper compared to data collected using smartphones (aIRR: 25, 95% CI: 12.5-51.8). Smartphone data was uploaded into the database in a median time of 7 days while paper-based data took a median of 21 days to be entered (p < 0.01). It cost USD 1,501 (9.4%) more to establish the smartphone data collection system ($17,500) than the pen-and-paper system (USD $15,999). During two years, however, the smartphone data collection system was $3,801 (7%) less expensive to operate ($50,200) when compared to pen-and-paper system ($54,001).

CONCLUSIONS

Compared to paper-based data collection, an electronic data collection system produced fewer incomplete data, fewer errors and inconsistent responses and delivered data faster. Although start-up costs were higher, the overall costs of establishing and running the electronic data collection system were lower compared to paper-based data collection system. Electronic data collection using smartphones has potential to improve timeliness, data integrity and reduce costs.

Daily diaries vs retrospective questionnaires to assess asthma control and therapeutic responses in asthma clinical trials: is participant burden worth the effort?

BACKGROUND

Presently, there is insufficient information to compare the value of daily diaries vs retrospective questionnaires for assessing symptoms in relationship to asthma control in clinical trials. Daily symptom diaries are often burdensome to gather, incomplete, susceptible to fabrication, and of questionable reliability. There is also concern that retrospective symptom questionnaires may be subject to poor recall and may be insensitive.

METHODS

To compare these two methods of assessing symptoms reporting, we analyzed data collected during the Best Add-on Therapy Giving Effective Responses (BADGER) trial. During the trial, asthma control in 182 children aged 6 to 17 years was assessed in two ways: (1) by asthma control days (ACDs) determined by manually recorded daily diary symptom and rescue medication use scores and (2) by monthly retrospective report of symptoms embedded within the age-appropriate version of the Asthma Control Test (ACT). Correlations between ACDs and ACT scores were analyzed, and the sensitivity of each method for measuring asthma control and determining the differential response among the three BADGER treatments was evaluated.

RESULTS

Although validated using a 4-week recall period, ACT correlated better with daily diary information from the last 2 weeks of the 4-week recall (r = 0.46) than from the first 2 weeks (r = 0.34). In addition, clinically significant differential treatment responses were detected using ACDs but not ACT scores .

CONCLUSIONS

The results of this study indicate that daily diaries used to determine ACDs can be a more sensitive tool than ACT for assessing differential treatment responses with respect to asthma control.

Development and functionality of a handheld computer program to improve fruit and vegetable intake among low-income youth

Mobile technologies hold promise for improving diet and physical activity, but little attention is given to creating programs that adolescents like and will use. This study developed a personal digital assistant (PDA) program to promote increased intake of fruits and vegetables (FV) in predominately low-income, ethnic minority girls. This study used a three-phase community-engaged process, including (i) engagement of a Student Advisory Board (SAB) to determine comfort with PDAs; (ii) early testing of Prototype I and rapid re-design by the SAB and (iii) feasibility testing of Prototype II in a new sample of girls. Phase 1 results showed that girls were comfortable with the PDA. Testing of Prototype I in Phase 2 showed that acceptability was mixed, with girls responding to 47.3% of the prompts. Girls wanted more reminders, accountability in monitoring FV, help in meeting daily goals and free music downloads based on program use. The PDA was reprogrammed and testing of Prototype II in Phase 3 demonstrated marked improvement in use (78.3%), increases in FV intake (1.8 ± 2.6 daily servings) and good overall satisfaction. Findings suggest that mobile technology designed with the early input of youth is a promising way to improve adolescent health behaviors.

Dietary assessment and self-monitoring with nutrition applications for mobile devices

Nutrition applications for mobile devices (e.g., personal digital assistants, smartphones) are becoming increasingly accessible and can assist with the difficult task of intake recording for dietary assessment and self-monitoring. This review is a compilation and discussion of research on this tool for dietary intake documentation in healthy populations and those trying to lose weight. The purpose is to compare this tool with conventional methods (e.g., 24-hour recall interviews, paper-based food records). Research databases were searched from January 2000 to April 2011, with the following criteria: healthy or weight loss populations, use of a mobile device nutrition application, and inclusion of at least one of three measures, which were the ability to capture dietary intake in comparison with conventional methods, dietary self-monitoring adherence, and changes in anthropometrics and/or dietary intake. Eighteen studies are discussed. Two application categories were identified: those with which users select food and portion size from databases and those with which users photograph their food. Overall, positive feedback was reported with applications. Both application types had moderate to good correlations for assessing energy and nutrient intakes in comparison with conventional methods. For self-monitoring, applications versus conventional techniques (often paper records) frequently resulted in better self-monitoring adherence, and changes in dietary intake and/or anthropometrics. Nutrition applications for mobile devices have an exciting potential for use in dietetic practice.

Mediators of asthma outcomes

BACKGROUND

Patient adherence, the level of asthma self-management skills, exposure to stress, and depression can have considerable influence on a wide range of asthma outcomes and thus are considered asthma outcome mediators.

OBJECTIVE

National Institutes of Health institutes and other federal agencies convened an expert group to recommend standardized measures for 7 domains of asthma clinical research outcomes measures. Although the review of mediators of these outcomes was not within the scope of any specific outcome topic, a brief summary is presented so that researchers might consider potential mediators.

METHODS

We prepared a summary of key mediators of asthma outcomes based on expertise and knowledge of the literature.

RESULTS

The rationale for including measures of adherence, self-management skills, and exposures to stress in asthma clinical research is presented, along with a brief review of instruments for collecting this information from clinical research participants.

CONCLUSIONS

Appropriate measurement of adherence, self-management skills, and exposures to stress will enhance characterization of study participants and provide information about the potential impact these factors can have on mediating the effects of treatment interventions.

Usability and feasibility of mobile phone diaries in an experimental physical exercise study

OBJECTIVES

Wireless and mobile phone technology as a method of data collection will increase alongside conventional methods. The aim of the present study was to evaluate the use of a mobile phone application for recording symptoms and physical activity exertion during an experimental physical exercise study.

MATERIALS AND METHODS

An experimental study on the effects of physical exercise on the well-being of menopausal women included 158 subjects between 44 and 63 years of age. The women were randomized into intervention and control groups. All participants in both groups reported daily symptoms by responding to morning and evening questionnaires via mobile phones. The usability of the mobile phone as a data collector tool was evaluated with the System Usability Scale (SUS) questionnaire 2 months after the intervention. The feasibility evaluation was based on the frequency of responses and open questions.

RESULTS

The response rates were about 70% to both morning and evening questionnaires. The average frequency of responses (n =158) to morning questionnaires was 125 (±40)/170 (±14) and to evening questionnaires was 118 (±40)/171 (±14). The response rate did not differ between the intervention and the control groups. The SUS score was on average 75.4 (range, 0-100; n =107).

CONCLUSION

A mobile phone diary is a feasible and usable tool for data collection in clinical trials.

Measures of asthma control

PURPOSE OF REVIEW

Over the past decade, the concept of asthma control as distinct from asthma severity has been clearly defined. Well controlled asthma is the goal of therapy in all asthma patients. This review is a comprehensive description of the tools currently available for a methodical assessment of different aspects of asthma control in clinical practice and research.

RECENT FINDINGS

Several questionnaires for assessing asthma control have been extensively validated in adults. In children, validation data are less extensive. Considerable overlap exists between asthma control measures and measures of asthma-specific quality of life. Asthma-specific quality-of-life questionnaires have been used as primary outcome measures in major clinical trials evaluating asthma therapy. Biomarkers that reflect eosinophilic inflammation of the airways are used as intermediate outcome measures to reflect the biological basis of asthma control. There is some controversy, however, over which biomarkers are best incorporated into therapeutic algorithms that attempt to achieve maximal asthma control while minimizing treatment intensity.

SUMMARY

In designing clinical studies to evaluate different asthma therapies, researchers will find this review to be a useful resource in terms of choosing the appropriate tool for assessing asthma control. This is also a valuable resource for a methodical assessment of response to asthma therapy in routine clinical care.

Personal digital assistant data capture: the future of quality of life measurement in prostate cancer treatment

PURPOSE

This article examines the potential use of personal digital assistant (PDA) data capture systems for real-time linear monitoring of health-related quality of life (HRQOL) in prostate cancer research and clinical care.

METHODS

We discuss the benefits and potential issues of using PDA data capture in the clinical health care setting. In addition, we describe the development and potential use of a PDA data capture system specific to managing HRQOL in prostate cancer treatment.

CONCLUSION

Follow-up health care clinics require a practical and systematic process of HRQOL data capture and analysis. Traditional paper questionnaire data capture is problematic. Data manipulation required for clinical decision-making is impractical for patient feedback on same-day clinic visits. Furthermore, the process of transforming paper questionnaire data to analysis-quality data can compromise data integrity. In contrast, research findings confirm the acceptability, ease of use, and reliability of PDAs in capturing data across health care settings, including the collection of serial HRQOL data. The main concern for PDA capture systems is the ability to compare respondent's answers between the paper and PDA questionnaire. Other challenges included patients reporting a lack of computer literacy and/or poor eyesight, as well as initial start-up costs. If issues are successfully addressed, the use of a PDA data capture system, such as the PDA HRQOL system at Princess Margaret Hospital's Prostate Centre, allows for valid and economical data collection with the possibility of linear real-time measurement of changes in HRQOL. Accordingly, there appears to be significant potential for PDA data collection of serial HRQOL in prostate cancer clinic settings.

University students' notebook computer use: lessons learned using e-diaries to report musculoskeletal discomfort

The objective of this pilot study was to identify if notebook accessories (ergonomic chair, desktop monitor and notebook riser) combined with a wireless keyboard, mouse and participatory ergonomics training would have the greatest impact on reducing self-reported upper extremity musculoskeletal discomfort in university students. In addition to pre-post computing and health surveys, the Ecological Momentary Assessment was used to capture change in discomfort over time using a personal digital assistant (PDA) as the e-diary. The PDA was programmed with a survey containing 45 questions. Four groups of university students were randomised to either intervention (three external computer accessories) or to control. Participants reported less discomfort with the ergonomic chair and notebook riser based on the pre-post survey data and the e-diary/PDA ANOVA analysis. However, the PDA data, adjusted for the effect of hours per day of computer use, showed no benefit of the chair and limited benefit from the riser. Statement of Relevance:University students' use of notebook computers has increased. This study found evidence of a positive effect of an adjustable chair or notebook riser when combined with ergonomic training on reducing discomfort. Daily notebook computer use of 4 h was confirmed as a risk factor. Without some form of ergonomic intervention, these students are likely to enter the workforce with poor computing habits, which places them on the road to future injuries as technology continues to play a dominant role in their lives.

Electronic data capture for registries and clinical trials in orthopaedic surgery: open source versus commercial systems

BACKGROUND

Collection and analysis of clinical data can help orthopaedic surgeons to practice evidence based medicine. Spreadsheets and offline relational databases are prevalent, but not flexible, secure, workflow friendly and do not support the generation of standardized and interoperable data. Additionally these data collection applications usually do not follow a structured and planned approach which may result in failure to achieve the intended goal.

QUESTIONS/PURPOSES

Our purposes are (1) to provide a brief overview of EDC systems, their types, and related pros and cons as well as to describe commonly used EDC platforms and their features; and (2) describe simple steps involved in designing a registry/clinical study in DADOS P, an open source EDC system. WHERE ARE WE NOW?: Electronic data capture systems aimed at addressing these issues are widely being adopted at an institutional/national/international level but are lacking at an individual level. A wide array of features, relative pros and cons and different business models cause confusion and indecision among orthopaedic surgeons interested in implementing EDC systems. WHERE DO WE NEED TO GO?: To answer clinical questions and actively participate in clinical studies, orthopaedic surgeons should collect data in parallel to their clinical activities. Adopting a simple, user-friendly, and robust EDC system can facilitate the data collection process. HOW DO WE GET THERE?: Conducting a balanced evaluation of available options and comparing them with intended goals and requirements can help orthopaedic surgeons to make an informed choice.

A review of the use of information and communication technologies for dietary assessment

Presently used dietary-assessment methods often present difficulties for researchers and respondents, and misreporting errors are common. Methods using information and communication technologies (ICT) may improve quality and accuracy. The present paper presents a systematic literature review describing studies applying ICT to dietary assessment. Eligible papers published between January 1995 and February 2008 were classified into four assessment categories: computerised assessment; personal digital assistants (PDA); digital photography; smart cards. Computerised assessments comprise frequency questionnaires, 24 h recalls (24HR) and diet history assessments. Self-administered computerised assessments, which can include audio support, may reduce literacy problems, be translated and are useful for younger age groups, but less so for those unfamiliar with computers. Self-administered 24HR utilising computers yielded comparable results as standard methods, but needed supervision if used in children. Computer-assisted interviewer-administered recall results were similar to conventional recalls, and reduced inter-interviewer variability. PDA showed some advantages but did not reduce underreporting. Mobile phone meal photos did not improve PDA accuracy. Digital photography for assessing individual food intake in dining facilities was accurate for adults and children, although validity was slightly higher with direct visual observation. Smart cards in dining facilities were useful for measuring food choice but not total dietary intake. In conclusion, computerised assessments and PDA are promising, and could improve dietary assessment quality in some vulnerable groups and decrease researcher workload. Both still need comprehensive evaluation for micronutrient intake assessment. Further work is necessary for improving ICT tools in established and new methods and for their rigorous evaluation.

A means to an end: a web-based client management system in palliative care

Home-based palliative care (hospice) services require comprehensive and fully integrated information systems to develop and manage the various aspects of their business, incorporating client data and management information. These systems assist in maintaining the quality of client care as well as improved management efficiencies. This article reports on a large not-for-profit home-based palliative care service in Australia, which embarked on a project to develop an electronic data management system specifically designed to meet the needs of the palliative care sector. This web-based client information management system represents a joint venture between the organization and a commercial company and has been a very successful project.

A customizable mobile tool for supporting health behavior interventions

Recorded self-observations on a regular basis is an important component in many health behavior interventions. Using information and communication technologies (ICT) and especially mobile eHealth applications is a promising way of improving user-friendliness and possibly the overall effectiveness of self-monitoring. Mobility as such brings the added value of continuous availability and timely information access. One additional benefit of ICT based solutions is the possibility for various types of customization, allowing support for a wider set of application requirements than was originally planned, and meeting changing needs and targets of individuals, groups or larger user segments. In this paper, we present a customizable mobile application for recording and managing health related self-observations, Wellness Diary, and the ideas and technical solutions for supporting tailoring of the application. The main idea is to allow end-users to freely change the data model in the application, and customize related data presentations. This work has been done in Nuadu ITEA project, as well as further work where the effectiveness of the mobile tool and other ICT technologies will be investigated in a controlled trial in Finland. We'll also present shortly a counterpart for the mobile application, a web service that should bring some added value for the end user.

Are electronic diaries useful for symptoms research? A systematic review

OBJECTIVE

The objective of this study was to evaluate electronic diaries as a tool for investigating associations between physical symptoms and psychological variables.

METHODS

A qualitative systematic review of electronic diary studies in pain and symptoms research was performed.

RESULTS

Studies of electronic diary use report good acceptability and accuracy of data recording. A descriptive classification of the findings of electronic diary studies yielded five categories: experience, recording data when symptoms were present; interaction, testing the relationship between variables at different levels; sequential, observing associations at different time lags; process, recording possible mediating constructs such as catastrophization and self-efficacy; and intervention, recording during treatment to identify trends. Most data from diary studies suggest relatively weak associations between variables.

CONCLUSION

Electronic diaries are a potentially valuable tool for psychosomatic research. We suggest further possibilities for their use.

Daily health status registration (patient diary) in patients with rheumatoid arthritis: a comparison between personal digital assistant and paper-pencil format

OBJECTIVE

The patient perspective workshops at the Outcome Measures in Rheumatology Clinical Trials have included daily measures of health status (patient diary) and use of electronic tools for data collection in the research agenda. The objective of this study was to compare daily and weekly registrations of self-reported health status measures between personal digital assistant (PDA) and paper-pencil (PP) format regarding scores, variation, and feasibility.

METHODS

Thirty-eight patients with stable rheumatoid arthritis recorded their health status during 84 days in a repeated crossover design, using PDA or PP format during four 21-day periods. Visual analog scales (VAS) for pain, fatigue, and global disease and the Rheumatoid Arthritis Disease Activity Index were scored daily; the Short Form 36 and Modified Health Assessment Questionnaire were scored weekly.

RESULTS

The average scores and measures of variation of the 4 daily health status measures over 21 days did not differ significantly between PDA and PP formats in either of the 2 crossover periods. The values for the average range between the maximum and minimum values for daily measures were similar between the 2 formats, but showed considerable variation (e.g., range for pain VAS was 19-28 mm over each 21-day period). The time to complete the instruments was similar between the 2 formats. Missing daily data entries were generally low for both periods and somewhat higher for PDA. The majority of patients (82.9%) preferred using PDA.

CONCLUSION

Daily assessments with PDA may be efficiently used for frequent data collection because this format performs similarly to the traditional PP format.

Daytime symptoms in primary insomnia: a prospective analysis using ecological momentary assessment

OBJECTIVES

To prospectively characterize and compare daytime symptoms in primary insomnia (PI) and good sleeper control (GSC) subjects using ecological momentary assessment; to examine relationships between daytime symptom factors, retrospective psychological and sleep reports, and concurrent sleep diary reports.

METHODS

Subjects included 47 PI and 18 GSC. Retrospective self-reports of daytime and sleep symptoms were collected. Daytime symptoms and sleep diary information were then collected for 1 week on hand-held computers. The Daytime Insomnia Symptom Scale (DISS) consisted of 19 visual analog scales completed four times per day. Factors for the DISS were derived using functional principal components analysis. Nonparametric tests were used to contrast DISS, retrospective symptom ratings, and sleep diary results in PI and GSC subjects, and to examine relationships among them.

RESULTS

Four principal components were identified for the DISS: Alert Cognition, Negative Mood, Positive Mood, and Sleepiness/Fatigue. PI scored significantly worse than GSC on all four factors (p<0.0003 for each). Among PI subjects DISS scales and retrospective psychological symptoms were related to each other in plausible ways. DISS factors were also related to self-report measures of sleep, whereas retrospective psychological symptom measures were not.

CONCLUSIONS

Daytime symptom factors of alertness, positive and negative mood, and sleepiness/fatigue, collected with ecological momentary assessment, showed impairment in PI versus GSC. DISS factors showed stronger relationships to retrospective sleep symptoms and concurrent sleep diary reports than retrospective psychological symptoms. The diurnal pattern of symptoms may inform studies of the pathophysiology and treatment outcome of insomnia.

Development and use of behavior and social interaction software installed on Palm handheld for observation of a child's social interactions with the environment

In settings in developing countries, children often socialize with multiple socializing agents (peers, siblings, neighbors) apart from their parents, and thus, a measurement of a child's social interactions should be expanded beyond parental interactions. Since the environment plays a role in shaping a child's development, the measurement of child-socializing agents' interactions is important. We developed and used a computerized observational software Behavior and Social Interaction Software (BASIS) with a preloaded coding scheme installed on a handheld Palm device to record complex observations of interactions between children and socializing agents. Using BASIS, social interaction assessments were conducted on 573 preschool children for 1 h in their natural settings. Multiple screens with a set of choices in each screen were designed that included the child's location, broad activity, state, and interactions with child-socializing agents. Data were downloaded onto a computer and systematically analyzed. BASIS, installed on Palm OS (M-125), enabled the recording of the complex interactions of child-socializing agents that could not be recorded with manual forms. Thus, this tool provides an innovative and relatively accurate method for the systematic recording of social interactions in an unrestricted environment.

Personal digital assistants are comparable to traditional diaries for dietary self-monitoring during a weight loss program

Dietary self-monitoring is considered the core of behavioral weight control programs. As software for personal digital assistants (PDA) has become more available, this study investigated whether the use of a PDA would improve dietary self-monitoring frequency and subsequent weight loss over the use of traditional paper diaries. One-hundred-seventy-six adults (BMI 25-39.9) participated in a 6-month behavioral weight control program. Treatment subjects (n = 61) were provided with a PalmZire 21 with Calorie King's Diet Diary software installed. Their self-monitoring habits and weight loss were compared with the results from a previous program (n = 115) which followed the same protocol using paper diaries for self-monitoring. No significant differences in weight loss or dietary self-monitoring were found. More frequent self-monitoring correlated with weight loss in both groups (p<.001). People seeking to lose weight should be encouraged to self-monitor and be matched with a mode of self-monitoring that is fitting to their lifestyle and skills.

Despite technical problems personal digital assistants outperform pen and paper when collecting patient diary data

OBJECTIVES

To assess how personal digital assistants (PDAs) perform as collection tools of patient-reported outcomes in clinical research compared to pen and paper (P&P) diaries in terms of feasibility, protocol compliance, data accuracy, and subject acceptability.

STUDY DESIGN AND SETTING

A systematic review of randomized and quasi-randomized controlled trials comparing the PDA and P&P methods in a health diary context involving repeated measures in persons with chronic health problems.

RESULTS

Nine studies were included. Their methodological quality was variable. Five studies reported on feasibility, and all reported technical difficulties with the PDA technology. Two studies reported that electronic collection leads to a substantial reduction in time used for data handling. Five studies reported that the PDA method results in better compliance, whereas one study reported the opposite. All three articles reporting on data accuracy indicated that there are fewer errors in the PDA records. Four articles scrutinized subject preference, and the PDA method came out favorably in all four.

CONCLUSION

The PDA method seems to perform better than P&P in most of the selected outcomes. Technical malfunction is the chief disadvantage with the PDA method. Further research comparing PDA with paper data collection using more stringent methodology is needed.

The Use of a Personal Digital Assistant for Dietary Self-Monitoring Does Not Improve the Validity of Self-Reports of Energy Intake

Underreporting of energy intake is a pervasive problem and resistant to improvement, especially among people with overweight and obesity. The goal of this study was to investigate whether the use of a personal digital assistant (PDA) for dietary self-monitoring would reduce underreporting prevalence and improve the validity of self-reported energy intake. Adults with overweight and obesity (n=61, 92% women, mean age 48.2 years, mean body mass index 32.3) were provided with a PalmZire 21 (Palm, Inc, Sunnyvale, CA) loaded with Calorie King's Diet Diary software (version 3.2.2, 2002, Family Health Network, Costa Mesa, CA). Subjects participated in a 24-week in-person behavioral weight control program and were asked to self-monitor their diet and exercise habits using the PDA. Basal metabolic rate and physical activity level were estimated at baseline. Energy intake from 7-day electronic food records were collected within the first month of the weight-control program. As subjects were actively losing weight, Bandini's adjustments were used to correct self-reported energy intake for weight loss. In this group, where 41% of the subjects were categorized as low-energy reporters, the use of a PDA did not improve validity of energy reporting when compared to what is reported in the literature.

A review of randomized controlled trials comparing the effectiveness of hand held computers with paper methods for data collection

BACKGROUND

Handheld computers are increasingly favoured over paper and pencil methods to capture data in clinical research.

METHODS

This study systematically identified and reviewed randomized controlled trials (RCTs) that compared the two methods for self-recording and reporting data, and where at least one of the following outcomes was assessed: data accuracy; timeliness of data capture; and adherence to protocols for data collection.

RESULTS

A comprehensive key word search of NLM Gateway's database yielded 9 studies fitting the criteria for inclusion. Data extraction was performed and checked by two of the authors. None of the studies included all outcomes. The results overall, favor handheld computers over paper and pencil for data collection among study participants but the data are not uniform for the different outcomes. Handheld computers appear superior in timeliness of receipt and data handling (four of four studies) and are preferred by most subjects (three of four studies). On the other hand, only one of the trials adequately compared adherence to instructions for recording and submission of data (handheld computers were superior), and comparisons of accuracy were inconsistent between five studies.

CONCLUSION

Handhelds are an effective alternative to paper and pencil modes of data collection; they are faster and were preferred by most users.

Who's using PDAs? Estimates of PDA use by health care providers: a systematic review of surveys

Background

Personal digital assistants (PDAs) find many uses in health care. Knowing rates of collective PDA use among health care providers is an important guiding step to further understanding those health care contexts that are most suited to PDA use and whether PDAs provide improved health outcomes.

Objectives

The objectives of this study were to estimate current and future PDA use among health care providers and to discuss possible implications of that use on choice of technology in clinical practice and research.

Methods

This study was a systematic review of PDA usage surveys. Surveys were identified as part of an ongoing systematic review on the use of handheld devices. Reports from eight databases covering both biomedical sciences and engineering (1993-2006) were screened against distinct eligibility criteria. Data from included surveys were extracted and verified in a standardized way and were assessed descriptively.

Results

We identified 23 relevant surveys, 15 of which were derived from peer-reviewed journals. This cohort of surveys was published between 2000 and 2005. Overall, since 1999, there is clear evidence of an increasing trend in PDA use. The current overall adoption rate for individual professional use ranges between 45% and 85%, indicating high but somewhat variable adoption, primarily among physicians.

Conclusions

Younger physicians and residents and those working in large and hospital-based practices are more likely to use a PDA. The adoption rate is now at its highest rate of increase according to a commonly accepted diffusion of innovations model. A common problem with the evaluation of information technology is that use frequently precedes research. This is the case here, in which PDA adoption rates are already high and projections are for rapid growth in the short term. In general, it appears that professional PDA use in health care settings involves more administrative and organizational tasks than those related to patient care, perhaps signaling where the growth in adoption is most likely to occur. We conclude that physicians are likely accustomed to using a PDA, and, therefore, technology expertise will probably not be a barrier to implementing PDA applications. However, there is an urgent need to evaluate the effectiveness and efficiency of specific tasks using handheld technology to inform those developing and those using PDA applications.

Brief cognitive-behavioral therapy for temporomandibular disorder pain: effects on daily electronic outcome and process measures

We used patient daily electronic ratings of outcome (activity interference, pain intensity, jaw use limitations, negative mood) and process (pain-related beliefs, catastrophizing, and coping) variables to evaluate a brief cognitive-behavioral (CB) treatment for chronic temporomandibular disorder (TMD) pain. TMD clinic patients (N=158) were assigned randomly to four biweekly sessions of either CB pain management training (PMT) or an education/attention control condition [self-care management (SCM)] and were asked to complete electronic interviews three times daily for the 8-week treatment. We analyzed diary data from 126 participants who completed >50% of requested interviews for >6 weeks. Multilevel regression analyses indicated no statistically significant difference between the study groups in rate of within-subject change over time on the daily outcome measures, but consistently greater within-subject improvement in the PMT group on the daily process measures. Significantly (P<0.05) greater proportions of PMT than of SCM patients showed clinically important (>50%) improvement from weeks 1 to 8 in daily activity interference and jaw use limitations. This study is novel in its application of electronic diary methods for assessing outcome and process variables in a chronic pain treatment trial, and supports the feasibility and utility of such methods. The brief CB treatment was efficacious in decreasing catastrophizing and increasing perceived control over pain, and in improving activity interference and jaw use limitations for a subgroup of patients. Longer-term follow-ups are ongoing to determine if there is an impact on outcomes over time.

How useful are the Rome II criteria for identification of upper gastrointestinal disorders in general practice?

OBJECTIVE

The Rome II criteria are a classification of functional gastrointestinal disorders. It is not known whether they can be used as a diagnostic tool. This study evaluates the agreement between GPs and the Rome II criteria on the diagnosis of upper gastrointestinal disorders.

MATERIAL AND METHODS

Consecutive patients with abdominal complaints were included in this pragmatic cross-sectional study. All patients answered a questionnaire based on the Rome II criteria. The diagnoses based on these criteria were compared with the GPs' diagnoses.

RESULTS

A total of 549 consecutively selected patients were included in the study. The agreement between GPs and the Rome II criteria was 65%, kappa 0.34 (CI 0.27-0.41). The agreement was lower when dyspepsia and gastroesophageal reflux/functional heartburn were evaluated separately. The positive and negative predictive values of the Rome II criteria varied between 29-58% and 82-90%, respectively, in various groups of patients with confirmed diagnoses.

CONCLUSIONS

The GPs' diagnoses differed from those based entirely on the Rome II criteria. Strict adherence to the criteria will result in other diseases being disregarded. The diagnoses of upper gastrointestinal disorders should be based on all available information and the Rome II criteria used only as an additional aid to improve the precise classification of functional disorders.

Performance of health status measures with a pen based personal digital assistant

BACKGROUND

Increasing use of self reported health status in clinical practice and research, as well as patient appreciation of monitoring fluctuations of health over time, suggest a need for more frequent collection of data. Electronic use of health status measures in the follow up of patients is a possible way to achieve this.

OBJECTIVE

To compare self reported health status measures in a personal digital assistant (PDA) version and a paper/pencil version for test-retest reliability, agreement between scores, and feasibility.

METHODS

30 patients with stable rheumatoid arthritis (mean age 61.6 years, range 49.8 to 70.0; mean disease duration, 16.7 years; 63% female; 67% rheumatoid factor positive; 46.6% on disease modifying antirheumatic drugs) completed self reported health status measures (pain, fatigue, and global health on visual analogue scales (VAS), rheumatoid arthritis disease activity index, modified health assessment questionnaire, SF-36) in a conventional paper based questionnaire version and on a PDA (HP iPAQ, model h5450). Completion was repeated after five to seven days.

RESULTS

Test-retest reliability was similar, as evaluated by the Bland-Altman approach, the coefficient of variation, and intraclass correlation coefficients. The scores showed acceptable agreement, but with a slight tendency to higher scores on VAS with the PDA than the paper/pencil version. No significant differences were seen for measures of feasibility (time to complete, satisfaction score), but 65.5% preferred PDA, 20.7% preferred paper, and 13.8% had no preference.

CONCLUSIONS

The clinimetric performance of paper/pencil versions of self reported health status measures was similar to an electronic version, using an inexpensive PDA.

Internet in clinical research based on a pilot experience

Computing has become an integral part of many disciplines nowadays, turning it into an evermore necessary working tool. Internet provides a fast and easy way to collect scientific data and is becoming a more and more effective and safe way to transmit data. It is also an efficient means for interaction and information sharing within a work group that provides the necessary flexibility. A pilot project was conducted replacing the traditional hardcopy version of the case report form for an electronic one (e-CRF) and with access to Internet within the Naturalistic Randomized Clinical Trial of the Effectiveness of Olanzapine and Risperidone in the Treatment of Schizophrenia. Carrying out this pilot project has given us the opportunity to determine the advantages electronic data collection (EDC) by Internet has to offer both researchers and sponsors. The results have optimized time management, since it is easier to work in real time; data quality is improved, since intermediates are eliminated, and it facilitates communication amongst the different parties involved in the project. The use of this technology requires updated Internet connections and adequate personal computers, since the possibilities offered by the computer system and high-speed connection are critical in conducting the project. Obviously, this may involve a higher initial investment, but the results have revealed to us that these start-up costs are later offset by lowering personnel costs or by decreasing the number of monitoring visits. On the basis of our experience and that of the participating investigators, certain recommendations for future clinical trials using e-CRF can be made. We will go into these recommendations in greater depth throughout this paper. In short, EDC can dramatically improve the clinical trial process, opening the door to new technologies in the world of clinical research, not only for sponsors, but also for clinicians.

Anaesthesia record system on handheld computers--pilot experience and uses for quality control and clinical guidelines

This paper describes a mobile information system to collect patient information for anesthesia quality control. In this system, a mobile database program was designed for use on handheld computers (Pocket PC). This program is used to collect patient data at the bedside on the handhelds, with a daily synchronization of the data between the anaesthesiologists' handhelds with the anaesthesia database. All collected data are later used for quality control analysis. Furthermore, clinical guidelines will be included on these same handhelds. During the pilot phase, data from a sample set of about 300 patients were incorporated. The processes and interfaces of the system are presented in the paper. The current mobile database system has been designed to replace the original paper-based data collection system. The individual anaesthesiologist's handheld synchronizes patient data daily with anaesthesia database center. This information database is analyzed and used not only to give feedback to the individual doctor or center, but also to review the use of the guidelines provided and the results of their utilization.

Diagnosing irritable bowel syndrome: poor agreement between general practitioners and the Rome II criteria

BACKGROUND

The new guidelines for diagnosing irritable bowel syndrome (IBS) in clinical practice recommend the use of the Rome II criteria. In this study the agreement between general practitioners (GPs) and the Rome II criteria for diagnosing of IBS and functional bowel disorders (FBD) is examined.

METHODS

Consecutive patients in general practice were asked to report on abdominal complaints, for which they had consulted or wanted to consult a GP. Patients with such complaints completed a questionnaire based on the Rome II criteria for FBD. After consultations, the GPs reported their diagnoses on the abdominal complaints.

RESULTS

Of 3097 screened patients, 553 patients were diagnosed by their GP and had complete data in the questionnaire. Of these patients, 107 had IBS according to the GPs and 209 had IBS according to the Rome II criteria (agreement 58%, kappa 0.01 (CI: -0.06; 0.09)). Agreement on IBS and FBD in patients without organic disease, without reflux or dyspepsia and in patients with a verified diagnosis was 45%-58%, with kappa values from -0.02 to 0.13. IBS and FBD cases were diagnosed by the Rome II criteria more often than by the GPs in all these groups of patients (P < 0.001). In patients with diagnostic discrepancies concerning IBS, 'stress-related symptoms' was predictive of a diagnosis of IBS made by the GPs only (OR 2.17 (CI: 1.1; 4.2)).

CONCLUSIONS

This study shows poor agreement in the diagnosis of IBS between GPs and the Rome II criteria. Therefore, current knowledge about IBS based on strict criteria is not necessarily transferable to patients with IBS in general practice.

Can clinical trials requiring frequent participant contact be conducted over the Internet? Results from an online randomized controlled trial evaluating a topical ointment for herpes labialis

Background

The Internet has tremendous appeal for conducting randomized clinical trials and may be especially applicable to trials requiring frequent participant contact. Trials of cold sore remedies, for example, often require daily clinic visits during outbreaks, imposing substantial burden on participants. An Internet-based randomized clinical trial design may reduce this burden, permitting frequent symptom reports with considerably less effort.

Objective

To evaluate the feasibility of a Web-based randomized clinical trial requiring frequent participant interaction, using a 6-month, double-blind, randomized, placebo-controlled pilot trial of a topical ointment containing dioctyl sodium sulfosuccinate (DSS) (Zilex; Meditech Pharmaceuticals, Inc, Scottsdale, Arizona, USA) intended for treatment of recurrent herpes labialis. A secondary objective was to obtain preliminary data on effectiveness outcomes, to assist in planning a fully-powered trial of DSS.

Methods

Adults with physician-confirmed herpes labialis were recruited to apply to the trial. Eligible applicants were randomized to DSS or placebo, mailed to them upon enrolment with instructions to apply topically every 2 hours for the duration of every cold sore outbreak. Participants were instructed to complete online questionnaires at 2-week intervals and, at the initiation of a cold sore, daily "outbreak questionnaires" until outbreak termination. Feasibility outcome measures included trial participant characteristics, frequency of cold sores, participant retention and adherence (to study medication), and data completeness. Treatment effectiveness outcome measures included outbreak duration, days to crust formation, and pain.

Results

Of the 292 individuals applying, 182 screened eligible; 32 participants with confirmed herpes labialis enrolled in the trial. 16 were randomized into the verum group and 16 into the placebo group. 29 (91%) participants completed the trial. During the trial, 34 outbreaks were reported among 23 (72%) participants, resulting in a cold sore incidence rate of 19.8 per 100 person-months of observation. Online data were available for 32 outbreaks; the absence of a resolution date made it impossible to accurately calculate the duration of 12 (38%) outbreaks. Although the DSS treatment group had a shorter mean outbreak duration (6.6 vs 7.7 days, P= .2) and fewer mean days to crust formation (3.5 vs 4.9, P= .1), these differences did not reach statistical significance. The DSS group has statistically significant lower mean pain scores (3.1 vs 7.6, P= .04), but participants in this group also consumed more acetaminophen tablets than the placebo group (1.1 versus 0.5, P=.55). Adherence to medication was similar in both groups: 7 (50%) of the verum group reported using the cream as directed compared to 6 (46.2%) in the placebo group; ( P= .8).

Conclusions

We efficiently recruited participants and achieved high overall retention rates. However, participant adherence to the daily outbreak visit schedules was low and only 7 (50%) participants used the cream as directed. These limitations could be addressed in future Internet-based studies by using Personal Digital Assistants (PDAs), using reminder devices, and providing incentives. By enhancing participant adherence, clinical trials requiring frequent participant contact may be feasible over the Internet.