Performance of health status measures with a pen based personal digital assistant

Measurement Comparability of Electronic and Paper Administration of Visual Analogue Scales: A Review of Published Studies

BACKGROUND

Visual analogue scales (VASs) are used in a variety of patient-, observer- and clinician-reported outcome measures. While typically included in measures originally developed for pen-and-paper completion, a greater number of clinical trials currently use electronic approaches to their collection. This leads researchers to question whether the measurement properties of the scale have been conserved during the migration to an electronic format, particularly because electronic formats often use a different scale length than the 100 mm paper standard.

METHODS

We performed a review of published studies investigating the measurement comparability of paper and electronic formats of the VAS.

RESULTS

Our literature search yielded 26 studies published between 1997 and 2018 that reported comparison of paper and electronic formats using the VAS. After excluding 2 publications, 23 of the remaining 24 studies included in this review reported electronic formats of the VAS (eVAS) and paper formats (pVAS) to be equivalent. A further study concluded that eVAS and pVAS were both acceptable but should not be interchanged. eVAS length varied from 21 to 200 mm, indicating that 100 mm length is not a requirement.

CONCLUSIONS

The literature supports the hypothesis that eVAS and pVAS provide comparable results regardless of the VAS length. When implementing a VAS on a screen-based electronic mode, we recommend following industry best practices for faithful migration to minimise the likelihood of non-comparability with pVAS.

Embodied Conversational Agent Appearance for Health Assessment of Older Adults: Explorative Study

BACKGROUND

Embodied conversational agents (ECAs) have great potential for health apps but are rarely investigated as part of such apps. To promote the uptake of health apps, we need to understand how the design of ECAs can influence the preferences, motivation, and behavior of users.

OBJECTIVE

This is one of the first studies that investigates how the appearance of an ECA implemented within a health app affects users' likeliness of following agent advice, their perception of agent characteristics, and their feeling of rapport. In addition, we assessed usability and intention to use.

METHODS

The ECA was implemented within a frailty assessment app in which three health questionnaires were translated into agent dialogues. In a within-subject experiment, questionnaire dialogues were randomly offered by a young female agent or an older male agent. Participants were asked to think aloud during interaction. Afterward, they rated the likeliness of following the agent's advice, agent characteristics, rapport, usability, and intention to use and participated in a semistructured interview.

RESULTS

A total of 20 older adults (72.2 [SD 3.5] years) participated. The older male agent was perceived as more authoritative than the young female agent (P=.03), but no other differences were found. The app scored high on usability (median 6.1) and intention to use (median 6.0). Participants indicated they did not see an added value of the agent to the health app.

CONCLUSIONS

Agent age and gender little influence users' impressions after short interaction but remain important at first glance to lower the threshold to interact with the agent. Thus, it is important to take the design of ECAs into account when implementing them into health apps.

Electronic Data Capture Versus Conventional Data Collection Methods in Clinical Pain Studies: Systematic Review and Meta-Analysis

BACKGROUND

The most commonly used means to assess pain is by patient self-reported questionnaires. These questionnaires have traditionally been completed using paper-and-pencil, telephone, or in-person methods, which may limit the validity of the collected data. Electronic data capture methods represent a potential way to validly, reliably, and feasibly collect pain-related data from patients in both clinical and research settings.

OBJECTIVE

The aim of this study was to conduct a systematic review and meta-analysis to compare electronic and conventional pain-related data collection methods with respect to pain score equivalence, data completeness, ease of use, efficiency, and acceptability between methods.

METHODS

We searched the Medical Literature Analysis and Retrieval System Online (MEDLINE), Excerpta Medica Database (EMBASE), and Cochrane Central Register of Controlled Trials (CENTRAL) from database inception until November 2019. We included all peer-reviewed studies that compared electronic (any modality) and conventional (paper-, telephone-, or in-person-based) data capture methods for patient-reported pain data on one of the following outcomes: pain score equivalence, data completeness, ease of use, efficiency, and acceptability. We used random effects models to combine score equivalence data across studies that reported correlations or measures of agreement between electronic and conventional pain assessment methods.

RESULTS

A total of 53 unique studies were included in this systematic review, of which 21 were included in the meta-analysis. Overall, the pain scores reported electronically were congruent with those reported using conventional modalities, with the majority of studies (36/44, 82%) that reported on pain scores demonstrating this relationship. The weighted summary correlation coefficient of pain score equivalence from our meta-analysis was 0.92 (95% CI 0.88-0.95). Studies on data completeness, patient- or provider-reported ease of use, and efficiency generally indicated that electronic data capture methods were equivalent or superior to conventional methods. Most (19/23, 83%) studies that directly surveyed patients reported that the electronic format was the preferred data collection method.

CONCLUSIONS

Electronic pain-related data capture methods are comparable with conventional methods in terms of score equivalence, data completeness, ease, efficiency, and acceptability and, if the appropriate psychometric evaluations are in place, are a feasible means to collect pain data in clinical and research settings.

Mobile Health Apps for Self-Management of Rheumatic and Musculoskeletal Diseases: Systematic Literature Review

BACKGROUND

Although the increasing availability of mobile health (mHealth) apps may enable people with rheumatic and musculoskeletal diseases (RMDs) to better self-manage their health, there is a general lack of evidence on ways to ensure appropriate development and evaluation of apps.

OBJECTIVE

This study aimed to obtain an overview on existing mHealth apps for self-management in patients with RMDs, focusing on content and development methods.

METHODS

A search was performed up to December 2017 across 5 databases. For each publication relevant to an app for RMDs, information on the disease, purpose, content, and development strategies was extracted and qualitatively assessed.

RESULTS

Of 562 abstracts, 32 were included in the analysis. Of these 32 abstracts, 11 (34%) referred to an app linked to a connected device. Most of the apps targeted rheumatoid arthritis (11/32, 34%). The top three aspects addressed by the apps were pain (23/32, 71%), fatigue (15/32, 47%), and physical activity (15/32, 47%). The development process of the apps was described in 84% (27/32) of the articles and was of low to moderate quality in most of the cases. Despite most of the articles having been published within the past two years, only 5 apps were still commercially available at the time of our search. Moreover, only very few studies showed improvement of RMD outcome measures.

CONCLUSIONS

The development process of most apps was of low or moderate quality in many studies. Owing to the increasing RMD patients' willingness to use mHealth apps for self-management, optimal standards and quality assurance of new apps are mandatory.

EULAR points to consider for the development, evaluation and implementation of mobile health applications aiding self-management in people living with rheumatic and musculoskeletal diseases

Background

Mobile health applications (apps) are available to enable people with rheumatic and musculoskeletal diseases (RMDs) to better self-manage their health. However, guidance on the development and evaluation of such apps is lacking.

Objectives

The objective of this EULAR task force was to establish points to consider (PtC) for the development, evaluation and implementation of apps for self-management of RMDs.

Methods

A systematic literature review of app content and development strategies was conducted, followed by patient focus group and an online survey. Based on this information and along with task force expert opinion, PtC were formulated in a face-to-face meeting by a multidisciplinary task force panel of experts, including two patient research partners. The level of agreement among the panel in regard to each PtC was established by anonymous online voting.

Results

Three overarching principles and 10 PtC were formulated. Three PtC are related to patient safety, considered as a critical issue by the panel. Three are related to relevance of the content and functionalities. The requirement for transparency around app development and funding sources, along with involvement of relevant health professionals, were also raised. Ease of app access across ages and abilities was highlighted, in addition to considering the cost benefit of apps from the outset. The level of agreement was from 8.8 to 9.9 out of 10.

Conclusion

These EULAR PtC provide guidance on important aspects that should be considered for the development, evaluation and implementation of existing and new apps.

Measurement of equivalence between the web and paper versions of the Japanese Orthopaedic Association Hip Disease Evaluation Questionnaire

Objectives: Digitised patient-reported outcome may be beneficial for physicians and patients. The Japanese Orthopaedic Association Hip Disease Evaluation Questionnaire (JHEQ) can only be completed with paper and pencil (pJHEQ). We newly developed a web version of the JHEQ (wJHEQ). This study aimed to determine whether the scores obtained with the wJHEQ are equivalent to those from the pJHEQ, how much the wJHEQ would decrease missing answers, and which JHEQ the participants preferred to use.Methods: To measure equivalence between the pJHEQ and wJHEQ, we evaluated the mean score difference for each subscale (pain, movement, mental) and Visual Analogue Scale (VAS; satisfaction, right hip pain, left hip pain) and then assessed the intraclass correlation coefficients (ICC) between the two scores. ICC values ≥0.75 were defined as excellent agreement. We used Bland-Altman analysis to assess level of agreement between the values of the two questionnaires. We compared the number of incomplete forms and amount of missing data between the two questionnaires. We investigated ease of use by asking the participants which format was easier to use.Results: This study comprised 113 patients (mean age 58.1 years, 81% female) with hip disease. Mean score differences for each subscale between the wJHEQ and pJHEQ were not significantly different. The values of ICC for each subscale and each VAS were all >0.75. All 113 participants completed the wJHEQ questionnaire, whereas nine patients did not complete the pJHEQ form. There was a significant statistical difference between the completion rate of the wJHEQ and that of the pJHEQ (p = .0017). Fifty-seven participants (55%) preferred the wJHEQ, whereas 33 participants (32%) preferred the pJHEQ.Conclusion: The wJHEQ was found to be equivalent to the original pJHEQ. The wJHEQ significantly decreased the numbers of missing answers and incomplete forms. The participants felt ease of use was nearly equivalent. The wJHEQ might help facilitate more complete assessments in clinical trials and research.

A meta-analytic review of measurement equivalence study findings of the SF-36® and SF-12® Health Surveys across electronic modes compared to paper administration

PURPOSE

Patient-reported outcome (PRO) measures originally developed for paper administration are increasingly being administered electronically in clinical trials and other health research studies. Three published meta-analyses of measurement equivalence among paper and electronic modes aggregated findings across hundreds of PROs, but there has not been a similar meta-analysis that addresses a single PRO, partly because there are not enough published measurement equivalence studies using the same PRO. Because the SF-36(R) Health Survey (SF-36) is a widely used PRO, the aim of this study was to conduct a meta-analysis of measurement equivalence studies of this survey.

METHODS

A literature search of several medical databases used search terms for variations of "SF-36" or "SF-12" and "equivalence" in the title or abstract of English language publications. The eight scale scores and two summary measures of the SF-36 and SF-12 were transformed to norm-based scores (NBS) using developer guidelines. A threshold of within ± 2 NBS points was set as the margin of equivalence. Comprehensive meta-analysis software was used.

RESULTS

Twenty-five studies were included in the meta-analysis. Results indicated that mean differences across domains and summary scores ranged from 0.01 to 0.39 while estimates of agreement ranged from 0.76 to 0.91, all well within the equivalence threshold. Moderator analyses showed that time between administration, survey language, and type of electronic device did not influence equivalence.

CONCLUSIONS

The results of the meta-analysis support equivalence of paper-based and electronic versions of the SF-36 and SF-12 across a variety of disease populations, countries, and electronic modes.

Reliability of a Condensed Computer-Based Patient Outcomes Scoring Tool in Orthopaedic Trauma Patients

OBJECTIVES

To determine the reliability of a condensed computer-based patient-centered outcome score system versus multiple standard uncondensed validated outcome scores used in orthopaedic trauma.

DESIGN

Prospective.

SETTING

Level I Trauma Center.

PATIENTS/PARTICIPANTS

One hundred patients older than 18 years with various orthopaedic injuries were evaluated at a Level I Trauma Clinic.

INTERVENTION

Study participants were randomly assigned to complete the paper-based and computer-based versions of the EQ-5D and musculoskeletal functional assessment at different times during the same visit.

MAIN OUTCOME MEASUREMENTS

Score variability between the computer-based and paper-based versions.

RESULTS

The average score difference between the computer-based and paper-based musculoskeletal functional assessment was 0.50, with an SD of 6.03 and a 95% confidence interval of -0.71 to 1.71. For the EQ-5D, the average score difference was 0.12 with an SD of 0.20 and a 95% confidence interval of -0.05 to 0.05.

CONCLUSIONS

Because patient-centered outcomes drive the direction of orthopaedic care, it is critical to collect patient data efficiently while minimizing responder burden. This condensed web-based adaptive outcome tool reliably produced similar scores when compared with individual paper scores, and it decreased responder burden and error.

Measurement Properties of the NIH-Minimal Dataset Dutch Language Version in Patients With Chronic Low Back Pain

STUDY DESIGN

Validation study with cross-sectional and longitudinal measurements.

OBJECTIVE

To translate the US National Institutes of Health (NIH)-minimal dataset for clinical research on chronic low back pain into the Dutch language and to test its validity and reliability among people with chronic low back pain.

SUMMARY OF BACKGROUND DATA

The NIH developed a minimal dataset to encourage more complete and consistent reporting of clinical research and to be able to compare studies across countries in patients with low back pain. In the Netherlands, the NIH-minimal dataset has not been translated before and measurement properties are unknown.

METHODS

Cross-cultural validity was tested by a formal forward-backward translation. Structural validity was tested with exploratory factor analyses (comparative fit index, Tucker-Lewis index, and root mean square error of approximation). Hypothesis testing was performed to compare subscales of the NIH dataset with the Pain Disability Index and the EurQol-5D (Pearson correlation coefficients). Internal consistency was tested with Cronbach α and test-retest reliability at 2 weeks was calculated in a subsample of patients with Intraclass Correlation Coefficients and weighted Kappa (κω).

RESULTS

In total, 452 patients were included of which 52 were included for the test-retest study.

VALIDITY

factor analysis for structural validity pointed into the direction of a seven-factor model (Cronbach α = 0.78). Factors and total score of the NIH-minimal dataset showed fair to good correlations with Pain Disability Index (r = 0.43-0.70) and EuroQol-5D (r = -0.41 to -0.64). Reliability: test-retest reliability per item showed substantial agreement (κω=0.65). Test-retest reliability per factor was moderate to good (Intraclass Correlation Coefficient = 0.71).

CONCLUSION

The Dutch language version measurement properties of the NIH-minimal were satisfactory.

LEVEL OF EVIDENCE

N/A.

Association of Improvement in Pain With Therapeutic Response as Determined by Individual Improvement Criteria in Patients With Rheumatoid Arthritis

Objective

To use statistical methods to establish a threshold for individual response in patient‐reported outcomes (PROs) in patients with rheumatoid arthritis.

Methods

We used an analysis of variance model in patients on stable therapy (discovery cohort) to establish critical differences (d_crit) for the minimum change associated with a significant individual patient response (beyond normal variation) in the PRO measures of pain (0–10), fatigue (0–10), and function (Funktionsfragebogen Hannover questionnaire; 0–100). We then evaluated PRO responses in patients initiating adalimumab in a noninterventional study (treatment cohort).

Results

In the discovery cohort (n = 700), PROs showed excellent long‐term retest reliability. The minimum change that exceeded random fluctuation was conservatively determined to be 3 points for pain, 4 points for fatigue, and 16 points for function. In the treatment cohort (n = 2,788), 1,483 patients (53.2%) achieved a significant individual therapeutic response as assessed by Disease Activity Score in 28 joints (DAS28)–d_crit (≥1.8 points) after 12 months of adalimumab treatment; 68.5% of patients with a DAS28‐d_crit response achieved a significant improvement in pain, whereas approximately 40% achieved significant improvements in fatigue or function. Significant improvements in all 3 PROs occurred in 22.7% of patients; 22.8% did not have any significant PRO responses. In contrast, significant improvements in all 3 PROs occurred in only 4.4% of 1,305 patients who did not achieve a DAS28‐d_crit response at month 12, and 59.1% did not achieve any significant PRO responses.

Conclusion

The establishment of critical differences in PROs distinguishes true responses from random variation and provides insights into appropriate patient management.

The Psoriatic Arthritis Impact of Disease 12-item questionnaire: equivalence, reliability, validity, and feasibility of the touch-screen administration versus the paper-and-pencil version

BACKGROUND

Over the last few years, there has been a shift toward a more patient-centered perspective of the disease by adopting patient-reported outcomes. Touch-screen formats are increasingly being used for data collection in routine care and research.

OBJECTIVES

The aim of this study is to examine the equivalence, reliability, validity and respondent preference for a computerized touch-screen version of the Psoriatic Arthritis Impact of Disease 12-item (PsAID-12) questionnaire in comparison with the original paper-and-pencil version, in a cohort of patients with psoriatic arthritis (PsA).

METHODS

One hundred and fifty-nine patients with PsA completed both the touch screen- and the conventional paper-and-pencil administered PsAID-12 questionnaire. Agreement between formats was assessed by intraclass correlation coefficients. Spearman's rho correlation coefficient was used to test convergent validity of the touch screen format of PsAID-12, while receiver operating characteristic curve analysis was performed to test discriminant validity. In order to assess the patient's preference, the participants filled in an additional questionnaire. The time taken to complete both formats was measured.

RESULTS

A high concordance between the responses to the two modes of the PsAID-12 tested was found, with no significant mean differences. Intraclass correlation coefficients between data obtained for touch-screen and paper versions ranged from 0.801 to 0.962. There was a very high degree of correlation between the touch-screen format of PsAID-12 and composite disease activity indices (all at a P level <0.0001), Health Assessment Questionnaire, and Physician Assessment of disease activity. The discriminatory power of the touch-screen format of PsAID-12, assessed using the minimal disease activity - Outcome Measurements in Rheumatology Clinical Trials criteria, was very good, with an area under the receiver operating characteristic curve of 0.937 and a resulting cutoff value of 2.5. The touch-screen questionnaire was readily accepted and preferred. The mean time spent for completing the questionnaire on touch screen was 2 minutes and on paper was 2.7 minutes.

CONCLUSION

The touch-screen mode of administration of PsAID-12 can be a feasible and suitable alternative to the paper-and-pencil mode for the assessment of patients with PsA.

Prediction of Remission in a French Early Arthritis Cohort by RAPID3 and other Core Data Set Measures, but Not by the Absence of Rheumatoid Factor, Anticitrullinated Protein Antibodies, or Radiographic Erosions

Objective.

To identify baseline variables that predict remission according to different criteria in rheumatoid arthritis (RA) in a comprehensive French ESPOIR early arthritis database.

Methods.

Individual variables and indices at baseline were analyzed in 664 patients for capacity to predict remission either 6 or 12 months later according to 4 criteria that require a formal joint count: the American College of Rheumatology/European League Against Rheumatism Boolean criteria, the Simplified Disease Activity Index, the Clinical Disease Activity Index, and the 28-joint Disease Activity Score; and 2 remission criteria that do not require a formal joint count: the Routine Assessment of Patient Index Data 3 (RAPID3) and the RAPID3 ≤ 3 + swollen joint, using univariate and multivariate logistic regressions.

Results.

Remission was predicted significantly 6 and/or 12 months later in 26.8%–51.4% of patients, according to all 6 criteria by younger age, low index scores, and better status for the 6/7 clinical RA core dataset measures: tender joint count, swollen joint count (SJC), physician’s global estimate, patient self-report Health Assessment Questionnaire (HAQ) physical function, pain, and patient’s global estimate. Remission was not predicted by the absence of “poor prognosis RA” indicators, rheumatoid factor (RF), anticitrullinated protein antibodies (ACPA), or radiographic erosions. In multivariate regressions that included only 3 variables, low HAQ function predicted remission by all criteria as effectively as SJC, erythrocyte sedimentation rate, or C-reactive protein.

Conclusion.

Younger age and 6 core dataset clinical measures, but not the absence of traditional “poor prognosis RA” indicators, RF, ACPA, or radiographic erosions, predicted remission according to 6 criteria, including 2 without a formal joint count.

Pain Assessment--Can it be Done with a Computerised System? A Systematic Review and Meta-Analysis

Background: Mobile and web technologies are becoming increasingly used to support the treatment of chronic pain conditions. However, the subjectivity of pain perception makes its management and evaluation very difficult. Pain treatment requires a multi-dimensional approach (e.g., sensory, affective, cognitive) whence the evidence of technology effects across dimensions is lacking. This study aims to describe computerised monitoring systems and to suggest a methodology, based on statistical analysis, to evaluate their effects on pain assessment. Methods: We conducted a review of the English-language literature about computerised systems related to chronic pain complaints that included data collected via mobile devices or Internet, published since 2000 in three relevant bibliographical databases such as BioMed Central, PubMed Central and ScienceDirect. The extracted data include: objective and duration of the study, age and condition of the participants, and type of collected information (e.g., questionnaires, scales). Results: Sixty-two studies were included, encompassing 13,338 participants. A total of 50 (81%) studies related to mobile systems, and 12 (19%) related to web-based systems. Technology and pen-and-paper approaches presented equivalent outcomes related with pain intensity. Conclusions: The adoption of technology was revealed as accurate and feasible as pen-and-paper methods. The proposed assessment model based on data fusion combined with a qualitative assessment method was revealed to be suitable. Data integration raises several concerns and challenges to the design, development and application of monitoring systems applied to pain.

Accuracy, Validity, and Reliability of an Electronic Visual Analog Scale for Pain on a Touch Screen Tablet in Healthy Older Adults: A Clinical Trial

Background

New technology for clinical data collection is rapidly evolving and may be useful for both researchers and clinicians; however, this new technology has not been tested for accuracy, reliability, or validity.

Objective

This study aims to test the accuracy of visual analog scale (VAS) for pain on a newly designed application on the iPad (iPadVAS) and measure the reliability and validity of iPadVAS compared to a paper copy (paperVAS).

Methods

Accuracy was determined by physically measuring an iPad scale on screen and comparing it to the results from the program, with a researcher collecting 101 data points. A total of 22 healthy community dwelling older adults were then recruited to test reliability and validity. Each participant completed 8 VAS (4 using each tool) in a randomized order. Reliability was measured using interclass correlation coefficient (ICC) and validity measured using Bland-Altman graphs and correlations.

Results

Of the measurements for accuracy, 64 results were identical, 2 results were manually measured as being 1 mm higher than the program, and 35 as 1 mm lower. Reliability for the iPadVAS was excellent with individual ICC 0.90 (95% CI 0.82-0.95) and averaged ICC 0.97 (95% CI 0.95-1.0) observed. Linear regression demonstrated a strong relationship with a small negative bias towards the iPad (−2.6, SD 5.0) with limits of agreement from −12.4 to 7.1.

Conclusions

The iPadVAS provides a convenient, user-friendly, and efficient way of collecting data from participants in measuring their current pain levels. It has potential use in documentation management and may encourage participatory healthcare.

Trial Registration

Australia New Zealand Clinical Trials Registry (ANZCTR): 367297; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=367297&isReview=true (Archived by Webcite at http://www.webcitation.org/6d9xYoUbD).

Reliability, validity and sensitivity of a computerized visual analog scale measuring state anxiety

BACKGROUND AND OBJECTIVES

Assessment of state anxiety is frequently required in clinical and research settings, but its measurement using standard multi-item inventories entails practical challenges. Such inventories are increasingly complemented by paper-and-pencil, single-item visual analog scales measuring state anxiety (VAS-A), which allow rapid assessment of current anxiety states. Computerized versions of VAS-A offer additional advantages, including facilitated and accurate data collection and analysis, and applicability to computer-based protocols. Here, we establish the psychometric properties of a computerized VAS-A.

METHODS

Experiment 1 assessed the reliability, convergent validity, and discriminant validity of the computerized VAS-A in a non-selected sample. Experiment 2 assessed its sensitivity to increase in state anxiety following social stress induction, in participants with high levels of social anxiety.

RESULTS

Experiment 1 demonstrated the computerized VAS-A's test-retest reliability (r = .44, p < .001); convergent validity with the State-Trait Anxiety Inventory's state subscale (STAI-State; r = .60, p < .001); and discriminant validity as indicated by significantly lower correlations between VAS-A and different psychological measures relative to the correlation between VAS-A and STAI-State. Experiment 2 demonstrated the VAS-A's sensitivity to changes in state anxiety via a significant pre- to during-stressor rise in VAS-A scores (F(1,48) = 25.13, p < .001).

LIMITATIONS

Set-order administration of measures, absence of clinically-anxious population, and gender-unbalanced samples.

CONCLUSIONS

The adequate psychometric characteristics, combined with simple and rapid administration, make the computerized VAS-A a valuable self-rating tool for state anxiety. It may prove particularly useful for clinical and research settings where multi-item inventories are less applicable, including computer-based treatment and assessment protocols. The VAS-A is freely available: http://people.socsci.tau.ac.il/mu/anxietytrauma/visual-analog-scale/.

Collection of patient-reported outcomes;--text messages on mobile phones provide valid scores and high response rates

Background

Patients with inflammatory rheumatic diseases have expressed a need for more frequent measurement of relevant outcomes, due to the variations in their symptoms during the day and from day to day. At present, patient-reported outcomes are extensively collected with questionnaires completed with pen and paper. However, as a measurement tool in frequent data collection the questionnaires are impractical. In contrast, text messages on mobile phones are suitable for frequent data collection.

The aim of this study was two-fold; to compare daily registrations of patient-reported outcomes assessed with text-messages on mobile phones (SMS) or with questionnaires completed with pen and paper (P&P), with regard to scores and variation of scores, and to examine feasibility of the SMS method in a multicentre clinical study.

Methods

To compare scores, 21 patients with an inflammatory, rheumatic disease performed daily assessments of pain, fatigue, stiffness and ability to carry out daily activities on a numeric rating scale (NRS). The patients were asked to assess the variables every other day with the SMS method and every other day with the P&P method for 28 consecutive days. In total each participant had to answer 14 P&P forms and 14 SMS messages. Mean scores and variation, expressed as the pooled standard deviation or as the average range between the maximum and minimum scores for the two methods, were compared using paired sample t-tests or Wilcoxon Signed Rank Test. To examine feasibility, 36 patients with an inflammatory, rheumatic disease assessed the same four variables with SMS twice a week for 35 weeks. Feasibility of the SMS method was expressed as mean response-rate (%) in the total group and per centre.

Results

Mean scores, standard deviation of mean scores and mean range scores did not differ significantly between the two methods (p > 0.05). Response-rate with the SMS method was 97.9% for the whole group and for the three centres 97.1%, 98.3% and 98.4%, respectively.

Conclusion

Outcomes assessed on numeric rating scales and reported with text-messages on mobile phones or with questionnaires completed with pen and paper provide comparable scores. Further, the SMS method provided high response rates (> 97%) in a multicentre setting. Our results encourage the use of text messages on mobile phones in studies requiring frequent data collection and real-time assessment, as in fluctuating diseases such inflammatory, rheumatic diseases.

Hip and knee replacement patients prefer pen-and-paper questionnaires: Implications for future patient-reported outcome measure studies

Objectives

Electronic forms of data collection have gained interest in recent years. In orthopaedics, little is known about patient preference regarding pen-and-paper or electronic questionnaires. We aimed to determine whether patients undergoing total hip (THR) or total knee replacement (TKR) prefer pen-and-paper or electronic questionnaires and to identify variables that predict preference for electronic questionnaires.

Methods

We asked patients who participated in a multi-centre cohort study investigating improvement in health-related quality of life (HRQoL) after THR and TKR using pen-and-paper questionnaires, which mode of questionnaire they preferred. Patient age, gender, highest completed level of schooling, body mass index (BMI), comorbidities, indication for joint replacement and pre-operative HRQoL were compared between the groups preferring different modes of questionnaire. We then performed logistic regression analyses to investigate which variables independently predicted preference of electronic questionnaires.

Results

A total of 565 THR patients and 387 TKR patients completed the preference question. Of the THR patients, 81.8% (95% confidence interval (CI) 78.4 to 84.7) preferred pen-and-paper questionnaires to electronic questionnaires, as did 86.8% (95% CI 83.1 to 89.8) of TKR patients. Younger age, male gender, higher completed level of schooling and higher BMI independently predicted preference of electronic questionnaires in THR patients. Younger age and higher completed level of schooling independently predicted preference of electronic questionnaires in TKR patients.

Conclusions

The majority of THR and TKR patients prefer pen-and-paper questionnaires. Patients who preferred electronic questionnaires differed from patients who preferred pen-and-paper questionnaires. Restricting the mode of patient-reported outcome measures to electronic questionnaires might introduce selection bias.

Cite this article: Bone Joint Res 2013;2:238–44.

Equivalence and measurement properties of an electronic version of the Psoriasis Symptom Inventory

PURPOSE

To evaluate the equivalence of electronic and paper versions of the Psoriasis Symptom Inventory and to examine measurement properties of the electronic version.

METHODS

In a prospective, randomized, crossover, non-interventional study in adult subjects (age ≥18 years) with plaque psoriasis conducted over a period of 15 days, subjects were randomized to two groups, completing either the paper or electronic Psoriasis Symptom Inventory daily for 7 consecutive days followed by the alternate version. Equivalence was assessed by the intraclass correlation coefficient (ICC) between both administration modes. Differences in scores were also tested using paired Student's t test. Measurement properties included internal consistency reliability, test-retest reliability, and convergent and discriminant validity between the Psoriasis Symptom Inventory and (1) disease-specific (Dermatology Life Quality Index) and (2) general health (SF-36v2) status.

RESULTS

Eighty subjects [74 % (59/80) moderate-to-severe psoriasis; 26 % (21/80) mild psoriasis receiving systemic treatment] were enrolled from 8 sites in the USA. The two modes were highly concordant for both total (ICC = 0.97) and individual item scores (ICC range = 0.93-0.97). Response bias testing showed no differences based on completion order with all ICC values >0.91. All mean score differences, except for one item ("flaking"), were non-significant (P > 0.05). Minimum values for reliability (>0.70) and validity (convergent, r ≥ 0.40) were exceeded for the electronic Psoriasis Symptom Inventory.

CONCLUSIONS

Equivalence between paper and electronic versions of the Psoriasis Symptom Inventory and strong measurement properties of the electronic mode indicated a successful migration from paper to electronic format of the Psoriasis Symptom Inventory.

Usability of an innovative and interactive electronic system for collection of patient-reported data in axial spondyloarthritis: comparison with the traditional paper-administered format

OBJECTIVE

To evaluate the validity, in terms of the patients' acceptance, preference, feasibility and reliability of an innovative, interactive computerized system for collection of patient-reported outcome (PRO) data on axial SpA against the paper-and-pencil version.

METHODS

Fifty-five patients with axial SpA completed both the touch screen and the paper-and-pencil set of questionnaires. A computerized touch-screen system, SPEAMonitor, was developed to capture PRO data. Variables recorded included demographic data, patient's assessment of general health status, BASDAI, BASFI, BASMI and acute-phase reactant levels. In order to assess the patient's acceptance of, preference for and feasibility of computer-based questionnaires, the participants filled in an additional questionnaire. The time taken to complete both formats was measured. In a further test-retest study, 25 patients were re-evaluated.

RESULTS

The agreement between the paper-administered and computer touch-screen format of the BASFI, BASDAI questionnaires and the Ankylosing Spondylitis Disease Activity Scores was excellent. Intraclass correlation coefficients (ICCs) between data ranged from 0.90 to 0.96. Additionally the test-retest study showed a very good agreement between the scores for the two administrations (ICC ≥ 0.90). Age, computer experience and education level had no significant impact on the results. The computerized questionnaires were reported to be easier to use. The mean time spent completing the questionnaires on a touch screen was 5.1 min and on paper 7.9 min.

CONCLUSION

Our newly developed computer-assisted touch-screen questionnaires for PRO in axial SpA were well accepted by patients, with good data quality, reliability and score agreement.

A comparison of telephone and paper self-completed questionnaires of main patient-related outcome measures in patients with ankylosing spondylitis and psoriatic arthritis

A cross-sectional study was performed to assess the correlation between telephone and self-administration of patient-related outcomes (PROs) used in the assessment of ankylosing spondylitis (AS) patients. Participants underwent a telephone interview in which the following measures were evaluated: numerical rating scales (NRSs) for global health, pain intensity, global pain, back pain, and back pain at night; BASDI, BASFI, Health Assessment Questionnaire (HAQ), ASQoL, EuroQol, SF-12, and Work Productivity and Activity Impairment (WPAI) questionnaire. Within 48 h after the telephone interview, patients were appointed for a clinical visit in which the same questionnaires and in the same order were self-administered. The degree of correlation of outcomes measures between telephone interview and self-administration was assessed with the intraclass correlation coefficient (ICC). The two modes of assessing PROs were highly reliable, with ICC of 0.81 for BASDAI, 0.82 for BASFI, and 0.75 for HAQ. NRSs for global health, global pain intensity, back pain, and back pain at night also showed ICCs between 0.51 and 0.70, and only NRS for global disease activity showed an ICC of 0.45. This results were similar in patients with AS and patients with psoriatic arthritis. Social functioning and mental health domains of the SF-12 as well as EuroQol had poor correlations. The ICCs for WPAI outcomes were very good or good. We conclude that PROs in AS patients are comparable in both self-administered paper questionnaires and via a telephone interview. Different modes of assessing PRO measures facilitate the assessment of patients with AS in routine practice.

Extensive validation of the pain disability index in 3 groups of patients with musculoskeletal pain

STUDY DESIGN

A cross-sectional study design was performed.

OBJECTIVE

To validate the pain disability index (PDI) extensively in 3 groups of patients with musculoskeletal pain.

SUMMARY OF BACKGROUND DATA

The PDI is a widely used and studied instrument for disability related to various pain syndromes, although there is conflicting evidence concerning factor structure, test-retest reliability, and missing items. Additionally, an official translation of the Dutch language version has never been performed.

METHODS

For reliability, internal consistency, factor structure, test-retest reliability and measurement error were calculated. Validity was tested with hypothesized correlations with pain intensity, kinesiophobia, Rand-36 subscales, Depression, Roland-Morris Disability Questionnaire, Quality of Life, and Work Status. Structural validity was tested with independent backward translation and approval from the original authors.

RESULTS

One hundred seventy-eight patients with acute back pain, 425 patients with chronic low back pain and 365 with widespread pain were included. Internal consistency of the PDI was good. One factor was identified with factor analyses. Test-retest reliability was good for the PDI (intraclass correlation coefficient, 0.76). Standard error of measurement was 6.5 points and smallest detectable change was 17.9 points. Little correlations between the PDI were observed with kinesiophobia and depression, fair correlations with pain intensity, work status, and vitality and moderate correlations with the Rand-36 subscales and the Roland-Morris Disability Questionnaire.

CONCLUSION

The PDI-Dutch language version is internally consistent as a 1-factor structure, and test-retest reliable. Missing items seem high in sexual and professional items. Using the PDI as a 2-factor questionnaire has no additional value and is unreliable.

Can remission in rheumatoid arthritis be assessed without laboratory tests or a formal joint count? possible remission criteria based on a self-report RAPID3 score and careful joint examination in the ESPOIR cohort

OBJECTIVE

To explore 5 possible criteria for remission in rheumatoid arthritis (RA) based on a patient self-report index, the Routine Assessment of Patient Index Data (RAPID3), with a careful joint examination and possible physician global estimate (DOCGL), but without a formal joint count or laboratory test.

METHODS

The ESPOIR early RA cohort of 813 French patients recruited in 2002-2005 was analyzed to identify patients in remission 6 months after enrollment, according to 2 American College of Rheumatology/European League Against Rheumatism (ACR/EULAR) criteria: Boolean ≤ 1 for total tender joint count-28, swollen joint count-28, C-reactive protein, and patient global estimate (PATGL), and Simplified Disease Activity Index (SDAI) ≤ 3.3. Agreement with 7 other remission criteria was analyzed - Disease Activity Score-28 (DAS28) ≤ 2.6, Clinical Disease Activity Index (CDAI) ≤ 2.8, and 5 candidate criteria based on RAPID3, joint examination, and DOCGL: "RAPID3R" (RAPID3 ≤ 3.0); "RAPID3R+SJ1" (RAPID3 ≤ 3.0, ≤ 1 swollen joint); "RAPID3R+SJ1+D1" (RAPID3 ≤ 3.0, ≤ 1 swollen joint, DOCGL ≤ 1); "RAPID3R+SJ0" (RAPID3 ≤ 3.0, 0 swollen joints); and "RAPID3R+SJ0+D1" (RAPID3 ≤ 3.0, 0 swollen joints, DOCGL ≤ 1), according to kappa statistics, sensitivity, and specificity. Residual global, articular, and questionnaire abnormalities according to each criteria set were analyzed.

RESULTS

Among 813 ESPOIR patients, 720 had complete data to compare all 9 possible criteria. Substantial agreement with the Boolean criteria was seen for SDAI, CDAI, RAPID3R+SJ1, RAPID3R+SJ1+D1, RAPID3R+SJ0, and RAPID3R+SJ0+D1 (92.2%-94.7%, kappa 0.67-0.79), versus only moderate agreement for DAS28 or RAPID3R (79.9%-85.8%, kappa 0.46-0.55).

CONCLUSION

Remission according to CDAI and RAPID3R+SJ1, but not DAS28 or RAPID3R, is similar to that of the ACR/EULAR criteria. RAPID3 scores require a complementary careful joint examination for clinical decisions, do not preclude formal joint counts or other indices, and may be useful in busy clinical settings.

Test-retest of computerized health status questionnaires frequently used in the monitoring of knee osteoarthritis: a randomized crossover trial

BACKGROUND

To compare data based on touch screen to data based on traditional paper versions of questionnaires frequently used to examine patient reported outcomes in knee osteoarthritis patients and to examine the impact of patient characteristics on this comparison

METHODS

Participants were recruited from an ongoing trial (http://ClinicalTrials.Gov Identifier: NCT00655941). 20 female participants, mean age 67 (SD 7), completed KOOS, VAS pain, function and patient global, SF-36, Physical Activity Scale, painDETECT, and the ADL Taxonomy. Patients were randomly assigned to one of two subgroups, completing either the paper or touch screen version first. Mean, mean differences (95% CI), median, median differences and Intraclass Correlation Coefficients (ICCs) were calculated for all questionnaires.

RESULTS

ICCs between data based on computerized and paper versions ranged from 0.86 to 0.99. Analysis revealed a statistically significant difference between versions of the ADL Taxonomy, but not for the remaining questionnaires. Age, computer experience or education-level had no significant impact on the results. The computerized questionnaires were reported to be easier to use.

CONCLUSION

The computerized questionnaires gave comparable results to answers given on paper. Patient characteristics did not influence results and implementation was feasible.

Personal digital assistant data capture: the future of quality of life measurement in prostate cancer treatment

PURPOSE

This article examines the potential use of personal digital assistant (PDA) data capture systems for real-time linear monitoring of health-related quality of life (HRQOL) in prostate cancer research and clinical care.

METHODS

We discuss the benefits and potential issues of using PDA data capture in the clinical health care setting. In addition, we describe the development and potential use of a PDA data capture system specific to managing HRQOL in prostate cancer treatment.

CONCLUSION

Follow-up health care clinics require a practical and systematic process of HRQOL data capture and analysis. Traditional paper questionnaire data capture is problematic. Data manipulation required for clinical decision-making is impractical for patient feedback on same-day clinic visits. Furthermore, the process of transforming paper questionnaire data to analysis-quality data can compromise data integrity. In contrast, research findings confirm the acceptability, ease of use, and reliability of PDAs in capturing data across health care settings, including the collection of serial HRQOL data. The main concern for PDA capture systems is the ability to compare respondent's answers between the paper and PDA questionnaire. Other challenges included patients reporting a lack of computer literacy and/or poor eyesight, as well as initial start-up costs. If issues are successfully addressed, the use of a PDA data capture system, such as the PDA HRQOL system at Princess Margaret Hospital's Prostate Centre, allows for valid and economical data collection with the possibility of linear real-time measurement of changes in HRQOL. Accordingly, there appears to be significant potential for PDA data collection of serial HRQOL in prostate cancer clinic settings.

Electronic pain assessment in clinical practice

SUMMARY The assessment and treatment of chronic pain remains an international challenge for healthcare providers among aging patients and rising healthcare costs. This article provides a brief overview of studies on the use of electronic pain diaries and innovative software programs for pain assessment and monitoring among providers and persons with chronic pain. The advent of software pain monitoring programs on smart phones, personal digital assistants and internet-based tracking allow for the collection of large datasets of momentary data to better assist in the management of chronic pain. Electronic tracking in the home and clinic can improve data quality and reduce the biases of recalled information compared with paper diaries and questionnaires. Furthermore, 3D pain mapping programs can enable patients to represent the location and intensity of their pain with greater accuracy. However, despite the benefits, there are a number of barriers to incorporating electronic pain assessment into daily clinical practice. Additional control trials and clinical investigations are needed to demonstrate the efficacy and benefit of electronic pain assessment over and above standard practices.

Comparison of paper and computer-based questionnaire modes for measuring health outcomes in patients undergoing total hip arthroplasty

BACKGROUND

Health status questionnaires are important, especially with the growing interest in outcome studies. However, these questionnaires continue to be administered in their original paper format. We hypothesized that total hip arthroplasty outcome data derived with computer-based questionnaires do not differ significantly from those derived with established paper-based formats.

METHODS

From January 2006 to January 2007, the clinic schedules of four attending arthroplasty surgeons were screened weekly to identify patients who could potentially be included in the study. Charts were reviewed for subjects who were scheduled for or had received primary total hip arthroplasty. Patients were recruited during their office visit or when they attended a preoperative educational class, and five health status questionnaires (the Harris hip score, WOMAC [Western Ontario and McMaster Universities Osteoarthritis Index], SF-36 [Short Form-36], EQ-5D [EuroQol-5D], and UCLA [University of California at Los Angeles] activity score) were administered in three formats: paper, touch screen, and web-based. Repeated-measures analysis of variance and Pearson correlations were used to compare the questionnaire modes for the Harris hip score (normally distributed data), and the Friedman test and Spearman correlations were used to compare the modes for the other health status scores (non-normally distributed data). The study was designed with 90% power for detecting 10% differences between modes in the entire series of sixty-one patients and with 82% and 87% power in preoperative and postoperative subgroups, respectively.

RESULTS

The mean age was sixty-three years, with thirty-seven male and twenty-four female patients in the study. Forty-seven hips (77%) had osteoarthritis as the primary diagnosis. No significant differences were detected, for any of the five health outcome systems, among the paper, touch screen, and web-based modes, and there were highly significant correlations among all questionnaire modes in the entire series of patients and in the preoperative and postoperative subgroups (p < 0.001).

CONCLUSIONS

The scores obtained with the paper, touch screen, and web-based modes of the five questionnaires demonstrated excellent agreement. Thus, touch screen and web-based formats can be used to collect and track patient outcome data. Use of electronic formats of these questionnaires will facilitate a more efficient and reliable data collection process.

The use of the computerized version of quality of life and health status questionnaires in a community sample in southern Brazil

CONTEXT AND OBJECTIVE

Computerized data collection is an efficient process and well accepted by patients with different disorders. Although computer-based systems have been used to assess health status and quality of life in various areas of healthcare, there is a lack of studies to investigate the effectiveness of these instruments in Brazil. The aims here were to assess the usability of the Portuguese-language versions of the Personal Health Scale (PHS) and the Multicultural Quality of Life Index (MQLI) in southern Brazil and to determine the correlation between these two questionnaires.

DESIGN AND SETTING

This was a cross-sectional community-based survey in which participants completed computerized versions of these two questionnaires.

METHODS

In a survey conducted in 16 different locations, 458 volunteers completed both questionnaires. Pearson correlation coefficients were generated between the scores of the two questionnaires. The inclusion criteria allowed all volunteers who were able to understand the questions in both questionnaires to participate in the study.

RESULTS

The percentage of proper data collection via the computerized versions of the two questionnaires combined was 97.45%. A significant correlation (P < 0.01) between the PHS and the MQLI was observed.

CONCLUSION

The computerized versions of the PHS and MQLI demonstrated efficient data collection patterns during the field survey trials. Health-related issues were significantly correlated with the overall experience of wellbeing and quality of life. The computerized versions of the PHS and MQLI are valid tools for research and clinical use in Brazil.

In-clinic use of electronic pain diaries: barriers of implementation among pain physicians

OBJECTIVES

The aim of this study was to examine barriers to the use of electronic diaries within the clinic setting and determine outcome differences between patients who used electronic diaries to monitor their progress with summary data feedback and patients who monitored their progress with paper diaries without summary data feedback.

METHODS

One hundred thirty-four (n=134) chronic pain patients were asked to monitor their pain, mood, activity interference, medication use, and pain location on either a paper or electronic diary immediately before each monthly clinic visit for 10 months. Patients and their treating physicians in the electronic diary group (n=67) were able to observe changes in their ratings whereas patients using the paper diaries (n=67) had no feedback about their data entry.

RESULTS

Most participants believed that completing pain diaries was beneficial; yet, only 23% of patients in the experimental condition felt that the data from the electronic diaries improved their care and less than 15% believed that their doctor made a change in their treatment based on the summary diary information.

CONCLUSION

In general, treating physicians were positive about the use of electronic diaries, although they admitted that they did not regularly incorporate the summary data in their treatment decision making because either they forgot or they were too busy. Future studies in understanding barriers to physicians' and patients' use of diary data to impact treatment outcome are needed to improve care for persons with chronic pain.

Patient-reported 28 swollen and tender joint counts accurately represent RA disease activity and can be used to assess therapy responses at the group level

OBJECTIVE

Formal joint assessments are critically important to improve rheumatological care of patients with RA. The aim of this study was to determine the usefulness of patient-recorded 28 tender joint counts (TJCs) and swollen joint counts (SJCs) using a tablet personal computer and to explore the possibility of using patient-recorded data to calculate 28-joint DAS (DAS-28) and EULAR response.

METHODS

Forty-seven patients were included before initiation of adalimumab therapy and assessed at baseline and after 3 months. SJC and TJC were registered by the patients and thereafter by an experienced rheumatology specialist. Changes were correlated using Spearman's rank correlation test.

RESULTS

The correlations between SJC and TJC derived by the physician and the patient at baseline were excellent (r = 0.78 and 0.87, respectively P < 0.01 for both). After 3 months, the correlations were less strong (0.645 and 0.745, respectively, P < 0.001 for both). When using the patient-derived SJC/TJC for calculation of the DAS-28 (patDAS-28), similar values were obtained, and correlations between DAS-28 and patDAS-28 were excellent (r = 0.91 at baseline, r = 0.90 at 3 months). According to the EULAR response criteria, the percentage of responders at the group level was nearly identical, although there was some disagreement at the individual level when DAS-28 and patDAS-28 were used to determine response to therapy.

CONCLUSION

Patient-reported SJC and TJC can in research settings be used instead of physician-reported ones. Patient-derived SJC and TJC may also make it possible for rheumatologists to obtain quantitative joint count recordings much more frequently than is feasible for traditional joint counts.

Osteoarthritis Index delivered by mobile phone (m-WOMAC) is valid, reliable, and responsive

OBJECTIVES

To evaluate the validity, reliability, responsiveness, and mode preference of electronic data capture (EDC) using the Western Ontario and McMaster (WOMAC) numerical rating scale (NRS) 3.1 Osteoarthritis (OA) Index on Motorola V3 mobile phones.

STUDY DESIGN AND SETTING

Patients with OA undergoing hip or knee joint replacement were assessed preoperatively and 3-4 months postoperatively, completing the WOMAC Index in paper (p-WOMAC) and electronic (m-WOMAC) format in random order.

RESULTS

Data were successfully and securely transmitted from patients in Australia to a server in the United States. Pearson correlations between the summated total index scores (TISs) for the p-WOMAC and m-WOMAC pre- and postsurgery were 0.98 and 0.99 (P<0.0001). There were no clinically important or statistically significant between-method differences in the adjusted total summated scores, pre- and postsurgery (adjusted mean differences=4.44, P=0.474 and 1.73, P=0.781, respectively). Internal consistency estimates of m-WOMAC reliability were 0.87-0.98. The m-WOMAC detected clinically important, statistically significant (P<0.0001) improvements in pain, stiffness, function, and TIS. No statistically significant differences in mode preference were detected.

CONCLUSIONS

There was close agreement and no significant differences between m-WOMAC and p-WOMAC scores. This study confirms the validity, reliability, and responsiveness of the Exco InTouch-engineered, Java-based m-WOMAC Index application. EDC with the m-WOMAC Index provides unique opportunities for using quantitative measurement in clinical research and practice.

Validation of an electronic version of the Mini Asthma Quality of Life Questionnaire

BACKGROUND

The Mini Asthma Quality of Life Questionnaire (MiniAQLQ) is a validated disease-specific quality of life (QOL) paper (p) questionnaire. Electronic (e) versions enable inclusion of asthma QOL in electronic medical records and research databases.

PURPOSE

To validate an e-version of the MiniAQLQ, compare time required for completion of e- and p-versions, and determine which version participants prefer.

METHODS

Adults with stable asthma were randomized to complete either the e- or p-MiniAQLQ, followed by a 2-h rest period before completing the other version. Agreement between versions was measured using the intraclass correlation coefficient (ICC) and Bland-Altman analysis.

RESULTS

Two participants with incomplete p-MiniAQLQ responses were excluded. Forty participants (85% female; age 47.7 +/- 14.9 years; asthma duration 22.6 +/- 16.1 years; FEV(1) 87.1 +/- 21.6% predicted) with both AQLQ scores <6.0 completed the study. Agreement between e- and p-versions for the overall score was acceptable (ICC=0.95) with no bias (difference (Delta) p-e=0.1; P=0.21). ICCs for the symptom, activity limitation, emotional function and environmental stimuli domains were 0.94, 0.89, 0.90, and 0.91 respectively. A small but significant bias (Delta=0.3; P=0.004) was noted in the activity limitation domain. Completion time was significantly longer for the e-version (3.8 +/- 1.9min versus 2.7 +/- 1.1min; P<0.0001). The majority of patients (57.5%) preferred the e-MiniAQLQ; 35% had no preference.

CONCLUSION

This e-version of the MiniAQLQ is valid and was preferred by most participants despite taking slightly longer to complete. Generalizabilty may be limited in younger (12-17) and older (>65) adults.

An open-source, self-explanatory touch screen in routine care. Validity of filling in the Bath measures on Ankylosing Spondylitis Disease Activity Index, Function Index, the Health Assessment Questionnaire and Visual Analogue Scales in comparison with paper versions

OBJECTIVE

The Danish DANBIO registry has developed open-source software for touch screens in the waiting room. The objective was to assess the validity of outcomes from self-explanatory patient questionnaires on touch screen in comparison with the traditional paper form in routine clinical care.

METHODS

Fifty-two AS patients and 59 RA patients completed Visual Analogue Scales (VASs) for pain, fatigue and global health, and Bath measures on Ankylosing Spondylitis Disease Activity Index (BASDAI) and Function Index (BASFI) (AS patients) or HAQs (RA patients) on touch screen and paper form in random order with a 1-h interval. Intra-class correlation coefficients (ICCs), 95% CIs and smallest detectable differences (SDDs) were calculated.

RESULTS

ICC ranged from 0.922 to 0.988 (P < 0.001). The mean differences (95% CI) were: BASDAI [-0.5 (-14.5, 13.5) mm]; BASFI [-1.1 (-10.6, 8.4) mm]; Item 5 [-1.7 (-23.6, 20.2) mm] and Item 6 [-0.7 (-14.7, 13.3) mm] from BASDAI; HAQ score [0.023 (-0.183, 0.229)]. For VAS -0.4 to -2.8 mm (no significance for all except VAS global and VAS fatigue in RA). SDD for BASDAI was 14.0 mm; BASFI 9.5 mm; Item 5 21.8 mm; Item 6 14.0 mm; HAQ 0.206; VAS 11.1-18.8 mm.

CONCLUSIONS

Self-explanatory touch screens based on the DANBIO open-source system generates valid results in AS and RA patients on completion of BASDAI, BASFI, HAQ and VAS scores for pain, fatigue and global health when compared with the traditional paper form. Implementation of touch screens in clinical practice is feasible and patients need no instruction.

Does the weather really matter? A cohort study of influences of weather and solar conditions on daily variations of joint pain in patients with rheumatoid arthritis

OBJECTIVE

To explore how reported joint pain in patients with rheumatoid arthritis (RA) relates to weather and solar variables.

METHODS

A prospective cohort study was conducted in Norway on 36 patients with stable RA. Daily reports of pain in the morning on a visual analog scale for 84 consecutive days were correlated (using time-series methodology) with records of atmospheric and solar variables for the same days.

RESULTS

Pain was significantly associated with 3 or more external variables in 6 (17%) of the patients, with 1 or 2 external variables in 16 (44%) of the patients, and no associations were observed in 14 (39%) of the patients. The multivariate model explained between 19% and 64% of the variance in pain (R(2)) in the patients with associations to at least 3 weather/solar variables. The patients differed in the variables they responded to and in which direction, except for consistent negative associations between pain and ultraviolet light dose, and between pain and solar radio flux/sunspot count. The associations were mostly with same-day weather, but also lagged up to 3 days. We were not able to fit a statistically significant model at the group level.

CONCLUSION

Weather sensitivity seems to be a continuum and a highly individual phenomenon in patients with RA. In the present sample, pain was significantly associated with 3 or more weather variables in 1 out of 6 patients, for whom the magnitude of weather sensitivity might significantly influence pain reporting in clinical care and research.

Development and preliminary testing of a computerized adaptive assessment of chronic pain

The aim of this article is to report the development and preliminary testing of a prototype computerized adaptive test of chronic pain (CHRONIC PAIN-CAT) conducted in 2 stages: (1) evaluation of various item selection and stopping rules through real data-simulated administrations of CHRONIC PAIN-CAT; (2) a feasibility study of the actual prototype CHRONIC PAIN-CAT assessment system conducted in a pilot sample. Item calibrations developed from a US general population sample (N = 782) were used to program a pain severity and impact item bank (kappa = 45), and real data simulations were conducted to determine a CAT stopping rule. The CHRONIC PAIN-CAT was programmed on a tablet PC using QualityMetric's Dynamic Health Assessment (DYHNA) software and administered to a clinical sample of pain sufferers (n = 100). The CAT was completed in significantly less time than the static (full item bank) assessment (P < .001). On average, 5.6 items were dynamically administered by CAT to achieve a precise score. Scores estimated from the 2 assessments were highly correlated (r = .89), and both assessments discriminated across pain severity levels (P < .001, RV = .95). Patients' evaluations of the CHRONIC PAIN-CAT were favorable.

PERSPECTIVE

This report demonstrates that the CHRONIC PAIN-CAT is feasible for administration in a clinic. The application has the potential to improve pain assessment and help clinicians manage chronic pain.

The development and evaluation of a PDA-based method for public health surveillance data collection in developing countries

BACKGROUND AND PURPOSE

EpiData and Epi Info are often used together by public health agencies around the world, particularly in developing countries, to meet their needs of low-cost public health data management; however, the current open source data management technology lacks a mobile component to meet the needs of mobile public health data collectors. The goal of this project is to explore the opportunity of filling this gap through developing and trial of a personal digital assistant (PDA) based data collection/entry system. It evaluated whether such a system could increase efficiency and reduce data transcription errors for public surveillance data collection in developing countries represented by Fiji.

METHODS

A generic PDA-based data collection software eSTEPS was developed. The software and the data collected using it directly interfaces with EpiData. A field trial was conducted to test the viability of public health surveillance data collection using eSTEPS. The design was a randomised, controlled trial with cross-over design. 120 participants recruited from the Fiji School of Medicine were randomly assigned to be interviewed by one of six interviewers in one of the two ways: (1) paper-based survey followed by PDA survey and (2) PDA survey followed by paper-based survey. Data quality was measured by error rates (logical range errors/inconsistencies, skip errors, missing values, date or time field errors and incorrect data type). Work flow and cost were evaluated in three stages of the survey process: (1) preparation of data collection instrument, (2) data collection and (3) data entry, validation and cleaning. User acceptance was also evaluated in the two groups of participants: (1) data collectors and (2) survey participants.

RESULTS

None of the errors presented in 20.8% of the paper questionnaires was found in the data set collected using PDA. Sixty-two percent of the participants perceived that the PDA-based questionnaire took less time to complete. Data entry, validation and cleaning for the PDA-based data collection from 120 participants took a total of 1.5h, a 93.26% reduction of time from 20.5h required using paper and pen. The cost is also significantly reduced with PDA-based protocol. Both data collectors and participants prefer to use PDA instead of paper for data collection. The trial results prove that eSTEPS is a feasible solution for public health surveillance data collection in the field. Several deficiencies of the software were also identified and would be addressed in the next version.

CONCLUSION

eSTEPS offers the potential to meet the need for an effective mobile public health data collection tool for use in the field. The eSTEPS field trial proves that PDA was more efficient than paper for public health survey data collection. It also significantly reduced errors in data entry. The later benefit was derived from the software providing its users with the flexibility of building their own constraints to control the data type, range and logic of data entry.