Factors Associated with Daily Completion Rates in a Smartphone-Based Ecological Momentary Assessment Study

Data Completeness and Concordance in the FeverApp Registry: Comparative Study

BACKGROUND

The FeverApp registry uses ecological momentary assessment (EMA) to collect parental data on pediatric fever for scientific research. The mobile app FeverApp educates parents on safe fever management and serves as a fever diary.

OBJECTIVE

The focus of this study was to evaluate the completeness and concordance of the EMA-based FeverApp registry with regard to its data quality from a multilevel perspective.

METHODS

Structured descriptions of fever episodes by health care professionals from an office were used as reference. The number of children, their sociodemographic data, and agreement of fever episodes, with maximum temperature, intake of antipyretics and antibiotics, and physician visits, were compared with the entries in the corresponding physician's reference records. The data quality indicators for completeness, meaning the extent to which the necessary data for the registry has actually been submitted, and concordance, which is the correspondence of the value of a data element with a reference source, were chosen to analyze whether EMA may be a suitable method for this kind of registry.

RESULTS

In both data sources, 1012 children were available for comparison over 16 months. The completeness of gender (1012/1012, 100%) and date of birth (1004/1012, 99.2%) information was high, and the mismatches were 0.69% (7/1012) and 1.19% (12/1012), respectively, between the sources. Of these 1012 children, 668 (66%) registered fever episodes in FeverApp. They relate to 534 families with 953 fever episodes in the reference records and 1452 episodes in the FeverApp registry. Of the 534 families, 183 (34.3%) refrained from visiting the office during fever episodes but nevertheless documented them in FeverApp. Largest part (766/1452, 52.75%) episodes were recorded exclusively in the FeverApp registry by 371 (371/534, 69.5%) families. The remaining 686 (47.2%) episodes of 391 (58.5%) children from 351 (65.7%) families were comparable with the reference data source in terms of physician visits, medication, and temperature. The completeness ranged, depending on the kind of variable, from 11.5% to 65% in the registry and from 7.6% to 42.6% in the office. The 953 fever episodes reported by the reference office consisted of 681 (71.5%) acute and 272 (28.5%) past episodes. In FeverApp, most past (262/272, 96.3%) but less acute (424/681, 62.3%) episodes have been entered. The concordance rates were varied: 90.2% for antibiotic use, 66.6% for antipyretic use, 61.7% for physician visits, and 16% for the highest temperature during the fever episode.

CONCLUSIONS

Both sources delivered only partial data, and the rates of completeness and concordance depended on the kind of variable. However, the FeverApp registry showed higher documentation and precision rates than professional records for all considered variables. Therefore, EMA may play a unique supplement for research in ambulatory care. FeverApp could support pediatric offices, especially during the pandemic.

Designing Studies to Inform Tobacco Harm Reduction: Learnings From an Oral Nicotine Pouch Actual Use Pilot Study

Background

Introduction of new tobacco products in the United States, including those that may be lower on the risk continuum than traditional combustible cigarettes, requires premarket authorization by the US Food and Drug Administration and information on the potential impact of the products on consumer behaviors. Efficient recruitment and data capture processes are needed to collect relevant information in a near-to-real-world environment.

Objective

The aim of this pilot study was to develop and test a protocol for an actual use study of a new tobacco product. The product included in this study was a commercially available oral nicotine pouch. Through the process of study design and execution, learnings were garnered to inform the design, execution, analysis, and report writing of future full-scale actual use studies with tobacco products.

Methods

A small sample (n=100) of healthy adult daily smokers of 7 or more cigarettes per day were recruited to participate in an 8-week prospective observational study conducted at 4 geographically dispersed sites in the United States. A smartphone-based customized electronic diary (eDiary) was employed to capture daily tobacco product use, including 1 week of baseline smoking and 6 weeks during which participants were provided with oral nicotine pouches for use as desired.

Results

Online screening procedures with follow-up telephone interviews and on-site enrollment were successfully implemented. Of 100 participants, 97 completed the study, with more than half (59/99, 60%) identifying as dual- or poly-users of cigarettes and other types of tobacco products at baseline. There was more than 90% (91-93/99, 92%-94%) compliance with daily eDiary reporting, and the majority (92/99, 93%) of participants expressed satisfaction with the study processes. Product use data from the eDiary indicated that after an initial period of trial use, pouches per day increased among those continuing to use the products, while per day average cigarette consumption decreased for 82% (79/97) of all study participants. At the end of the week 6, 16% (15/97) of participants had reduced their cigarette consumption by more than half.

Conclusions

The design of this study, including recruiting, enrollment, eDiary use, and oversight, was successfully implemented through the application of a detailed protocol, a user-friendly eDiary, electronically administered questionnaires, and remote monitoring procedures. High-resolution information was obtained on prospective changes in tobacco product use patterns in the context of availability of a new tobacco product. Future, larger actual use studies will provide important evidence supporting the role that alternatives to combustible cigarettes may play in smoking reduction and/or cessation and lowering the population health burden of tobacco and nicotine-containing products.

A systematic review of engagement reporting in remote measurement studies for health symptom tracking

Remote Measurement Technologies (RMTs) could revolutionise management of chronic health conditions by providing real-time symptom tracking. However, the promise of RMTs relies on user engagement, which at present is variably reported in the field. This review aimed to synthesise the RMT literature to identify how and to what extent engagement is defined, measured, and reported, and to present recommendations for the standardisation of future work. Seven databases (Embase, MEDLINE and PsycINFO (via Ovid), PubMed, IEEE Xplore, Web of Science, and Cochrane Central Register of Controlled Trials) were searched in July 2020 for papers using RMT apps for symptom monitoring in adults with a health condition, prompting users to track at least three times during the study period. Data were synthesised using critical interpretive synthesis. A total of 76 papers met the inclusion criteria. Sixty five percent of papers did not include a definition of engagement. Thirty five percent included both a definition and measurement of engagement. Four synthetic constructs were developed for measuring engagement: (i) engagement with the research protocol, (ii) objective RMT engagement, (iii) subjective RMT engagement, and (iv) interactions between objective and subjective RMT engagement. The field is currently impeded by incoherent measures and a lack of consideration for engagement definitions. A process for implementing the reporting of engagement in study design is presented, alongside a framework for definition and measurement options available. Future work should consider engagement with RMTs as distinct from the wider eHealth literature, and measure objective versus subjective RMT engagement.Registration: This review has been registered on PROSPERO [CRD42020192652].

Distinguishing between rumination and intrusive memories in PTSD using a wearable self-tracking instrument: a proof-of-concept case study

Rumination has been shown to play a part in post-traumatic stress disorder (PTSD), but its relation to the intrusions characteristic of PTSD has mainly been investigated experimentally. This proof-of-concept case study explored the occurrence, personal experiences, and possible relation between rumination and intrusions in two PTSD patients in their daily living using a mixed method approach. A novel wearable self-tracking instrument was employed which provided fine-grained temporal resolution of observation data and could eliminate recall bias. Furthermore, quantitative and qualitative data were collected on participants’ symptoms, rumination and experiences of using the self-tracking instrument. First, without distinguishing between the two phenomena, the participants tracked both for a week. After receiving psychoeducational training for distinguishing between rumination and intrusions, the differentiated phenomena were tracked for a week. Both participants reported being subjectively able to distinguish between rumination and intrusions and made observations with high adherence during the project. Data hinted at a possible temporal relation between the phenomena in line with theories posing rumination as a maladaptive coping strategy as well as an exacerbator of PTSD symptoms. However, relations to mood were inconclusive. Furthermore, by using the self-tracking instrument, participants gained a heightened awareness of the characteristics of rumination and intrusions and contextual cues for occurrence, as well as a greater sense of momentary agency. Results reveal promising prospects in using the wearable self-tracking instrument for further investigation of the relation between rumination and intrusions in the lived lives of PTSD patients, as well as potential for incorporating this method in clinical treatment.

Key learning aims

(1)

Evaluating real-time momentary stress and affect in police officers using a smartphone application

Background

Police officers work under stressful conditions, and the resulting occupational stress may impact their health and well-being through changes in positive affect (PA) and negative affect (NA). It is therefore important to assess officers’ stress, PA, and NA while it is experienced. This study evaluates police officers’ momentary stress and affect in real-world settings using an ecological momentary assessment, and examines the within-person (W) and between-person (B) factors that influence momentary affect.

Methods

Eighty-nine police officers were recruited in South Korea. Participants completed questionnaires about their momentary stress and affect using a smartphone application. The associations between momentary stress, momentary contextual environment, momentary PA, and momentary NA were examined using mixed modeling.

Results

Social overload (W: -.37), work discontent (W: −.45, B: −.73), social tension (W: −.79, B: −.67), and pressure to perform (W: −.29, B: −.49) were significantly associated with lower PA. Work overload (B: .33) and social isolation(W: .48, B: .31) were significantly associated with higher PA. Being with family (W: .71, B: .91) and friends (W: 1.89, B: 2.45) were significantly associated with higher PA. Being at home or other places away from the work place were significantly associated with higher PA (W: 1.01) and when patrolling or investigating were associated with lower PA (B: − 1.13). Lack of social recognition (W: 1.74, B: 2.33), work discontent (W: 1.59, B: 1.88), social tension (W: 1.74, B: 2.92), and pressure to perform (W: .78, B: 1.92) were significantly associated with higher NA. Being with colleagues (W: − 1.43), family (W: -1.38, B: − 2.66) and friends (W: -1.78, B: − 2.45) were associated with lower NA.

Conclusions

Momentary within-person and between-person stress factors and contextual factors influenced police officers’ momentary affect. These factors should be considered when developing interventions to mitigate stress and improve affect in police officers.