1
|
Washington P. A Perspective on Crowdsourcing and Human-in-the-Loop Workflows in Precision Health. J Med Internet Res 2024; 26:e51138. [PMID: 38602750 PMCID: PMC11046386 DOI: 10.2196/51138] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2023] [Revised: 11/15/2023] [Accepted: 01/30/2024] [Indexed: 04/12/2024] Open
Abstract
Modern machine learning approaches have led to performant diagnostic models for a variety of health conditions. Several machine learning approaches, such as decision trees and deep neural networks, can, in principle, approximate any function. However, this power can be considered to be both a gift and a curse, as the propensity toward overfitting is magnified when the input data are heterogeneous and high dimensional and the output class is highly nonlinear. This issue can especially plague diagnostic systems that predict behavioral and psychiatric conditions that are diagnosed with subjective criteria. An emerging solution to this issue is crowdsourcing, where crowd workers are paid to annotate complex behavioral features in return for monetary compensation or a gamified experience. These labels can then be used to derive a diagnosis, either directly or by using the labels as inputs to a diagnostic machine learning model. This viewpoint describes existing work in this emerging field and discusses ongoing challenges and opportunities with crowd-powered diagnostic systems, a nascent field of study. With the correct considerations, the addition of crowdsourcing to human-in-the-loop machine learning workflows for the prediction of complex and nuanced health conditions can accelerate screening, diagnostics, and ultimately access to care.
Collapse
Affiliation(s)
- Peter Washington
- Information and Computer Sciences, University of Hawaii at Manoa, Honolulu, HI, United States
| |
Collapse
|
2
|
The comfort of adolescent patients and their parents with mobile sensing and digital phenotyping. COMPUTERS IN HUMAN BEHAVIOR 2023. [DOI: 10.1016/j.chb.2022.107603] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
|
3
|
Baumeister H, Garatva P, Pryss R, Ropinski T, Montag C. Digitale Phänotypisierung in der Psychologie – ein Quantensprung in der psychologischen Forschung? PSYCHOLOGISCHE RUNDSCHAU 2022. [DOI: 10.1026/0033-3042/a000609] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Zusammenfassung. Digitale Phänotypisierung stellt einen neuen, leistungsstarken Ansatz zur Realisierung psychodiagnostischer Aufgaben in vielen Bereichen der Psychologie und Medizin dar. Die Grundidee besteht aus der Nutzung digitaler Spuren aus dem Alltag, um deren Vorhersagekraft für verschiedenste Anwendungsmöglichkeiten zu überprüfen und zu nutzen. Voraussetzungen für eine erfolgreiche Umsetzung sind elaborierte Smart Sensing Ansätze sowie Big Data-basierte Extraktions- (Data Mining) und Machine Learning-basierte Analyseverfahren. Erste empirische Studien verdeutlichen das hohe Potential, aber auch die forschungsmethodischen sowie ethischen und rechtlichen Herausforderungen, um über korrelative Zufallsbefunde hinaus belastbare Befunde zu gewinnen. Hierbei müssen rechtliche und ethische Richtlinien sicherstellen, dass die Erkenntnisse in einer für Einzelne und die Gesellschaft als Ganzes wünschenswerten Weise genutzt werden. Für die Psychologie als Lehr- und Forschungsdomäne bieten sich durch Digitale Phänotypisierung vielfältige Möglichkeiten, die zum einen eine gelebte Zusammenarbeit verschiedener Fachbereiche und zum anderen auch curriculare Erweiterungen erfordern. Die vorliegende narrative Übersicht bietet eine theoretische, nicht-technische Einführung in das Forschungsfeld der Digitalen Phänotypisierung, mit ersten empirischen Befunden sowie einer Diskussion der Möglichkeiten und Grenzen sowie notwendigen Handlungsfeldern.
Collapse
Affiliation(s)
- Harald Baumeister
- Abteilung für Klinische Psychologie und Psychotherapie, Institut für Psychologie und Pädagogik, Universität Ulm, Deutschland
| | - Patricia Garatva
- Abteilung für Klinische Psychologie und Psychotherapie, Institut für Psychologie und Pädagogik, Universität Ulm, Deutschland
| | - Rüdiger Pryss
- Institut für Klinische Epidemiologie und Biometrie, Universität Würzburg, Deutschland
| | - Timo Ropinski
- Arbeitsgruppe Visual Computing, Institut für Medieninformatik, Universität Ulm, Deutschland
| | - Christian Montag
- Abteilung für Molekulare Psychologie, Institut für Psychologie und Pädagogik, Universität Ulm, Deutschland
| |
Collapse
|
4
|
Kuppens P, Dejonckheere E, Kalokerinos EK, Koval P. Some Recommendations on the Use of Daily Life Methods in Affective Science. AFFECTIVE SCIENCE 2022; 3:505-515. [PMID: 36046007 DOI: 10.1007/s42761-022-00101-0] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/11/2021] [Accepted: 01/03/2022] [Indexed: 11/25/2022]
Abstract
Real-world emotions are often more vivid, personally meaningful, and consequential than those evoked in the lab. Therefore, studying emotions in daily life is essential to test theories, discover new phenomena, and understand healthy emotional functioning; in short, to move affective science forward. The past decades have seen a surge of research using daily diary, experience sampling, or ecological momentary assessment methods to study emotional phenomena in daily life. In this paper, we will share some of the insights we have gained from our collective experience applying such daily life methods to study everyday affective processes. We highlight what we see as important considerations and caveats involved in using these methods and formulate recommendations to improve their use in future research. These insights focus on the importance of (i) theory and hypothesis-testing; (ii) measurement; (iii) timescale; and (iv) context, when studying emotions in their natural habitat.
Collapse
Affiliation(s)
| | | | | | - Peter Koval
- KU Leuven, Leuven, Belgium
- University of Melbourne, Melbourne, Australia
| |
Collapse
|
5
|
Biagianti B. What Can Mobile Sensing and Assessment Strategies Capture About Human Subjectivity? Front Digit Health 2022; 4:871133. [PMID: 35493531 PMCID: PMC9051043 DOI: 10.3389/fdgth.2022.871133] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2022] [Accepted: 03/28/2022] [Indexed: 11/13/2022] Open
Affiliation(s)
- Bruno Biagianti
- Department of Pathophysiology and Transplantation, University of Milan, Milan, Italy
- Department of Neurosciences and Mental Health, Fondazione IRCCS Ca' Granda Ospedale Maggiore Policlinico, Milan, Italy
- *Correspondence: Bruno Biagianti
| |
Collapse
|
6
|
Aubourg T, Demongeot J, Provost H, Vuillerme N. Exploitation of Outgoing and Incoming Telephone Calls in the Context of Circadian Rhythms of Social Activity Among Elderly People: Observational Descriptive Study. JMIR Mhealth Uhealth 2020; 8:e13535. [PMID: 33242018 PMCID: PMC7728541 DOI: 10.2196/13535] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2019] [Revised: 06/26/2019] [Accepted: 01/28/2020] [Indexed: 01/07/2023] Open
Abstract
Background In the elderly population, analysis of the circadian rhythms of social activity may help in supervising homebound disabled and chronically ill populations. Circadian rhythms are monitored over time to determine, for example, the stability of the organization of daily social activity rhythms and the occurrence of particular desynchronizations in the way older adults act and react socially during the day. Recently, analysis of telephone call detail records has led to the possibility of determining circadian rhythms of social activity in an objective unobtrusive way for young patients from their outgoing telephone calls. At this stage, however, the analysis of incoming call rhythms and the comparison of their organization with respect to outgoing calls remains to be performed in underinvestigated populations (in particular, older populations). Objective This study investigated the persistence and synchronization of circadian rhythms in telephone communication by older adults. Methods The study used a longitudinal 12-month data set combining call detail records and questionnaire data from 26 volunteers aged 70 years or more to determine the existence of persistent and synchronized circadian rhythms in their telephone communications. The study worked with the following four specific telecommunication parameters: (1) recipient of the telephone call (alter), (2) time at which the call began, (3) duration of the call, and (4) direction of the call. We focused on the following two issues: (1) the existence of persistent circadian rhythms of outgoing and incoming telephone calls in the older population and (2) synchronization with circadian rhythms in the way the older population places and responds to telephone calls. Results The results showed that older adults have their own specific circadian rhythms for placing telephone calls and receiving telephone calls. These rhythms are partly structured by the way in which older adults allocate their communication time over the day. In addition, despite minor differences between circadian rhythms for outgoing and incoming calls, our analysis suggests the two rhythms could be synchronized. Conclusions These results suggest the existence of potential persistent and synchronized circadian rhythms in the outgoing and incoming telephone activities of older adults.
Collapse
Affiliation(s)
- Timothée Aubourg
- Orange Labs, Meylan, France.,Univ Grenoble Alpes, AGEIS, Grenoble, France.,LabCom Telecom4Health, Univ Grenoble Alpes & Orange Labs, Grenoble, France
| | - Jacques Demongeot
- Univ Grenoble Alpes, AGEIS, Grenoble, France.,LabCom Telecom4Health, Univ Grenoble Alpes & Orange Labs, Grenoble, France.,Institut Universitaire de France, Paris, France
| | - Hervé Provost
- Orange Labs, Meylan, France.,LabCom Telecom4Health, Univ Grenoble Alpes & Orange Labs, Grenoble, France
| | - Nicolas Vuillerme
- Univ Grenoble Alpes, AGEIS, Grenoble, France.,LabCom Telecom4Health, Univ Grenoble Alpes & Orange Labs, Grenoble, France.,Institut Universitaire de France, Paris, France
| |
Collapse
|
7
|
Pratap A, Neto EC, Snyder P, Stepnowsky C, Elhadad N, Grant D, Mohebbi MH, Mooney S, Suver C, Wilbanks J, Mangravite L, Heagerty PJ, Areán P, Omberg L. Indicators of retention in remote digital health studies: a cross-study evaluation of 100,000 participants. NPJ Digit Med 2020; 3:21. [PMID: 32128451 PMCID: PMC7026051 DOI: 10.1038/s41746-020-0224-8] [Citation(s) in RCA: 199] [Impact Index Per Article: 49.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2019] [Accepted: 01/17/2020] [Indexed: 12/13/2022] Open
Abstract
Digital technologies such as smartphones are transforming the way scientists conduct biomedical research. Several remotely conducted studies have recruited thousands of participants over a span of a few months allowing researchers to collect real-world data at scale and at a fraction of the cost of traditional research. Unfortunately, remote studies have been hampered by substantial participant attrition, calling into question the representativeness of the collected data including generalizability of outcomes. We report the findings regarding recruitment and retention from eight remote digital health studies conducted between 2014-2019 that provided individual-level study-app usage data from more than 100,000 participants completing nearly 3.5 million remote health evaluations over cumulative participation of 850,000 days. Median participant retention across eight studies varied widely from 2-26 days (median across all studies = 5.5 days). Survival analysis revealed several factors significantly associated with increase in participant retention time, including (i) referral by a clinician to the study (increase of 40 days in median retention time); (ii) compensation for participation (increase of 22 days, 1 study); (iii) having the clinical condition of interest in the study (increase of 7 days compared with controls); and (iv) older age (increase of 4 days). Additionally, four distinct patterns of daily app usage behavior were identified by unsupervised clustering, which were also associated with participant demographics. Most studies were not able to recruit a sample that was representative of the race/ethnicity or geographical diversity of the US. Together these findings can help inform recruitment and retention strategies to enable equitable participation of populations in future digital health research.
Collapse
Affiliation(s)
- Abhishek Pratap
- Sage Bionetworks, Seattle, WA USA
- Department of Biomedical Informatics and Medical Education, University of Washington, Seattle, WA USA
| | | | | | - Carl Stepnowsky
- University of California, San Diego, CA USA
- American Sleep Apnea Association, Washington, DC USA
| | | | - Daniel Grant
- Novartis Pharmaceutical Corporation, East Hanover, NJ USA
| | | | - Sean Mooney
- Department of Biomedical Informatics and Medical Education, University of Washington, Seattle, WA USA
| | | | | | | | | | - Pat Areán
- Department of Psychiatry & Behavioral Sciences, University of Washington, Seattle, WA USA
| | | |
Collapse
|
8
|
Electronic Nose with Digital Gas Sensors Connected via Bluetooth to a Smartphone for Air Quality Measurements. SENSORS 2020; 20:s20030786. [PMID: 32023974 PMCID: PMC7038395 DOI: 10.3390/s20030786] [Citation(s) in RCA: 34] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/20/2019] [Revised: 01/29/2020] [Accepted: 01/30/2020] [Indexed: 11/24/2022]
Abstract
This paper introduces a miniaturized personal electronic nose (39 mm × 33 mm), which is managed through an app developed on a smartphone. The electronic nose (e-nose) incorporates four new generation digital gas sensors. These MOx-type sensors incorporate a microcontroller in the same package, being also smaller than the previous generation. This makes it easier to integrate them into the electronics and improves their performance. In this research, the application of the device is focused on the detection of atmospheric pollutants in order to complement the information provided by the reference stations. To validate the system, it has been tested with different concentrations of NOx including some tests specifically developed to study the behavior of the device in different humidity conditions. Finally, a mobile application has been developed to provide classification services. In this regard, a neural network has been developed, trained, and integrated into a smartphone to process the information retrieved from e-nose devices.
Collapse
|