1
|
Dunlop E, Ferguson A, Mueller T, Baillie K, Laskey J, Clarke J, Kurdi A, Wales A, Connolly T, Bennie M. Involving Patients and Clinicians in the Design of Wireframes for Cancer Medicines Electronic Patient Reported Outcome Measures in Clinical Care: Mixed Methods Study. JMIR Form Res 2023; 7:e48296. [PMID: 38127422 PMCID: PMC10767627 DOI: 10.2196/48296] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2023] [Revised: 09/28/2023] [Accepted: 11/22/2023] [Indexed: 12/23/2023] Open
Abstract
BACKGROUND Cancer treatment is a key component of health care systems, and the increasing number of cancer medicines is expanding the treatment landscape. However, evidence of the impact on patients has been focused more on chemotherapy toxicity and symptom control and less on the effect of cancer medicines more broadly on patients' lives. Evolving electronic patient-reported outcome measures (ePROMs) presents the opportunity to secure early engagement of patients and clinicians in shaping the collection of quality-of-life metrics and presenting these data to better support the patient-clinician decision-making process. OBJECTIVE The aim of this study was to obtain initial feedback from patients and clinicians on the wireframes of a digital solution (patient app and clinician dashboard) for the collection and use of cancer medicines ePROMs. METHODS We adopted a 2-stage, mixed methods approach. Stage 1 (March to June 2019) consisted of interviews and focus groups with cancer clinicians and patients with cancer to explore the face validity of the wireframes, informed by the technology acceptance model constructs (perceived ease of use, perceived usefulness, and behavioral intention to use). In stage 2 (October 2019 to February 2020), the revised wireframes were assessed through web-based, adapted technology acceptance model questionnaires. Qualitative data (stage 1) underwent a framework analysis, and descriptive statistics were performed on quantitative data (stage 2). Clinicians and patients with cancer were recruited from NHS Greater Glasgow & Clyde, the largest health board in Scotland. RESULTS A total of 14 clinicians and 19 patients participated in a combination of stage 1 interviews and focus groups. Clinicians and patients indicated that the wireframes of a patient app and clinician dashboard for the collection of cancer medicines ePROMs would be easy to use and could focus discussions, and they would be receptive to using such tools in the future. In stage 1, clinicians raised the potential impact on workload, and both groups identified the need for adequate IT skills to use each technology. Changes to the wireframes were made, and in stage 2, clinicians (n=8) and patients (n=16) indicated it was "quite likely" that the technologies would be easy to use and they would be "quite likely" to use them in the future. Notably, clinicians indicated that they would use the dashboard to enable treatment decisions "with around half" of their patients. CONCLUSIONS This study emphasizes the importance of consulting both patients and clinicians in the design of digital solutions. The wireframes were perceived positively by patients and clinicians who were willing to use such technologies if available in the future as part of routine care. However, challenges were raised, and some differences were identified between participant groups, which warrant further research.
Collapse
Affiliation(s)
- Emma Dunlop
- Strathclyde Institute of Pharmacy & Biomedical Sciences, University of Strathclyde, Glasgow, United Kingdom
| | - Aimee Ferguson
- Strathclyde Institute of Pharmacy & Biomedical Sciences, University of Strathclyde, Glasgow, United Kingdom
| | - Tanja Mueller
- Strathclyde Institute of Pharmacy & Biomedical Sciences, University of Strathclyde, Glasgow, United Kingdom
| | | | | | - Julie Clarke
- NHS Greater Glasgow & Clyde, Glasgow, United Kingdom
| | - Amanj Kurdi
- Strathclyde Institute of Pharmacy & Biomedical Sciences, University of Strathclyde, Glasgow, United Kingdom
- Department of Pharmacology, College of Pharmacy, Hawler Medical University, Erbil, Iraq
- Department of Clinical Pharmacy, College of Pharmacy, Al-Kitab University, Kirkuk, Iraq
| | - Ann Wales
- NHS Healthcare Improvement Scotland, Glasgow, United Kingdom
| | | | - Marion Bennie
- Strathclyde Institute of Pharmacy & Biomedical Sciences, University of Strathclyde, Glasgow, United Kingdom
| |
Collapse
|
2
|
Sadhu S, Solanki D, Brick LA, Nugent NR, Mankodiya K. Designing a Clinician-Centered Wearable Data Dashboard (CarePortal): Participatory Design Study. JMIR Form Res 2023; 7:e46866. [PMID: 38051573 PMCID: PMC10731575 DOI: 10.2196/46866] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2023] [Revised: 08/31/2023] [Accepted: 09/08/2023] [Indexed: 12/07/2023] Open
Abstract
BACKGROUND The recent growth of eHealth is unprecedented, especially after the COVID-19 pandemic. Within eHealth, wearable technology is increasingly being adopted because it can offer the remote monitoring of chronic and acute conditions in daily life environments. Wearable technology may be used to monitor and track key indicators of physical and psychological stress in daily life settings, providing helpful information for clinicians. One of the key challenges is to present extensive wearable data to clinicians in an easily interpretable manner to make informed decisions. OBJECTIVE The purpose of this research was to design a wearable data dashboard, named CarePortal, to present analytic visualizations of wearable data that are meaningful to clinicians. The study was divided into 2 main research objectives: to understand the needs of clinicians regarding wearable data interpretation and visualization and to develop a system architecture for a web application to visualize wearable data and related analytics. METHODS We used a wearable data set collected from 116 adolescent participants who experienced trauma. For 2 weeks, participants wore a Microsoft Band that logged physiological sensor data such as heart rate (HR). A total of 834 days of HR data were collected. To design the CarePortal dashboard, we used a participatory design approach that interacted directly with clinicians (stakeholders) with backgrounds in clinical psychology and neuropsychology. A total of 8 clinicians were recruited from the Rhode Island Hospital and the University of Massachusetts Memorial Health. The study involved 5 stages of participatory workshops and began with an understanding of the needs of clinicians. A User Experience Questionnaire was used at the end of the study to quantitatively evaluate user experience. Physiological metrics such as daily and hourly maximum, minimum, average, and SD of HR and HR variability, along with HR-based activity levels, were identified. This study investigated various data visualization graphing methods for wearable data, including radar charts, stacked bar plots, scatter plots combined with line plots, simple bar plots, and box plots. RESULTS We created a CarePortal dashboard after understanding the clinicians' needs. Results from our workshops indicate that overall clinicians preferred aggregate information such as daily HR instead of continuous HR and want to see trends in wearable sensor data over a period (eg, days). In the User Experience Questionnaire, a score of 1.4 was received, which indicated that CarePortal was exciting to use (question 5), and a similar score was received, indicating that CarePortal was the leading edge (question 8). On average, clinicians reported that CarePortal was supportive and can be useful in making informed decisions. CONCLUSIONS We concluded that the CarePortal dashboard integrated with wearable sensor data visualization techniques would be an acceptable tool for clinicians to use in the future.
Collapse
Affiliation(s)
- Shehjar Sadhu
- University of Rhode Island, Kingston, RI, United States
| | | | | | | | | |
Collapse
|
3
|
McDonald IR, Blocker ES, Weyman EA, Smith N, Dwyer AA. What Are the Best Practices for Co-Creating Patient-Facing Educational Materials? A Scoping Review of the Literature. Healthcare (Basel) 2023; 11:2615. [PMID: 37830651 PMCID: PMC10572900 DOI: 10.3390/healthcare11192615] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2023] [Revised: 09/13/2023] [Accepted: 09/21/2023] [Indexed: 10/14/2023] Open
Abstract
Co-creating patient-facing educational materials (PEMs) can enhance person-centered care by responding to patient priorities and unmet needs. Little data exist on 'best practices' for co-creation. We followed the Arksey and O'Malley framework to conduct a systematic literature search of nine databases (MEDLINE, PubMed, EMBASE, CINAHL, PsycINFO, Web of Science, Cochrane Library, Joanna Briggs Institute, TRIP-April, 2022) to identify empirical studies published in English on PEM co-creation to distill 'best practices'. Following an independent dual review of articles, data were collated into tables, and thematic analysis was employed to synthesize 'best practices' that were validated by a patient experienced in co-creating PEMs. Bias was not assessed, given the study heterogeneity. Of 6998 retrieved articles, 44 were included for data extraction/synthesis. Studies utilized heterogeneous methods spanning a range of health conditions/populations. Only 5/45 (11%) studies defined co-creation, 14 (32%) used a guiding framework, and 18 (41%) used validated evaluation tools. Six 'best practices' were identified: (1) begin with a review of the literature, (2) utilize a framework to inform the process, (3) involve clinical and patient experts from the beginning, (4) engage diverse perspectives, (5) ensure patients have the final decision, and (6) employ validated evaluation tools. This scoping review highlights the need for clear definitions and validated evaluation measures to guide and assess the co-creation process. Identified 'best practices' are relevant for use with diverse patient populations and health issues to enhance person-centered care.
Collapse
Affiliation(s)
- Isabella R. McDonald
- William F. Connell School of Nursing, Boston College, Chestnut Hill, MA 02467, USA; (I.R.M.); (E.S.B.); (E.A.W.)
| | - Elizabeth S. Blocker
- William F. Connell School of Nursing, Boston College, Chestnut Hill, MA 02467, USA; (I.R.M.); (E.S.B.); (E.A.W.)
| | - Elizabeth A. Weyman
- William F. Connell School of Nursing, Boston College, Chestnut Hill, MA 02467, USA; (I.R.M.); (E.S.B.); (E.A.W.)
| | - Neil Smith
- “I Am HH” Patient Organization, Dallas, TX 75238, USA;
| | - Andrew A. Dwyer
- William F. Connell School of Nursing, Boston College, Chestnut Hill, MA 02467, USA; (I.R.M.); (E.S.B.); (E.A.W.)
- Massachusetts General Hospital—Harvard Center for Reproductive Medicine, Boston, MA 02114, USA
| |
Collapse
|
4
|
Gourounti K, Sarantaki A, Dafnou ME, Hadjigeorgiou E, Lykeridou A, Middleton N. A qualitative study of assessing learning needs and digital health literacy in pregnancy: Baby Buddy Forward Greek findings. Eur J Midwifery 2022; 6:55. [PMID: 36119404 PMCID: PMC9434499 DOI: 10.18332/ejm/150770] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2021] [Revised: 06/04/2022] [Accepted: 06/07/2022] [Indexed: 11/24/2022] Open
Abstract
INTRODUCTION The purpose of this study was to explore the learning needs and the digital health literacy of pregnant women in Greece regarding perinatal health and care issues. METHODS This was a qualitative study involving thirteen Greek pregnant women, in two focus groups of primiparous and multiparous. The interview topic guide was developed by consensus during a training workshop of the European Baby Buddy Forward research program. The interviews were recorded, transcribed and inductively content analyzed. RESULTS Pregnant women described a range of learning needs and identify antenatal classes, health professionals, Internet, books, friends and relatives, as their main sources of information. Women expressed satisfaction in terms of their communication with midwives, but they expressed ambiguity regarding communication with doctors. With regard to the Internet, women highlighted their concern about the validity of information and point out the difficulties they face in order to access reliable scientific resources. Moreover, the process of seeking information online occurs in parallel and independently from healthcare providers, who discourage it, thus, many women were reluctant to discuss any information they retrieved from the Internet with health professionals. CONCLUSIONS The content of antenatal classes should be tailored to address pregnant women learning needs more holistically. However, taking into consideration that a major source of information for pregnant women is the Internet, it is vital for health professionals to acknowledge this reality and provide pregnant women with trusted websites. It is also particularly important for health professionals to practice their communication skills and update their digital knowledge.
Collapse
Affiliation(s)
- Kleanthi Gourounti
- Department of Midwifery, School of Health and Care Sciences, University of West Attica, Athens, Greece
| | - Antigoni Sarantaki
- Department of Midwifery, School of Health and Care Sciences, University of West Attica, Athens, Greece
| | - Maria-Eleni Dafnou
- Department of Midwifery, School of Health and Care Sciences, University of West Attica, Athens, Greece
| | - Eleni Hadjigeorgiou
- Department of Nursing, Faculty of Health Sciences, Cyprus University of Technology, Limassol, Cyprus
| | - Aikaterini Lykeridou
- Department of Midwifery, School of Health and Care Sciences, University of West Attica, Athens, Greece
| | - Nicos Middleton
- Department of Nursing, Faculty of Health Sciences, Cyprus University of Technology, Limassol, Cyprus
| |
Collapse
|
5
|
Emerson MR, Buckland S, Lawlor MA, Dinkel D, Johnson DJ, Mickles MS, Fok L, Watanabe-Galloway S. Addressing and evaluating health literacy in mHealth: a scoping review. Mhealth 2022; 8:33. [PMID: 36338314 PMCID: PMC9634204 DOI: 10.21037/mhealth-22-11] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/06/2022] [Accepted: 09/23/2022] [Indexed: 01/24/2023] Open
Abstract
BACKGROUND Recent surveys have revealed many adults have basic or below basic health literacy, which is linked to medical errors, increased illness, and compromised public health. Health literacy as a concept is multi-faceted extending beyond the individual to include social structures and the context in which health information is being accessed. Delivering health information via mobile devices (mHealth) expands the amount of information available while presenting challenges to ensuring these materials are suitable for a variety of literacy needs. The aims of this study are to discover how health literacy is addressed and evaluated in mHealth app development. METHODS A scoping review of 5 peer-reviewed databases was conducted. Eligible articles were written in English, addressed general literacy or mHealth/digital/eHealth literacy, and collected literacy information in order to incorporate literacy into the design and/or modification of an app or collected literacy information to describe the population being studied. The "Health Literacy Online" (HLO) United States (U.S.) government guide was used as a framework. RESULTS Thirty-two articles were reviewed. Articles included health literacy recommendations for all HLO categories and some recommendations not aligned with these categories. Most articles addressed health literacy using specific HLO categories though none incorporated every HLO category. The most common categories addressed engagement and testing of mHealth content. Though several studies addressed health literacy through a formal assessment tool, most did not. Evaluation of health literacy in mHealth was end-user focused and did not extensively evaluate content for fit to a variety of individuals with limited health literacy. CONCLUSIONS The recommendations seen consistently in our results in conjunction with formal HLO categories can act as beginning steps towards development of a health literacy evaluation tool for mHealth apps themselves. It is clear efforts are being made to reduce barriers to using mHealth for those with literacy deficits, however, it was also clear that this space has room to be more pragmatic in evaluation of mHealth tools for literacy. End user engagement in design and testing is necessary in future mHealth literacy tool development.
Collapse
Affiliation(s)
| | - Sydney Buckland
- College of Nursing, University of Nebraska Medical Center, Omaha, NE, USA
| | - Maxwell A. Lawlor
- College of Medicine, University of Nebraska Medical Center, Omaha, NE, USA
| | - Danae Dinkel
- College of Education Health and Human Sciences, University of Nebraska, Omaha, NE, USA
| | - David J. Johnson
- Department of Psychiatry & Behavioral Science, Mercer University School of Medicine, Atlanta, GA, USA
| | - Maria S. Mickles
- College of Public Health University of Nebraska Medical Center, Omaha, NE, USA
| | - Louis Fok
- College of Public Health University of Nebraska Medical Center, Omaha, NE, USA
| | | |
Collapse
|
6
|
Aida A, Svensson T, Svensson AK, Chung UI, Yamauchi T. eHealth Delivery of Educational Content Using Selected Visual Methods to Improve Health Literacy on Lifestyle-Related Diseases: Literature Review. JMIR Mhealth Uhealth 2020; 8:e18316. [PMID: 33295296 PMCID: PMC7758165 DOI: 10.2196/18316] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2020] [Revised: 08/07/2020] [Accepted: 11/19/2020] [Indexed: 12/28/2022] Open
Abstract
BACKGROUND Lifestyle-related diseases, such as stroke, heart disease, and diabetes, are examples of noncommunicable diseases. Noncommunicable diseases are now the leading cause of death in the world, and their major causes are lifestyle related. The number of eHealth interventions is increasing, which is expected to improve individuals' health literacy on lifestyle-related diseases. OBJECTIVE This literature review aims to identify existing literature published in the past decade on eHealth interventions aimed at improving health literacy on lifestyle-related diseases among the general population using selected visual methods, such as educational videos, films, and movies. METHODS A systematic literature search of the PubMed database was conducted in April 2019 for papers written in English and published from April 2, 2009, through April 2, 2019. A total of 538 papers were identified and screened in accordance with the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) flow diagram. Finally, 23 papers were included in this review. RESULTS The 23 papers were characterized according to study characteristics (author and year of publication, study design and region where the study was conducted, study objective, service platform, target disease and participant age, research period, outcomes, and research method); the playback time of the educational videos, films, and movies; and the evaluation of the study's impacts on health literacy. A total of 7 studies compared results using statistical methods. Of these, 5 studies reported significant positive effects of the intervention on health literacy and health-related measures (eg, physical activity, body weight). Although most of the studies included educational content aimed at improving health literacy, only 7 studies measured health literacy. In addition, only 5 studies assessed literacy using health literacy measurement tools. CONCLUSIONS This review found that the provision of educational content was satisfactory in most eHealth studies using selected visual methods, such as videos, films, and movies. These findings suggest that eHealth interventions influence people's health behaviors and that the need for this intervention is expected to increase. Despite the need to develop eHealth interventions, standardized measurement tools to evaluate health literacy are lacking. Further research is required to clarify acceptable health literacy measurements.
Collapse
Affiliation(s)
- Azusa Aida
- Precision Health, Department of Bioengineering, Graduate School of Engineering, The University of Tokyo, Tokyo, Japan.,Department of Diabetes and Metabolic Diseases, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan
| | - Thomas Svensson
- Precision Health, Department of Bioengineering, Graduate School of Engineering, The University of Tokyo, Tokyo, Japan.,Department of Clinical Sciences, Lund University, Skåne University Hospital, Malmö, Sweden.,School of Health Innovation, Kanagawa University of Human Services, Kawasaki-shi, Japan
| | - Akiko Kishi Svensson
- Precision Health, Department of Bioengineering, Graduate School of Engineering, The University of Tokyo, Tokyo, Japan.,Department of Diabetes and Metabolic Diseases, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan.,Department of Clinical Sciences, Lund University, Skåne University Hospital, Malmö, Sweden
| | - Ung-Il Chung
- Precision Health, Department of Bioengineering, Graduate School of Engineering, The University of Tokyo, Tokyo, Japan.,School of Health Innovation, Kanagawa University of Human Services, Kawasaki-shi, Japan.,Clinical Biotechnology, Center for Disease Biology and Integrative Medicine, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan
| | - Toshimasa Yamauchi
- Department of Diabetes and Metabolic Diseases, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan
| |
Collapse
|
7
|
Magee MF, Baker KM, Bardsley JK, Wesley D, Smith KM. Diabetes to Go-Inpatient: Pragmatic Lessons Learned from Implementation of Technology-Enabled Diabetes Survival Skills Education Within Nursing Unit Workflow in an Urban, Tertiary Care Hospital. Jt Comm J Qual Patient Saf 2020; 47:107-119. [PMID: 33358126 DOI: 10.1016/j.jcjq.2020.10.007] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2020] [Revised: 10/02/2020] [Accepted: 10/21/2020] [Indexed: 01/31/2023]
Abstract
BACKGROUND Diabetes survival skills education (DSSE) focuses on core knowledge and skills necessary for safe, effective, short-term diabetes self-care. Inpatient DSSE delivery approaches are needed. Diabetes to Go (D2Go) is an evidence-based DSSE program originally designed for outpatients. METHODS Implementation science principles were used to redesign D2Go for delivery by staff on medicine and surgery units in a tertiary care hospital to adults with type 2 diabetes (T2DM) using a tablet-based e-learning platform. Implementation efficacy was evaluated from staff and patient engagement perspectives. The Practical, Robust Implementation and Sustainability Model (PRISM) guided redesign. The team conducted qualitative evaluation (implementation barriers and facilitators); program redesign (via stakeholder feedback and education and human factors principles); implementation design for tablet delivery and patient engagement by unit staff; and a prospective implementation feasibility study. RESULTS Among 596 T2DM patients identified on three medical/surgical units, 415 (69.6%) were program eligible. Of those eligible, 59 (14.2%) received, accessed, and engaged with the platform; and among those, 43 (72.9%) completed the intervention, representing just 10.4% of those eligible. Multilevel implementation barriers were encountered: staff (receptivity, time, production pressures, culture); process (electronic health record [EHR] integration, patient identification, data tracking, bedside delivery); and patient (receptivity, acuity, availability, accessibility). Most completers required technology support. CONCLUSION Time constraints, limited EHR integration, and patient barriers markedly impeded implementation of the delivery of diabetes education at the bedside, despite stated staff interest. As a result, uptake and adoption of a tablet-based DSSE e-learning program in a high-acuity care setting was limited.
Collapse
|
8
|
Boyd AD, Ndukwe CI, Dileep A, Everin OF, Yao Y, Welland B, Field J, Baumann M, Flores JD, Shroff A, Groo V, Dickens C, Doukky R, Francis R, Peacock G, Wilkie DJ. Elderly Medication Adherence Intervention Using the My Interventional Drug-Eluting Stent Educational App: Multisite Randomized Feasibility Trial. JMIR Mhealth Uhealth 2020; 8:e15900. [PMID: 32579120 PMCID: PMC7381043 DOI: 10.2196/15900] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2019] [Revised: 12/20/2019] [Accepted: 01/24/2020] [Indexed: 01/19/2023] Open
Abstract
BACKGROUND A lifesaving treatment for myocardial infarction is the placement of a stent in a closed or obstructed coronary artery. The largest modifiable risk factor after receiving a stent is medication adherence to Dual AntiPlatelet Therapy, a combination of P2Y12 inhibitors and aspirin. OBJECTIVE This study aimed to determine the acceptability of a protocol and an intervention using the My Interventional Drug-Eluting Stent Educational App (MyIDEA) and to evaluate medication adherence using the proportion of days covered (PDC) and platelet activation tests in a multisite randomized controlled trial. METHODS Potential participants who received a post percutaneous coronary intervention (PCI) procedure with a drug-eluting stent were approached. All patients older than 50 years and who spoke English were recruited. Participants were recruited, baseline demographics were collected, and the Hospital Anxiety and Depression Scale (HADS), Rapid Estimate of Adult Literacy in Medicine-Short Form, Burden-Benefit questionnaire, 36-Item Short Form Health Survey, and PCI knowledge questionnaire were administered. Block randomization was used to randomize participants to either usual care or MyIDEA supplementation. MyIDEA is a personalized educational intervention based on the Kolb experiential learning theory using patient narratives for education. During the visits, participants' blood was collected to measure platelet suppression from medication. During the second and third encounters, the Morisky medication adherence score and cardiology outcomes were measured. The study was conducted at the University of Illinois Hospital and John H Stroger Jr Cook County Hospital with appropriate ethical approvals. Platelet suppression was measured through aspirin reactive units and P2Y12 reactive units. Medication adherence was measured using the PDC. The analysis team was blinded to the participants' group membership. The primary outcome was a feasibility analysis of recruitment and retention. RESULTS The mean age of participants was 60.4 years (SD 7.1); the majority of patients were black and non-Hispanic. The majority of patients' reading levels were seventh grade or above, and they were not very familiar with other electronic devices for information and communication. The number of control subjects was 21, and the number of participants in the interventional arm was 24. The interventional group was able to use MyIDEA in both the hospital and outpatient setting. However, there was no significant difference in platelet suppression or medication adherence between groups. There were also differences between the groups in terms of depression and anxiety, initially, as measured by HADS. No documented adverse event associated with the intervention was found. CONCLUSIONS Elderly patients are willing to use tablet devices to be educated about health conditions. Additional studies are required to measure the effectiveness and determine the most suitable timing and location for patient education. TRIAL REGISTRATION ClinicalTrials.gov NCT04439864; https://clinicaltrials.gov/ct2/show/NCT04439864.
Collapse
Affiliation(s)
- Andrew Dallas Boyd
- Department of Biomedical and Health Information Science, University of Illinois at Chicago, Chicago, United States
| | - Chioma Iheanyi Ndukwe
- Department of Biomedical and Health Information Science, University of Illinois at Chicago, Chicago, United States
| | - Anandu Dileep
- Department of Biomedical and Health Information Science, University of Illinois at Chicago, Chicago, United States
| | - Olivia Frances Everin
- Department of Biomedical and Health Information Science, University of Illinois at Chicago, Chicago, United States
| | - Yingwei Yao
- Biobehavioral Nursing Science, University of Florida, Gainesville, FL, United States
| | - Betty Welland
- Patient Advisor, Department of Biomedical and Health Information Sciences, University of Illinois at Chicago, Chicago, IL, United States
| | - Jerry Field
- Patient Advisor, Department of Biomedical and Health Information Sciences, University of Illinois at Chicago, Chicago, IL, United States
| | - Matt Baumann
- Patient Advisor, Department of Biomedical and Health Information Sciences, University of Illinois at Chicago, Chicago, IL, United States
| | - Jose D Flores
- Patient Advisor, Department of Biomedical and Health Information Sciences, University of Illinois at Chicago, Chicago, IL, United States
| | - Adhir Shroff
- Department of Biomedical and Health Information Science, University of Illinois at Chicago, Chicago, United States
| | - Vicki Groo
- Department of Pharmacy Practice, University of Illinois at Chicago, Chicago, IL, United States
| | - Carolyn Dickens
- Department of Biomedical and Health Information Science, University of Illinois at Chicago, Chicago, United States
| | - Rami Doukky
- Divison of Cardiology, Cook County Health, Chicago, IL, United States
| | - Regeena Francis
- Divison of Cardiology, Cook County Health, Chicago, IL, United States
| | - Geraldine Peacock
- Divison of Cardiology, Cook County Health, Chicago, IL, United States
| | - Diana J Wilkie
- Biobehavioral Nursing Science, University of Florida, Gainesville, FL, United States
| |
Collapse
|
9
|
Mitchell KM, Holtz BE, McCarroll A. Patient-Centered Methods for Designing and Developing Health Information Communication Technologies: A Systematic Review. Telemed J E Health 2019; 25:1012-1021. [PMID: 30576258 DOI: 10.1089/tmj.2018.0236] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/29/2023] Open
Abstract
Background: Chronic disease management and maintaining healthy behaviors to prevent disease are important lifelong considerations. Adherence to prescribed management and behaviors often falls short of physician recommendations, which can result in negative health outcomes. Information communication technologies (ICTs) offer an approach to combat this issue. However, uptake and sustainability of ICTs have mixed results. One reason could be that technologies are often created without an understanding of the complexities of patient needs. Therefore, the intent of this study is to explore the current landscape of patient-centered design and development of health ICTs through a systematic review. Materials and Methods: Systematic literature searches were conducted in the databases EBSCO, PubMed, and Web of Science between October 2016 and February 2017. Each paper was critically evaluated for each data extraction classification, and was categorized based on the chronic disease or health focus, method of patient-centered design, resulting themes, and use of theory. Results: The study search resulted in 3,748 articles total. After duplicates and articles not meeting criteria were removed, 57 articles were selected for assessment. Four main themes emerged: participant experience, technological requirements, behavioral and knowledge components, and social components. Conclusions: Adhering to chronic disease management and healthy behaviors are both crucial to attain positive health outcomes. ICTs can play an interesting role in aiding disease management and healthy behavior promotion, but involving end-users and applying a theoretical foundation in the design and development of these technologies should be considered.
Collapse
Affiliation(s)
- Katharine M Mitchell
- Department of Advertising and Public Relations, Michigan State University, East Lansing, Michigan
| | - Bree E Holtz
- Department of Advertising and Public Relations, Michigan State University, East Lansing, Michigan
| | - Alexis McCarroll
- Department of Media and Information, Michigan State University, East Lansing, Michigan
| |
Collapse
|
10
|
Larentis AV, Barbosa DNF, da Silva CR, Barbosa JLV. Applied Computing to Education on Noncommunicable Chronic Diseases: A Systematic Mapping Study. Telemed J E Health 2019; 26:147-163. [PMID: 30807261 DOI: 10.1089/tmj.2018.0282] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Abstract
Background: The number of deaths from noncommunicable chronic diseases (NCDs) has increased worldwide. These deaths would be partly avoidable if prevention and follow-up measures were applied to reduce risk factors. Computing can help educate individuals, improving their knowledge about NCDs. This article presents a systematic mapping of studies that apply computing to education on NCDs. The results allow a general view of the literature and the identification of research opportunities. Materials and Methods: The methodology followed three steps: (1) definition of search databases from computer science and health sciences, (2) selection of keywords for search string composition, and (3) application of inclusion and exclusion criteria to filter the results. The survey occurred from January 2008 to April 2018. Results: The initial search resulted in 19,675 papers, of which 38 were selected after applying the filter criteria. The use of mobile computing stood out in 25 papers. The education modalities were self-management and educational content for diabetes (10 papers), asthma (1), cardiovascular disease (1) and chronic diseases (1), self-management of diabetes and games (1), educational content (15), games (6), personalized content (2), and virtual community (1). The percentage of papers on diabetes was 65%. Most solutions (55%) do not use data from individuals to provide information considering their health condition. In addition, 19 papers produced outcome measures by means of experiments. Conclusions: Mobile computing was the most used technology in the papers. In addition, self-management, educational content, and games were the most used mechanisms. A research opportunity consists of personalized assistance. In this sense, ubiquitous learning can provide a continuous and contextualized education.
Collapse
Affiliation(s)
- Andrêsa Vargas Larentis
- Applied Computing Graduate Program, University of Vale do Rio dos Sinos, São Leopoldo, Brazil
| | | | | | | |
Collapse
|
11
|
Moore G, Wilding H, Gray K, Castle D. Participatory Methods to Engage Health Service Users in the Development of Electronic Health Resources: Systematic Review. J Particip Med 2019; 11:e11474. [PMID: 33055069 PMCID: PMC7434099 DOI: 10.2196/11474] [Citation(s) in RCA: 38] [Impact Index Per Article: 7.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2018] [Revised: 10/29/2018] [Accepted: 12/10/2018] [Indexed: 02/06/2023] Open
Abstract
Background When health service providers (HSP) plan to develop electronic health (eHealth) resources for health service users (HSU), the latter’s involvement is essential. Typically, however, HSP, HSU, and technology developers engaged to produce the resources lack expertise in participatory design methodologies suited to the eHealth context. Furthermore, it can be difficult to identify an established method to use, or determine how to work stepwise through any particular process. Objective We sought to summarize the evidence about participatory methods and frameworks used to engage HSU in the development of eHealth resources from the beginning of the design process. Methods We searched for studies reporting participatory processes in initial development of eHealth resources from 2006 to 2016 in 9 bibliographic databases: MEDLINE, EMBASE, CINAHL, PsycINFO, Emcare, Cochrane Library, Web of Science, ACM Guide to Computing Literature, and IEEE Xplore. From 15,117 records initially screened on title and abstract for relevance to eHealth and early participatory design, 603 studies were assessed for eligibility on full text. The remaining 90 studies were rated by 2 reviewers using the Mixed Methods Appraisal Tool Version 2011 (Pluye et al; MMAT) and analyzed with respect to health area, purpose, technology type, and country of study. The 30 studies scoring 90% or higher on MMAT were included in a detailed qualitative synthesis. Results Of the 90 MMAT-rated studies, the highest reported (1) health areas were cancer and mental disorders, (2) eHealth technologies were websites and mobile apps, (3) targeted populations were youth and women, and (4) countries of study were the United States, the United Kingdom, and the Netherlands. Of the top 30 studies the highest reported participatory frameworks were User-Centered Design, Participatory Action Research Framework, and the Center for eHealth Research and Disease Management (CeHRes) Roadmap, and the highest reported model underpinning development and engagement was Social Cognitive Theory. Of the 30 studies, 4 reported on all the 5 stages of the CeHRes Roadmap. Conclusions The top 30 studies yielded 24 participatory frameworks. Many studies referred to using participatory design methods without reference to a framework. The application of a structured framework such as the CeHRes Roadmap and a model such as Social Cognitive Theory creates a foundation for a well-designed eHealth initiative that ensures clarity and enables replication across participatory design projects. The framework and model need to be clearly articulated and address issues that include resource availability, responsiveness to change, and the criteria for good practice. This review creates an information resource for future eHealth developers, to guide the design of their eHealth resource with a framework that can support further evaluation and development. Trial Registration PROSPERO CRD42017053838; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=53838
Collapse
Affiliation(s)
- Gaye Moore
- Mental Health Executive Services, St Vincent's Hospital, Melbourne, Fitzroy, Australia.,Department of Nursing, Faculty of Medicine, Dentistry and Health Sciences, University of Melbourne, Melbourne, Australia
| | - Helen Wilding
- Mental Health Executive Services, St Vincent's Hospital, Melbourne, Fitzroy, Australia.,Library Service, St Vincent's Hospital Melbourne, Fitzroy, Australia
| | - Kathleen Gray
- Health and Biomedical Informatics Centre, University of Melbourne, Melbourne, Australia
| | - David Castle
- Mental Health Executive Services, St Vincent's Hospital, Melbourne, Fitzroy, Australia.,Department of Psychiatry, Faculty of Medicine, Dentistry and Health Sciences, University of Melbourne, Melbourne, Australia
| |
Collapse
|
12
|
Edwards EA, Caton H, Lumsden J, Rivas C, Steed L, Pirunsarn Y, Jumbe S, Newby C, Shenvi A, Mazumdar S, Smith JQ, Greenhill D, Griffiths CJ, Walton RT. Creating a Theoretically Grounded, Gamified Health App: Lessons From Developing the Cigbreak Smoking Cessation Mobile Phone Game. JMIR Serious Games 2018; 6:e10252. [PMID: 30497994 PMCID: PMC6293248 DOI: 10.2196/10252] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2018] [Revised: 06/25/2018] [Accepted: 07/28/2018] [Indexed: 12/11/2022] Open
Abstract
Background Gaming techniques are increasingly recognized as effective methods for changing behavior and increasing user engagement with mobile phone apps. The rapid uptake of mobile phone games provides an unprecedented opportunity to reach large numbers of people and to influence a wide range of health-related behaviors. However, digital interventions are still nascent in the field of health care, and optimum gamified methods of achieving health behavior change are still being investigated. There is currently a lack of worked methodologies that app developers and health care professionals can follow to facilitate theoretically informed design of gamified health apps. Objective This study aimed to present a series of steps undertaken during the development of Cigbreak, a gamified smoking cessation health app. Methods A systematic and iterative approach was adopted by (1) forming an expert multidisciplinary design team, (2) defining the problem and establishing user preferences, (3) incorporating the evidence base, (4) integrating gamification, (5) adding behavior change techniques, (6) forming a logic model, and (7) user testing. A total of 10 focus groups were conducted with 73 smokers. Results Users found the app an engaging and motivating way to gain smoking cessation advice and a helpful distraction from smoking; 84% (62/73) of smokers said they would play again and recommend it to a friend. Conclusions A dedicated gamified app to promote smoking cessation has the potential to modify smoking behavior and to deliver effective smoking cessation advice. Iterative, collaborative development using evidence-based behavior change techniques and gamification may help to make the game engaging and potentially effective. Gamified health apps developed in this way may have the potential to provide effective and low-cost health interventions in a wide range of clinical settings.
Collapse
Affiliation(s)
- Elizabeth A Edwards
- Centre for Primary Care and Public Health, Blizard Institute, Bart's and The London School of Medicine and Dentistry, Queen Mary University of London, London, United Kingdom.,Asthma UK Centre for Applied Research, Bart's and The London School of Medicine and Dentistry, Queen Mary University of London, London, United Kingdom
| | - Hope Caton
- Faculty of Science, Engineering Computing, Kingston University, London, United Kingdom
| | - Jim Lumsden
- MRC Integrative Epidemiology Unit, University of Bristol, Bristol, United Kingdom.,School of Psychological Science, University of Bristol, Bristol, United Kingdom
| | - Carol Rivas
- Centre for Primary Care and Public Health, Blizard Institute, Bart's and The London School of Medicine and Dentistry, Queen Mary University of London, London, United Kingdom.,Social Science Research Unit, University College London, London, United Kingdom
| | - Liz Steed
- Centre for Primary Care and Public Health, Blizard Institute, Bart's and The London School of Medicine and Dentistry, Queen Mary University of London, London, United Kingdom.,Asthma UK Centre for Applied Research, Bart's and The London School of Medicine and Dentistry, Queen Mary University of London, London, United Kingdom
| | - Yutthana Pirunsarn
- Faculty of Science, Engineering Computing, Kingston University, London, United Kingdom
| | - Sandra Jumbe
- Centre for Primary Care and Public Health, Blizard Institute, Bart's and The London School of Medicine and Dentistry, Queen Mary University of London, London, United Kingdom.,Asthma UK Centre for Applied Research, Bart's and The London School of Medicine and Dentistry, Queen Mary University of London, London, United Kingdom
| | - Chris Newby
- Centre for Primary Care and Public Health, Blizard Institute, Bart's and The London School of Medicine and Dentistry, Queen Mary University of London, London, United Kingdom.,Asthma UK Centre for Applied Research, Bart's and The London School of Medicine and Dentistry, Queen Mary University of London, London, United Kingdom
| | - Aditi Shenvi
- Centre for Complexity Science, University of Warwick, Coventry, United Kingdom
| | - Samaresh Mazumdar
- Centre for Primary Care and Public Health, Blizard Institute, Bart's and The London School of Medicine and Dentistry, Queen Mary University of London, London, United Kingdom.,Asthma UK Centre for Applied Research, Bart's and The London School of Medicine and Dentistry, Queen Mary University of London, London, United Kingdom
| | - Jim Q Smith
- Department of Statistics, University of Warwick, Coventry, United Kingdom
| | - Darrel Greenhill
- Faculty of Science, Engineering Computing, Kingston University, London, United Kingdom
| | - Chris J Griffiths
- Centre for Primary Care and Public Health, Blizard Institute, Bart's and The London School of Medicine and Dentistry, Queen Mary University of London, London, United Kingdom.,Asthma UK Centre for Applied Research, Bart's and The London School of Medicine and Dentistry, Queen Mary University of London, London, United Kingdom
| | - Robert T Walton
- Centre for Primary Care and Public Health, Blizard Institute, Bart's and The London School of Medicine and Dentistry, Queen Mary University of London, London, United Kingdom.,Asthma UK Centre for Applied Research, Bart's and The London School of Medicine and Dentistry, Queen Mary University of London, London, United Kingdom
| |
Collapse
|
13
|
Qualitative Assessment of the Feasibility, Usability, and Acceptability of a Mobile Client Data App for Community-Based Maternal, Neonatal, and Child Care in Rural Ghana. Int J Telemed Appl 2016; 2016:2515420. [PMID: 28070186 PMCID: PMC5192299 DOI: 10.1155/2016/2515420] [Citation(s) in RCA: 37] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2016] [Accepted: 11/14/2016] [Indexed: 01/12/2023] Open
Abstract
Mobile phone applications may enhance the delivery of critical health services and the accuracy of health service data. Yet, the opinions and experiences of frontline health workers on using mobile apps to track pregnant and recently delivered women are underreported. This evaluation qualitatively assessed the feasibility, usability, and acceptability of a mobile Client Data App for maternal, neonatal, and child client data management by community health nurses (CHNs) in rural Ghana. The mobile app enabled CHNs to enter, summarize, and query client data. It also sent visit reminders for clients and provided a mechanism to report level of care to district officers. Fourteen interviews and two focus groups with CHNs, midwives, and district health officers were conducted, coded, and thematically analyzed. Results indicated that the app was easily integrated into care, improved CHN productivity, and was acceptable due to its capacity to facilitate client follow-up, data reporting, and decision-making. However, the feasibility and usability of the app were hindered by high client volumes, staff shortages, and software and device challenges. Successful integration of mobile client data apps for frontline health workers in rural and resource-poor settings requires real-time monitoring, program investments, and targeted changes in human resources.
Collapse
|
14
|
Shah V, Dileep A, Dickens C, Groo V, Welland B, Field J, Baumann M, Flores JD, Shroff A, Zhao Z, Yao Y, Wilkie DJ, Boyd AD. Patient-Centered Tablet Application for Improving Medication Adherence after a Drug-Eluting Stent. Front Public Health 2016; 4:272. [PMID: 28018897 PMCID: PMC5149519 DOI: 10.3389/fpubh.2016.00272] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2016] [Accepted: 11/28/2016] [Indexed: 11/13/2022] Open
Abstract
BACKGROUND/AIMS This study's objective was to evaluate a patient-centered educational electronic tablet application, "My Interventional Drug-Eluting Stent Educational App" (MyIDEA) to see if there was an increase in patient knowledge about dual antiplatelet therapy (DAPT) and medication possession ratio (MPR) compared to treatment as usual. METHODS In a pilot project, 24 elderly (≥50 years old) research participants were recruited after a drug-eluting stent. Eleven were randomized to the control arm and 13 to the interventional arm. All the participants completed psychological and knowledge questionnaires. Adherence was assessed through MPR, which was calculated at 3 months for all participants who were scheduled for second and third follow-up visits. RESULTS Relative to control, the interventional group had a 10% average increase in MPR. As compared to the interventional group, more patients in the control group had poor adherence (<80% MPR). The psychological data revealed a single imbalance in anxiety between the control and interventional groups. On average, interventional participants spent 21 min using MyIDEA. DISCUSSION Consumer health informatics has enabled us to engage patients with their health data using novel methods. Consumer health technology needs to focus more on patient knowledge and engagement to improve long-term health. MyIDEA takes a unique approach in targeting DAPT from the onset. CONCLUSION MyIDEA leverages patient-centered information with clinical care and the electronic health record highlighting the patients' role as a team member in their own health care. The patients think critically about adverse events and how to solve issues before leaving the hospital.
Collapse
Affiliation(s)
- Vicki Shah
- Department of Biomedical and Health Information Sciences, College of Applied Health Sciences, University of Illinois at Chicago , Chicago, IL , USA
| | - Anandu Dileep
- Department of Biomedical and Health Information Sciences, College of Applied Health Sciences, University of Illinois at Chicago , Chicago, IL , USA
| | - Carolyn Dickens
- Department of Biobehavioral Health Science, College of Nursing, University of Illinois at Chicago, Chicago, IL, USA; Division of Cardiology, Department of Internal Medicine, College of Medicine, University of Illinois at Chicago, Chicago, IL, USA
| | - Vicki Groo
- Division of Cardiology, Department of Internal Medicine, College of Medicine, University of Illinois at Chicago, Chicago, IL, USA; Department of Pharmacy Practice, College of Pharmacy, University of Illinois at Chicago, Chicago, IL, USA
| | - Betty Welland
- University of Illinois at Chicago , Chicago, IL , USA
| | - Jerry Field
- University of Illinois at Chicago , Chicago, IL , USA
| | | | - Jose D Flores
- University of Illinois at Chicago , Chicago, IL , USA
| | - Adhir Shroff
- Division of Cardiology, Department of Internal Medicine, College of Medicine, University of Illinois at Chicago , Chicago, IL , USA
| | - Zhongsheng Zhao
- Department of Biobehavioral Health Science, College of Nursing, University of Illinois at Chicago , Chicago, IL , USA
| | - Yingwei Yao
- Department of Biobehavioral Nursing Science, University of Florida , Gainesville, FL , USA
| | - Diana J Wilkie
- Department of Biobehavioral Nursing Science, University of Florida , Gainesville, FL , USA
| | - Andrew D Boyd
- Department of Biomedical and Health Information Sciences, College of Applied Health Sciences, University of Illinois at Chicago , Chicago, IL , USA
| |
Collapse
|
15
|
Finkelstein J, Cha EM. Using a Mobile App to Promote Smoking Cessation in Hospitalized Patients. JMIR Mhealth Uhealth 2016; 4:e59. [PMID: 27154792 PMCID: PMC4875494 DOI: 10.2196/mhealth.5149] [Citation(s) in RCA: 25] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2015] [Revised: 03/13/2016] [Accepted: 03/30/2016] [Indexed: 11/16/2022] Open
Abstract
Background The potential of interactive health education for preventive health applications has been widely demonstrated. However, use of mobile apps to promote smoking cessation in hospitalized patients has not been systematically assessed. Objective This study was conducted to assess the feasibility of using a mobile app for the hazards of smoking education delivered via touch screen tablets to hospitalized smokers. Methods Fifty-five consecutive hospitalized smokers were recruited. Patient sociodemographics and smoking history was collected at baseline. The impact of the mobile app was assessed by measuring cognitive and behavioral factors shown to promote smoking cessation before and after the mobile app use including hazards of smoking knowledge score (KS), smoking attitudes, and stages of change. Results After the mobile app use, mean KS increased from 27(3) to 31(3) (P<0.0001). Proportion of patients who felt they “cannot quit smoking” reduced from 36% (20/55) to 18% (10/55) (P<0.03). Overall, 13% (7/55) of patients moved toward a more advanced stage of change with the proportion of patients in the preparation stage increased from 40% (22/55) to 51% (28/55). Multivariate regression analysis demonstrated that knowledge gains and mobile app acceptance did not depend on age, gender, race, computer skills, income, or education level. The main factors affecting knowledge gain were initial knowledge level (P<0.02), employment status (P<0.05), and high app acceptance (P<0.01). Knowledge gain was the main predictor of more favorable attitudes toward the mobile app (odds ratio (OR)=4.8; 95% confidence interval (CI) (1.1, 20.0)). Attitudinal surveys and qualitative interviews identified high acceptance of the mobile app by hospitalized smokers. Over 92% (51/55) of the study participants recommended the app for use by other hospitalized smokers and 98% (54/55) of the patients were willing to use such an app in the future. Conclusions Our results suggest that a mobile app promoting smoking cessation is well accepted by hospitalized smokers. The app can be used for interactive patient education and counseling during hospital stays. Development and evaluation of mobile apps engaging patients in their care during hospital stays is warranted.
Collapse
Affiliation(s)
- Joseph Finkelstein
- Columbia University, Department of Biomedical Informatics, New York, NY, United States.
| | | |
Collapse
|