1
|
Chin D, Boon J, Rojas-Carabali W, Choo S, Cifuentes-González C, Agrawal R. Evaluation of Patient Experiences with PocDoc, a Web-Based Eye Screening Tool. Ophthalmol Ther 2024; 13:1799-1811. [PMID: 38705913 PMCID: PMC11109045 DOI: 10.1007/s40123-024-00948-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/26/2023] [Accepted: 03/27/2024] [Indexed: 05/07/2024] Open
Abstract
INTRODUCTION The efficacy of diagnostic and monitoring tools in ophthalmology is significantly influenced by patient engagement levels. This presents a notable challenge, especially in the context of developing tools designed for telemedicine applications. Ensuring consistent patient engagement is therefore crucial for the accurate and reliable utilization of these technologies. This study assesses patient perceptions and experiences after using a purpose-built web application, called PocDoc. METHODS A cross-sectional questionnaire-based survey was conducted among 440 patients recruited from general and specialist eye clinics between March 2022 and October 2023, both before and after using the PocDoc app. RESULTS Pre-test findings revealed that 86.8% of patients thought that a remote eye monitoring application would have use, while 70.9% anticipated frequent usage. Only 16.4% found it overly complex, and 55.2% perceived it as easy to use. Additionally, 34.5% foresaw the need for technical support, while 72.5% believed they would quickly grasp its use. In the post-test questionnaire, 63.3% of patients still expressed intent for frequent PocDoc usage. The perception of complexity decreased to 20.4%, with 79.3% finding it easy to use. The belief in the need for technical support decreased to 36.5%, while 89.9% felt confident in mastering the application quickly. Moreover, 77.3% found the application's functions well-integrated, and 64.6% were very confident using PocDoc. CONCLUSIONS Results suggest patient receptivity to web-based applications, confirming their viability for specific patient groups. Overall, our study contributes to the growing body of evidence indicating that greater exposure to digital health tools can significantly influence patient acceptance and perceived ease of use, an insight that has important implications for the implementation and design of these technologies in clinical settings.
Collapse
Affiliation(s)
- Daniel Chin
- National Healthcare Group Eye Institute, Tan Tock Seng Hospital, Singapore, 308433, Singapore
| | - Joewee Boon
- National Healthcare Group Eye Institute, Tan Tock Seng Hospital, Singapore, 308433, Singapore
| | - William Rojas-Carabali
- National Healthcare Group Eye Institute, Tan Tock Seng Hospital, Singapore, 308433, Singapore
- Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore
| | - Shannon Choo
- National Healthcare Group Eye Institute, Tan Tock Seng Hospital, Singapore, 308433, Singapore
| | | | - Rupesh Agrawal
- National Healthcare Group Eye Institute, Tan Tock Seng Hospital, Singapore, 308433, Singapore.
- Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore.
- Singapore Eye Research Institute, Singapore, Singapore.
- Duke NUS Medical School, Singapore, Singapore.
- Moorfields Eye Hospital, NHUS Foundation Trust, London, UK.
| |
Collapse
|
2
|
Boon J, Rojas-Carabali W, Asad Y, Lim JTY, Rajagopalan R, Agrawal R. Evaluation of a Digital Amsler Grid (PocDoc) for Macular Disease Screening: A Comparative Analysis with the Conventional Method. Ophthalmol Ther 2024; 13:1289-1301. [PMID: 38507191 DOI: 10.1007/s40123-024-00910-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2024] [Accepted: 02/15/2024] [Indexed: 03/22/2024] Open
Abstract
INTRODUCTION Macular diseases are major contributors to visual impairment and blindness worldwide. This study introduces PocDoc, a digital version of the conventional Amsler grid, aimed at enhancing the screening and monitoring of macular diseases. We conducted a comprehensive evaluation to compare the effectiveness of PocDoc against the conventional method. METHODS Our comparative analysis involved two distinct phases. Initially, we assessed the capability of both PocDoc and the conventional method in detecting central visual field abnormalities. This phase included a cohort of 72 healthy and 155 eyes affected by various conditions such as age-related macular degeneration (AMD), uveitis, polypoidal choroidal vasculopathy (PCV), and macular telangiectasia. We primarily focused on the area of compromise and observed the correlation between the results obtained from both methods, measuring their concordance using a correlation coefficient. In the second phase, we evaluated the accuracy of both methods in diagnosing AMD. This involved a group of 127 eyes, including 70 healthy and 57 AMD-affected eyes. We determined the sensitivity, specificity, and overall accuracy of each method in diagnosing AMD. RESULTS In the initial phase, both PocDoc and the conventional Amsler grid demonstrated a high correlation in detecting central visual field defects across various macular diseases (correlation coefficient > 0.9). In the second phase, focused on AMD diagnosis, PocDoc showed a sensitivity of 50%, specificity of 100%, and an overall accuracy of 78%. Comparatively, the conventional method exhibited a sensitivity of 49%, specificity of 100%, and accuracy of 77%. CONCLUSION PocDoc's digital Amsler grid exhibits comparable effectiveness to the conventional method in both detecting visual field abnormalities across a range of macular diseases and specifically in the diagnosis of AMD. The high correlation in results, combined with the digital advantages of PocDoc, such as ease of use and potential for telemedicine applications, suggests its viability as a valuable tool in the screening and monitoring of macular diseases.
Collapse
Affiliation(s)
- Joewee Boon
- National Healthcare Group Eye Institute, Tan Tock Seng Hospital, Singapore, 308433, Singapore
| | - William Rojas-Carabali
- National Healthcare Group Eye Institute, Tan Tock Seng Hospital, Singapore, 308433, Singapore
- Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore
| | - Yusra Asad
- National Healthcare Group Eye Institute, Tan Tock Seng Hospital, Singapore, 308433, Singapore
| | - Jonathan Tzien Yih Lim
- Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore
| | - Rajesh Rajagopalan
- National Healthcare Group Eye Institute, Tan Tock Seng Hospital, Singapore, 308433, Singapore
| | - Rupesh Agrawal
- National Healthcare Group Eye Institute, Tan Tock Seng Hospital, Singapore, 308433, Singapore.
- Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore.
- Singapore Eye Research Institute, Singapore, Singapore.
- Duke NUS Medical School, Singapore, Singapore.
- Moorfields Eye Hospital, NHUS Foundation Trust, London, UK.
| |
Collapse
|
3
|
Nagino K, Sung J, Midorikawa-Inomata A, Eguchi A, Fujimoto K, Okumura Y, Miura M, Yee A, Hurramhon S, Fujio K, Akasaki Y, Hirosawa K, Huang T, Ohno M, Morooka Y, Zou X, Kobayashi H, Inomata T. Clinical Utility of Smartphone Applications in Ophthalmology: A Systematic Review. OPHTHALMOLOGY SCIENCE 2024; 4:100342. [PMID: 37869018 PMCID: PMC10587618 DOI: 10.1016/j.xops.2023.100342] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/02/2022] [Revised: 05/17/2023] [Accepted: 05/23/2023] [Indexed: 10/24/2023]
Abstract
Topic Numerous smartphone applications have been devised for diagnosis, treatment, and symptom management in ophthalmology. Despite the importance of systematic evaluation of the purpose, target disease, effectiveness, and utility of smartphone applications to their effective utilization, few studies have formally evaluated their validity, reliability, and clinical utility. Clinical Relevance This report identifies smartphone applications with potential for clinical implementation in ophthalmology and summarizes the evidence on their practical utility. Methods We searched PubMed and EMBASE on July 28, 2022, for articles reporting original data on the effectiveness of treatment, disease detection, diagnostic accuracy, disease monitoring, and usability of smartphone applications in ophthalmology published between January 1, 1987, and July 25, 2022. Their quality was assessed using the Joanna Briggs Institute Critical Appraisal Checklist. Results The initial search yielded 510 articles. After removing 115 duplicates and 285 articles based on inclusion and exclusion criteria, the full texts of the remaining 110 articles were reviewed. Furthermore, 71 articles were included in the final qualitative synthesis. All studies were determined to be of high (87.3%) or moderate (12.7%) quality. In terms of respective application of interest, 24 (33.8%) studies assessed diagnostic accuracy, 17 (23.9%) assessed disease detection, and 3 (4.2%) assessed intervention efficacy. A total of 48 smartphone applications were identified, of which 27 (56.3%) were publicly available. Seventeen (35.4%) applications included functions for ophthalmic examinations, 13 (27.1%) included functions aimed at disease detection, 10 (20.8%) included functions to support medical personnel, five (10.4%) included functions related to disease education, and three (6.3%) included functions to promote treatment adherence for patients. The largest number of applications targeted amblyopia (18.8%), followed by retinal disease (10.4%). Two (4.2%) smartphone applications reported significant efficacy in treating diseases. Conclusion In this systematic review, a comprehensive appraisal is presented on studies related to diagnostic accuracy, disease detectability, and efficacy of smartphone applications in ophthalmology. Forty-eight applications with potential clinical utility are identified. Appropriate smartphone applications are expected to enable early detection of undiagnosed diseases via telemedicine and prevent visual dysfunction via remote monitoring of chronic diseases. Financial Disclosures Proprietary or commercial disclosure may be found after the references.
Collapse
Affiliation(s)
- Ken Nagino
- Department of Hospital Administration, Juntendo University Graduate School of Medicine, Tokyo, Japan
- Department of Ophthalmology, Juntendo University Graduate School of Medicine, Tokyo, Japan
- Department of Digital Medicine, Juntendo University Graduate School of Medicine, Tokyo, Japan
| | - Jaemyoung Sung
- Department of Ophthalmology, Juntendo University Graduate School of Medicine, Tokyo, Japan
| | - Akie Midorikawa-Inomata
- Department of Hospital Administration, Juntendo University Graduate School of Medicine, Tokyo, Japan
| | - Atsuko Eguchi
- Department of Hospital Administration, Juntendo University Graduate School of Medicine, Tokyo, Japan
| | - Keiichi Fujimoto
- Department of Ophthalmology, Juntendo University Graduate School of Medicine, Tokyo, Japan
- Department of Digital Medicine, Juntendo University Graduate School of Medicine, Tokyo, Japan
| | - Yuichi Okumura
- Department of Ophthalmology, Juntendo University Graduate School of Medicine, Tokyo, Japan
- Department of Digital Medicine, Juntendo University Graduate School of Medicine, Tokyo, Japan
| | - Maria Miura
- Department of Ophthalmology, Juntendo University Graduate School of Medicine, Tokyo, Japan
- Department of Digital Medicine, Juntendo University Graduate School of Medicine, Tokyo, Japan
| | - Alan Yee
- Department of Ophthalmology, Juntendo University Graduate School of Medicine, Tokyo, Japan
- Department of Digital Medicine, Juntendo University Graduate School of Medicine, Tokyo, Japan
| | - Shokirova Hurramhon
- Department of Ophthalmology, Juntendo University Graduate School of Medicine, Tokyo, Japan
| | - Kenta Fujio
- Department of Ophthalmology, Juntendo University Graduate School of Medicine, Tokyo, Japan
- Department of Digital Medicine, Juntendo University Graduate School of Medicine, Tokyo, Japan
| | - Yasutsugu Akasaki
- Department of Ophthalmology, Juntendo University Graduate School of Medicine, Tokyo, Japan
- Department of Digital Medicine, Juntendo University Graduate School of Medicine, Tokyo, Japan
| | - Kunihiko Hirosawa
- Department of Ophthalmology, Juntendo University Graduate School of Medicine, Tokyo, Japan
- Department of Digital Medicine, Juntendo University Graduate School of Medicine, Tokyo, Japan
| | - Tianxiang Huang
- Department of Ophthalmology, Juntendo University Graduate School of Medicine, Tokyo, Japan
- Department of Digital Medicine, Juntendo University Graduate School of Medicine, Tokyo, Japan
| | - Mizu Ohno
- Department of Ophthalmology, Juntendo University Graduate School of Medicine, Tokyo, Japan
- Department of Digital Medicine, Juntendo University Graduate School of Medicine, Tokyo, Japan
| | - Yuki Morooka
- Department of Ophthalmology, Juntendo University Graduate School of Medicine, Tokyo, Japan
- Department of Digital Medicine, Juntendo University Graduate School of Medicine, Tokyo, Japan
| | - Xinrong Zou
- Department of Ophthalmology, Juntendo University Graduate School of Medicine, Tokyo, Japan
- Department of Ophthalmology, Fengcheng Hospital, Shanghai, China
| | - Hiroyuki Kobayashi
- Department of Hospital Administration, Juntendo University Graduate School of Medicine, Tokyo, Japan
| | - Takenori Inomata
- Department of Hospital Administration, Juntendo University Graduate School of Medicine, Tokyo, Japan
- Department of Ophthalmology, Juntendo University Graduate School of Medicine, Tokyo, Japan
- Department of Digital Medicine, Juntendo University Graduate School of Medicine, Tokyo, Japan
- AI Incubation Farm, Juntendo University Graduate School of Medicine, Tokyo, Japan
| |
Collapse
|
4
|
Racano E, Malfatti G, Pertile R, Delle Site R, Romanelli F, Nicolini A. A novel smartphone App to support the clinical practice of pediatric ophthalmology and strabismus: the validation of visual acuity tests. Eur J Pediatr 2023; 182:4007-4013. [PMID: 37386193 DOI: 10.1007/s00431-023-05058-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/20/2023] [Revised: 05/08/2023] [Accepted: 06/06/2023] [Indexed: 07/01/2023]
Abstract
This study is aimed at describing the TreC Oculistica novel smartphone App that facilitated the clinical practice of pediatric ophthalmology and strabismus during the COVID-19 pandemic and at reporting on the validation of visual acuity tests in a home setting. The Trec Oculistica smartphone App was prescribed to eligible patients at the Pediatric Ophthalmology and Strabismus Clinic, Ophthalmology Unit of Rovereto Hospital, between September 2020 and March 2022. Four key indicators were identified for monitoring visual and visuo-motor functions remotely: visual acuity, ocular motility, head posture, and color vision. Clinicians selected few mobile applications (iOS, Android) and printable materials within the Trec Oculistica App: the Snellen Chart Visual Acuity App, the 9Gaze App, the eyeTilt App, the Color Blind test App, the LEA Symbols pdf, and the Snellen Chart pdf. All patients, aged 4 and older, were screened at home for visual acuity at 3 m and later in the clinic (LEA Symbols cabinet or Snellen computerized optotype). The 9Gaze, the eyeTilt, and the Color Blind test Apps were only recommended to a subset of patients based on clinical suspicion or diagnosis. The Wilcoxon signed rank sum test and weighted Cohen's kappa coefficient were applied to compare pairs of scores from different settings. The Trec Oculistica App was downloaded and activated by 97 patients or their caregiver. 40 patients were tested at home using the 9Gaze App, 7 used the eyeTilt App, and 11 used the Color-Blind test App. Families reported that all the Apps were easy and intuitive to use; clinicians reported that measurements were reliable. 82 eyes of 41 patients (mean age 5.2 years, SD ± 0.4, range 4.4-6.1) were tested for visual acuity using the self-administered LEA Symbols pdf. 92 eyes of 46 patients (mean age 11.6 years, SD ± 5.2, range 6-35) were evaluated using the self-administered Snellen Chart Visual Acuity App or the Snellen Chart pdf. Home median visual acuity score was statistically different from that registered in clinical setting for both the LEA Symbols pdf (P-value = 0.0074) and the Snellen Chart App and pdf (P-value = 0.0001). The strength of agreement was 0.12 (slight) for the LEA Symbols pdf, 0.50 (moderate) for the Snellen Chart Visual Acuity App, and 0.69 (substantial) for the Snellen Chart pdf. CONCLUSION The novel TreC Oculistica smartphone App was a useful tool for facilitating the clinical practice of pediatric ophthalmology and strabismus during the COVID-19 pandemic. In the follow-up of strabismus patients and patients with suspected inherited retinal diseases, the 9Gaze, eyeTilt, and Color Blind test applications were deemed to be intuitive and easy to use by families and were considered reliable by clinicians. In a home setting, visual acuity tested by means of Snellen Charts was moderately congruent with the in-office examination. On the contrary, agreement was poor in younger children tested with the LEA Symbols pdf. WHAT IS KNOWN • Teleophthalmology enables clinicians to evaluate patients' ocular diseases remotely and various tools are helpful for screening, follow-ups and treatment. • Smartphones can currently be used to obtain ocular images and vision measurements of patients' eyes and this information can be shared with the ophthalmologist for further evaluations and medical management (mhealth). WHAT IS NEW • Smartphone Apps can be successfully used in a hybrid teleophthalmology service concerning first visits and follow-ups. • Apps and printable materials are easy, intuitive to use for patients and also reliable for clinicians.
Collapse
Affiliation(s)
| | - Giulia Malfatti
- , TrentinoSalute4.0, Fondazione Bruno Kessler, Trento, Italy
| | - Riccardo Pertile
- Department of Clinical and Evaluative Epidemiology, APSS, Trento, Italy
| | | | | | - Andrea Nicolini
- , TrentinoSalute4.0, Fondazione Bruno Kessler, Trento, Italy
| |
Collapse
|
5
|
Malfatti G, Racano E, Delle Site R, Gios L, Micocci S, Dianti M, Molini PB, Allegrini F, Ravagni M, Moz M, Nicolini A, Romanelli F. Enabling teleophthalmology during the COVID-19 pandemic in the Province of Trento, Italy: Design and implementation of a mHealth solution. PLoS One 2021; 16:e0257250. [PMID: 34506578 PMCID: PMC8432860 DOI: 10.1371/journal.pone.0257250] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2021] [Accepted: 08/26/2021] [Indexed: 12/28/2022] Open
Abstract
BACKGROUND Due to the many restrictions imposed during the COVID-19 emergency, the normal clinical activities have been stopped abruptly in view of limiting the circulation of the virus. The extraordinary containment measures have had a dramatic impact on the undertaking and follow-up of ophthalmic outpatients. OBJECTIVE In order to guarantee proper monitoring and routine care, the Pediatric Ophthalmology equipe of Rovereto Hospital (North-East of Italy) supported by the Competence Center on Digital Health TrentinoSalute4.0, designed and implemented a digital platform, TreC Oculistica, enabling teleophthalmology. We report our innovative-albeit restricted-experience aiming at testing and maximizing the efficacy of remote ophthalmic and orthoptic visits. METHODS A multidisciplinary team created the TreC Oculistica platform and defined a teleophthalmology protocol. The system consists of a clinician web interface and a patient mobile application. Clinicians can prescribe outpatients with the App and some preliminary measurements to be self-collected before the televisit. The App conveys the clinician's requests (i.e. measurements) and eases the share of the collected information in a secure digital environment, promoting a new health care workflow. RESULTS Four clinicians took part in the testing phase (2 ophthalmologists and 2 orthoptists) and recruited 37 patients (mostly pediatric) in 3 months. Thanks to a continuous feedback between the testing and the technical implementation, it has been possible to identify pros and cons of the implemented functionalities, considering possible improvements. Digital solutions such as TreC Oculistica advance the digitalization of the Italian health care system, promoting a structured and effective reorganization of the workload supported by digital systems. CONCLUSIONS The study tested an innovative digital solution in the teleophthalmology context and represented the first experience within the Italian healthcare system. This solution opens up new possibilities and scenarios that can be effective not only during the pandemic, but also in the traditional management of public health services.
Collapse
Affiliation(s)
- Giulia Malfatti
- TrentinoSalute4.0, Competence Center for Digital Health of the Province of Trento, Trento, Italy
| | - Elisabetta Racano
- Azienda Provinciale per i Servizi Sanitari, U.O. di Oculistica, Ospedale di Rovereto, Trento, Italy
| | - Roberta Delle Site
- Azienda Provinciale per i Servizi Sanitari, U.O. di Oculistica, Ospedale di Rovereto, Trento, Italy
| | - Lorenzo Gios
- TrentinoSalute4.0, Competence Center for Digital Health of the Province of Trento, Trento, Italy
| | | | - Marco Dianti
- Fondazione Bruno Kessler, Digital Health Lab, Povo, Italy
| | | | - Francesca Allegrini
- Azienda Provinciale per i Servizi Sanitari, U.O. di Oculistica, Ospedale di Rovereto, Trento, Italy
| | - Mariangela Ravagni
- Azienda Provinciale per i Servizi Sanitari, U.O. di Oculistica, Ospedale di Rovereto, Trento, Italy
| | - Monica Moz
- TrentinoSalute4.0, Competence Center for Digital Health of the Province of Trento, Trento, Italy
| | - Andrea Nicolini
- TrentinoSalute4.0, Competence Center for Digital Health of the Province of Trento, Trento, Italy
| | - Federica Romanelli
- Azienda Provinciale per i Servizi Sanitari, U.O. di Oculistica, Ospedale di Rovereto, Trento, Italy
| |
Collapse
|
6
|
Hwang Y, Shin D, Eun J, Suh B, Lee J. Design Guidelines of a Computer-Based Intervention for Computer Vision Syndrome: Focus Group Study and Real-World Deployment. J Med Internet Res 2021; 23:e22099. [PMID: 33779568 PMCID: PMC8088848 DOI: 10.2196/22099] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2020] [Revised: 01/05/2021] [Accepted: 02/25/2021] [Indexed: 01/26/2023] Open
Abstract
Background Prolonged time of computer use increases the prevalence of ocular problems, including eye strain, tired eyes, irritation, redness, blurred vision, and double vision, which are collectively referred to as computer vision syndrome (CVS). Approximately 70% of computer users have vision-related problems. For these reasons, properly designed interventions for users with CVS are required. To design an effective screen intervention for preventing or improving CVS, we must understand the effective interfaces of computer-based interventions. Objective In this study, we aimed to explore the interface elements of computer-based interventions for CVS to set design guidelines based on the pros and cons of each interface element. Methods We conducted an iterative user study to achieve our research objective. First, we conducted a workshop to evaluate the overall interface elements that were included in previous systems for CVS (n=7). Through the workshop, participants evaluated existing interface elements. Based on the evaluation results, we eliminated the elements that negatively affect intervention outcomes. Second, we designed our prototype system LiquidEye that includes multiple interface options (n=11). Interface options included interface elements that were positively evaluated in the workshop study. Lastly, we deployed LiquidEye in the real world to see how the included elements affected the intervention outcomes. Participants used LiquidEye for 14 days, and during this period, we collected participants’ daily logs (n=680). Additionally, we conducted prestudy and poststudy surveys, and poststudy interviews to explore how each interface element affects participation in the system. Results User data logs collected from the 14 days of deployment were analyzed with multiple regression analysis to explore the interface elements affecting user participation in the intervention (LiquidEye). Statistically significant elements were the instruction page of the eye resting strategy (P=.01), goal setting of the resting period (P=.009), compliment feedback after completing resting (P<.001), a mid-size popup window (P=.02), and CVS symptom-like effects (P=.004). Conclusions Based on the study results, we suggested design implications to consider when designing computer-based interventions for CVS. The sophisticated design of the customization interface can make it possible for users to use the system more interactively, which can result in higher engagement in managing eye conditions. There are important technical challenges that still need to be addressed, but given the fact that this study was able to clarify the various factors related to computer-based interventions, the findings are expected to contribute greatly to the research of various computer-based intervention designs in the future.
Collapse
Affiliation(s)
- Youjin Hwang
- Human Computer Interaction and Design Lab, Seoul National University, Seoul, Republic of Korea
| | - Donghoon Shin
- Human Computer Interaction and Design Lab, Seoul National University, Seoul, Republic of Korea
| | - Jinsu Eun
- Human Computer Interaction and Design Lab, Seoul National University, Seoul, Republic of Korea
| | - Bongwon Suh
- Seoul National University, Seoul, Republic of Korea
| | - Joonhwan Lee
- Human Computer Interaction and Design Lab, Seoul National University, Seoul, Republic of Korea
| |
Collapse
|
7
|
Steren BJ, Young B, Chow J. Visual Acuity Testing for Telehealth Using Mobile Applications. JAMA Ophthalmol 2021; 139:344-347. [PMID: 33443550 DOI: 10.1001/jamaophthalmol.2020.6177] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
Abstract
Importance The coronavirus disease 2019 pandemic illustrates the increasingly important role of telemedicine as a method of clinician-patient interaction. However, electronic applications (apps) for the testing of ophthalmology vital signs, such as visual acuity, can be published and used without any verification of accuracy, validity, or reliability. Objective To reassess the accuracy of visual acuity-testing apps and assess their viability for telehealth. Design, Setting, and Participants The US Apple App Store was queried for apps for visual acuity testing. Anticipated optotype size for various visual acuity lines were calculated and compared against the actual measured optotype size on 4 different Apple hardware devices. No human participants were part of this study. Main Outcomes and Measures Mean (SD) errors were calculated per device and across multiple devices. Results On iPhones, 10 apps met inclusion criteria, with mean errors ranging from 0.2% to 109.9%. On the iPads, 9 apps met inclusion criteria, with mean errors ranging from 0.2% to 398.1%. Six apps met criteria and worked on both iPhone and iPad, with mean errors from 0.2% to 249.5%. Of the 6 apps that worked across devices, the top 3 most accurate apps were Visual Acuity Charts (mean [SD] error, 0.2% [0.0%]), Kay iSight Test Professional (mean [SD] error, 3.5% [0.7%]), and Smart Optometry (mean [SD] error, 15.9% [4.3%]). None of the apps tested were ideal for telemedicine, because some apps displayed accurate optotype size, while others displayed the same letters on separate devices; no apps exhibited both characteristics. Conclusions and Relevance Both Visual Acuity Charts and Kay iSight Test Professional had low mean (SD) errors and functionality across all tested devices, but no apps were suitable for telemedicine. This suggests that new and/or improved visual acuity-testing apps are necessary for optimal telemedicine use.
Collapse
Affiliation(s)
- Benjamin J Steren
- Department of Ophthalmology and Visual Sciences, Yale School of Medicine, New Haven, Connecticut
| | - Benjamin Young
- Department of Ophthalmology and Visual Sciences, Yale School of Medicine, New Haven, Connecticut
| | - Jessica Chow
- Department of Ophthalmology and Visual Sciences, Yale School of Medicine, New Haven, Connecticut
| |
Collapse
|
8
|
Mansoor H, Khan SA, Afghani T, Assir MZ, Ali M, Khan WA. Utility of teleconsultation in accessing eye care in a developing country during COVID-19 pandemic. PLoS One 2021; 16:e0245343. [PMID: 33444381 PMCID: PMC7808582 DOI: 10.1371/journal.pone.0245343] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2020] [Accepted: 12/29/2020] [Indexed: 11/19/2022] Open
Abstract
OBJECTIVE To evaluate the utility of teleconsultation in the provision of eye care services during the COVID-19 lockdown. Disparities in the consultation burden of sub-specialities and socio-demographic differences in teleconsultation utilization were also assessed. METHODS Al-Shifa Trust Eye Hospital Rawalpindi began audio and video teleconsultation using broadband telecommunication services during the lockdown. Patients' and consultations' data gathered during the first three weeks after the commencement of this programme were compared with data from the four weeks prior to lockdown. The weekly consultation ratio and overall consultation burden of sub-specialities were measured. Chi-Square tests of association determined the relationship between different variables (socioeconomic status and consultation characteristics) and consultation modality (on-site vs online). RESULTS In total, 17507 on-site consultations (4377/week) were conducted compared to 1431 teleconsultations (477/week), which maintained 10.89% of the weekly pre-lockdown eye care services. The post-lockdown teleconsultation programme saw a relatively higher percentage of service utility among female (47.09% vs 44.71%), younger-age (31.33±19.45 vs 41.25±23.32 years) and higher-socioeconomic-status (32.21% vs 0.30%) patients compared to pre-lockdown on-site consultations. The most common indication for teleconsultation was red-eye (16.70%). While cornea and glaucoma clinics maintained most of the pre-lockdown services (30.42% and 29% respectively), the highest dropout was seen in optometric and vitreoretinal services supporting only 5.54% and 8.28% of pre-lockdown services, respectively. CONCLUSION Digital initiatives could partially maintain eye care services during the lockdown. Focused strategies to improve teleconsultation utilization are required during the pandemic and beyond.
Collapse
Affiliation(s)
- Hassan Mansoor
- Al-Shifa Trust Eye Hospital, Rawalpindi, Pakistan
- * E-mail: (WAK); (HM)
| | | | | | - Muhammad Zaman Assir
- Department of Medicine, Allama Iqbal Medical College, University of Health Sciences, Lahore, Pakistan
| | - Mahmood Ali
- Al-Shifa Trust Eye Hospital, Rawalpindi, Pakistan
| | - Wajid Ali Khan
- Al-Shifa Trust Eye Hospital, Rawalpindi, Pakistan
- * E-mail: (WAK); (HM)
| |
Collapse
|
9
|
Yang M, Lo ACY, Lam WC. Smart phone apps every ophthalmologist should know about. Int J Ophthalmol 2020; 13:1329-1333. [PMID: 32821689 DOI: 10.18240/ijo.2020.08.21] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2019] [Accepted: 03/09/2020] [Indexed: 12/28/2022] Open
Abstract
We are living in a mobile world, where the number of medical apps is surging in recent years. Over 320 000 healthcare apps are now available as shown in the latest research. The major function and potential of these apps vary, from assisting the learning and practice of clinicians as well as achieving better outcomes of patients to preventing eye diseases through the education of healthy individuals. However, based on the various features, ophthalmology apps nowadays contain a wide range of subjects and focus on different stakeholders in the ophthalmic practice, including but not limited to doctors, patients, and researchers. Here, we review special and advanced apps that ophthalmologists will find useful in their clinical practice.
Collapse
Affiliation(s)
- Ming Yang
- Department of Ophthalmology, Li Ka Shing Faculty of Medicine, the University of Hong Kong, Hong Kong Special Administrative Region 999077, China
| | - Amy Cheuk Yin Lo
- Department of Ophthalmology, Li Ka Shing Faculty of Medicine, the University of Hong Kong, Hong Kong Special Administrative Region 999077, China
| | - Wai Ching Lam
- Department of Ophthalmology, Li Ka Shing Faculty of Medicine, the University of Hong Kong, Hong Kong Special Administrative Region 999077, China
| |
Collapse
|
10
|
Tian L, Zhang K, Wang X, Jiang K, Gao W, Liang N, Wang X, Miao Y, Lu Z. Utilization of Mobile Application for Better Implementation of Good Clinical Practice in a Biorepository Sample Collection Process: Functions of PancMoBio in Biobanking. Biopreserv Biobank 2020; 18:46-52. [PMID: 31910345 DOI: 10.1089/bio.2019.0025] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Abstract
Preanalytical variables of biospecimens play a vital role in biobanking. Currently, there is a lack of a convenient and precise methods to document these variables. Paper documentation and computer-based Lab Information Management System software are the most common solutions, but both have clear disadvantages. An application named PancMoBio was newly developed in our pancreas biobank, with the guidance of good clinical practice principles as well as the incorporation of technical support from professional software companies. With portable electronic devices running this application, all data can be precisely collected in a synchronous manner during sample collection and processing. PancMoBio comprises two major modules-recording and searching-and five submodules in the recording module: blood sample collection, solid tumor tissue sample collection, cystic tumor sample collection, plasma sample separation, and serum sample separation. Compared with other methods, our application was found to be more convenient and accurate in recording preanalytical variables and demonstrated improved capability in facilitating real-time quality control and quality assurance. It was apparent that PancMoBio could improve the integrity of biospecimen and biobank quality management. Thus, it should be considered for further utilization in biobanking.
Collapse
Affiliation(s)
- Lei Tian
- Pancreas Center, The First Affiliated Hospital of Nanjing Medical University, Nanjing, P.R. China.,Pancreas Biobank, The First Affiliated Hospital of Nanjing Medical University, Nanjing, P.R. China.,Pancreas Institute of Nanjing Medical University, Nanjing, P.R. China
| | - Kai Zhang
- Pancreas Center, The First Affiliated Hospital of Nanjing Medical University, Nanjing, P.R. China.,Pancreas Biobank, The First Affiliated Hospital of Nanjing Medical University, Nanjing, P.R. China.,Pancreas Institute of Nanjing Medical University, Nanjing, P.R. China
| | - Xiao Wang
- Yozo Software Company, Wuxi, P.R. China
| | - Kuirong Jiang
- Pancreas Center, The First Affiliated Hospital of Nanjing Medical University, Nanjing, P.R. China.,Pancreas Biobank, The First Affiliated Hospital of Nanjing Medical University, Nanjing, P.R. China.,Pancreas Institute of Nanjing Medical University, Nanjing, P.R. China
| | - Wentao Gao
- Pancreas Center, The First Affiliated Hospital of Nanjing Medical University, Nanjing, P.R. China.,Pancreas Biobank, The First Affiliated Hospital of Nanjing Medical University, Nanjing, P.R. China.,Pancreas Institute of Nanjing Medical University, Nanjing, P.R. China
| | - Ningxia Liang
- Department of Science and Technology, The First Affiliated Hospital of Nanjing Medical University, Nanjing, P.R. China
| | - Xiuqin Wang
- Department of Science and Technology, The First Affiliated Hospital of Nanjing Medical University, Nanjing, P.R. China
| | - Yi Miao
- Pancreas Center, The First Affiliated Hospital of Nanjing Medical University, Nanjing, P.R. China.,Pancreas Biobank, The First Affiliated Hospital of Nanjing Medical University, Nanjing, P.R. China.,Pancreas Institute of Nanjing Medical University, Nanjing, P.R. China
| | - Zipeng Lu
- Pancreas Center, The First Affiliated Hospital of Nanjing Medical University, Nanjing, P.R. China.,Pancreas Biobank, The First Affiliated Hospital of Nanjing Medical University, Nanjing, P.R. China.,Pancreas Institute of Nanjing Medical University, Nanjing, P.R. China
| |
Collapse
|
11
|
Olivero E, Bert F, Thomas R, Scarmozzino A, Raciti IM, Gualano MR, Siliquini R. E-tools for hospital management: An overview of smartphone applications for health professionals. Int J Med Inform 2019; 124:58-67. [PMID: 30784427 DOI: 10.1016/j.ijmedinf.2019.01.010] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2018] [Revised: 10/15/2018] [Accepted: 01/17/2019] [Indexed: 12/20/2022]
Abstract
BACKGROUND Commonly, management of the main hospital activities is organized by different software packages that run on desktop computers, which may not always allow fast and practical use by health operators. This problem could be alleviated by combining these software packages with mobile health. The aim of this study is to provide an overview of smartphone and tablet applications used for hospital management and administration in order to evaluate their features and analyze them according to their content, number of downloads and field of application. METHODS Researchers performed the survey on the two main application stores available on the Internet: iTunes for Apple devices and Google Play for Android devices. Using specific keywords, 47 apps that met the inclusion criteria were identified. RESULTS Most of the applications were designed for health operators and patient management (76.6%); 12.8% of the apps were focused on the organization and setting of hospital resources, and 10.6% of the apps could help hospital administrators perform self-evaluations of their structures, processes and outcomes. The large majority of apps (80.7%) counted less than 1000 downloads. Most of them (87.5%) were in English and free to download (93.6%). DISCUSSION The results of the first attempt to provide an overview of this emerging topic showed that, despite the existence of several applications for hospital management purposes, these tools appear to be not very widespread. In our opinion, there is a strong need to further assess the quality of these applications; thus, it may be worth continuing to monitor this field in order to analyze eventual improvements in the design and distribution of these apps.
Collapse
Affiliation(s)
- E Olivero
- Department of Public Health Sciences, University of Turin, Italy
| | - F Bert
- Department of Public Health Sciences, University of Turin, Italy
| | - R Thomas
- Department of Public Health Sciences, University of Turin, Italy.
| | | | - I M Raciti
- A.O.U. City of Health and Science of Turin, Italy
| | - M R Gualano
- Department of Public Health Sciences, University of Turin, Italy
| | - R Siliquini
- Department of Public Health Sciences, University of Turin, Italy
| |
Collapse
|
12
|
Millenson ML, Baldwin JL, Zipperer L, Singh H. Beyond Dr. Google: the evidence on consumer-facing digital tools for diagnosis. ACTA ACUST UNITED AC 2018; 5:95-105. [PMID: 30032130 DOI: 10.1515/dx-2018-0009] [Citation(s) in RCA: 43] [Impact Index Per Article: 7.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2018] [Accepted: 06/01/2018] [Indexed: 12/17/2022]
Abstract
Over a third of adults go online to diagnose their health condition. Direct-to-consumer (DTC), interactive, diagnostic apps with information personalization capabilities beyond those of static search engines are rapidly proliferating. While these apps promise faster, more convenient and more accurate information to improve diagnosis, little is known about the state of the evidence on their performance or the methods used to evaluate them. We conducted a scoping review of the peer-reviewed and gray literature for the period January 1, 2014–June 30, 2017. We found that the largest category of evaluations involved symptom checkers that applied algorithms to user-answered questions, followed by sensor-driven apps that applied algorithms to smartphone photos, with a handful of evaluations examining crowdsourcing. The most common clinical areas evaluated were dermatology and general diagnostic and triage advice for a range of conditions. Evaluations were highly variable in methodology and conclusions, with about half describing app characteristics and half examining actual performance. Apps were found to vary widely in functionality, accuracy, safety and effectiveness, although the usefulness of this evidence was limited by a frequent failure to provide results by named individual app. Overall, the current evidence base on DTC, interactive diagnostic apps is sparse in scope, uneven in the information provided and inconclusive with respect to safety and effectiveness, with no studies of clinical risks and benefits involving real-world consumer use. Given that DTC diagnostic apps are rapidly evolving, rigorous and standardized evaluations are essential to inform decisions by clinicians, patients, policymakers and other stakeholders.
Collapse
Affiliation(s)
- Michael L Millenson
- Health Quality Advisors LLC, Highland Park, IL 60035, USA
- Northwestern University Feinberg School of Medicine, Department of General Internal Medicine and Geriatrics, Chicago, IL, USA
| | - Jessica L Baldwin
- Center for Innovations in Quality, Effectiveness and Safety, Michael E. DeBakey VA Medical Center, Houston, TX, USA
- Department of Medicine, Baylor College of Medicine, Houston, TX, USA
| | | | - Hardeep Singh
- Center for Innovations in Quality, Effectiveness and Safety, Michael E. DeBakey VA Medical Center, Houston, TX, USA
- Department of Medicine, Baylor College of Medicine, Houston, TX, USA
| |
Collapse
|
13
|
Paglialonga A, Lugo A, Santoro E. An overview on the emerging area of identification, characterization, and assessment of health apps. J Biomed Inform 2018; 83:97-102. [PMID: 29852318 DOI: 10.1016/j.jbi.2018.05.017] [Citation(s) in RCA: 48] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2018] [Revised: 05/22/2018] [Accepted: 05/27/2018] [Indexed: 11/18/2022]
Abstract
The need to characterize and assess health apps has inspired a significant amount of research in the past years, in search for methods able to provide potential app users with relevant, meaningful knowledge. This article presents an overview of the recent literature in this field and categorizes - by discussing some specific examples - the various methodologies introduced so far for the identification, characterization, and assessment of health apps. Specifically, this article outlines the most significant web-based resources for app identification, relevant frameworks for descriptive characterization of apps' features, and a number of methods for the assessment of quality along its various components (e.g., evidence base, trustworthiness, privacy, or user engagement). The development of methods to characterize the apps' features and to assess their quality is important to define benchmarks and minimum requirements. Similarly, such methods are important to categorize potential risks and challenges in the field so that risks can be minimized, whenever possible, by design. Understanding methods to assess apps is key to raise the standards of quality of health apps on the market, towards the final goal of delivering apps that are built on the pillars of evidence-base, reliability, long-term effectiveness, and user-oriented quality.
Collapse
Affiliation(s)
- Alessia Paglialonga
- CNR - Consiglio Nazionale delle Ricerche, Istituto di Elettronica e di Ingegneria dell'Informazione e delle Telecomunicazioni (IEIIT), Piazza Leonardo da Vinci, 32, I-20133 Milan, Italy.
| | - Alessandra Lugo
- IRCCS - Istituto di Ricerche Farmacologiche "Mario Negri", Dipartimento di Ambiente e Salute, Laboratorio di Epidemiologia degli Stili di Vita, Via La Masa, 19, I-20156 Milan, Italy
| | - Eugenio Santoro
- IRCCS - Istituto di Ricerche Farmacologiche "Mario Negri", Dipartimento di Salute Pubblica, Laboratorio di Informatica Medica, Via La Masa, 19, I-20156 Milan, Italy
| |
Collapse
|