1
|
Holt KD, Roman G, McIntosh L, Kleinsorge J, Holden-Wiltse J, Bennett NM. RocHealthData.org: Development and usage of a publicly available, geographic source of social determinants of health data. J Clin Transl Sci 2024; 8:e41. [PMID: 38476248 PMCID: PMC10928699 DOI: 10.1017/cts.2024.484] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2023] [Revised: 12/27/2023] [Accepted: 02/02/2024] [Indexed: 03/14/2024] Open
Abstract
Access to local, population specific, and timely data is vital in understanding factors that impact population health. The impact of place (neighborhood, census tract, and city) is particularly important in understanding the Social Determinants of Health. The University of Rochester Medical Center's Clinical and Translational Science Institute created the web-based tool RocHealthData.org to provide access to thousands of geographically displayed publicly available health-related datasets. The site has also hosted a variety of locally curated datasets (eg., COVID-19 vaccination rates and community-derived health indicators), helping set community priorities and impacting outcomes. Usage statistics (available through Google Analytics) show returning visitors with a lower bounce rate (leaving a site after a single page access) and spent longer at the site than new visitors. Of the currently registered 1033 users, 51.7% were from within our host university, 20.1% were from another educational institution, and 28.2% identified as community members. Our assessments indicate that these data are useful and valued across a variety of domains. Continuing site improvement depends on new sources of locally relevant data, as well as increased usage of data beyond our local region.
Collapse
Affiliation(s)
- Kathleen D. Holt
- Clinical and Translational Science Institute, University of Rochester, Rochester, NY, USA
- Center for Community Health and Prevention, University of Rochester, Rochester, NY, USA
| | - Gretchen Roman
- Department of Family Medicine, University of Rochester, Rochester, NY, USA
| | - Laura McIntosh
- Center for Community Health and Prevention, University of Rochester, Rochester, NY, USA
| | - Jamie Kleinsorge
- Center for Applied Research and Engagement Systems, University of Missouri, Columbia, MO, USA
| | - Jeanne Holden-Wiltse
- Clinical and Translational Science Institute, University of Rochester, Rochester, NY, USA
| | - Nancy M. Bennett
- Clinical and Translational Science Institute, University of Rochester, Rochester, NY, USA
- Department of Medicine, School of Medicine and Dentistry, Rochester, NY, USA
| |
Collapse
|
2
|
Juel A, Berring LL, Erlangsen A, Larsen ER, Buus N. Sense of psychological ownership in co-design processes: A case study. Health Expect 2023; 27:e13886. [PMID: 37890859 PMCID: PMC10726143 DOI: 10.1111/hex.13886] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2023] [Revised: 09/27/2023] [Accepted: 09/28/2023] [Indexed: 10/29/2023] Open
Abstract
INTRODUCTION Service users are increasingly participating in health research. Although collaborative research is assumed to give users a sense of psychological ownership, little is known about the specific psychosocial processes through which ownership develops and is displayed. The present study yields insight into a process in which service users, researchers and a website designer collaborated to design a website. AIM The aim of this study was to explore how participants developed and displayed feelings of ownership during a collaborative process to design a website. METHODS A case study design was adopted by which audio recordings were subjected to thematic analysis and interpreted by drawing on the concept of psychological ownership. FINDINGS A sense of psychological ownership of the website design process emerged in two distinct and overlapping phases. In the first phase, 'sense of ownership during the early design phase', only researchers and the website designer displayed a sense of ownership, which was facilitated by the research context preceding the collaborative workshops. In the second phase, 'sense of ownership during the collaborative design phase', service users gradually started to develop parallel feelings of ownership that were facilitated by workshop design activities. These activities enabled service users to increasingly control the process, to invest themselves in the process and to gain intimate knowledge of the process and its outcome. Service users' sense of ownership was displayed in their statements about the website and its elements. CONCLUSION Participants engaged in codesign processes may develop a sense of psychological ownership at different speeds because of contextual factors. It is important to take this into account as it may complicate the formation of egalitarian work groups. PATIENT AND PUBLIC CONTRIBUTION Parents of children with suicidal behaviour and a counsellor participated as service users in a website design process.
Collapse
Affiliation(s)
- Anette Juel
- Psychiatric Research UnitPsychiatry Region ZealandSlagelseDenmark
- Mental Health Centre CopenhagenDanish Research Institute for Suicide PreventionHellerupDenmark
- Department of Regional Health ResearchUniversity of Southern DenmarkOdenseDenmark
| | - Lene L. Berring
- Psychiatric Research UnitPsychiatry Region ZealandSlagelseDenmark
- Department of Regional Health ResearchUniversity of Southern DenmarkOdenseDenmark
| | - Annette Erlangsen
- Mental Health Centre CopenhagenDanish Research Institute for Suicide PreventionHellerupDenmark
- Department of Mental HealthJohns Hopkins Bloomberg School of Public HealthBaltimoreMarylandUSA
- Center of Mental Health ResearchThe Australian National UniversityCanberraAustralian Capital TerritoryAustralia
- Copenhagen Research Center for Mental HealthMental Health Centre CopenhagenHellerupDenmark
| | - Erik R. Larsen
- Translational Neuropsychiatry Unit, Department of Clinical MedicineAarhus UniversityAarhus NuDenmark
| | - Niels Buus
- Department of Regional Health ResearchUniversity of Southern DenmarkOdenseDenmark
- School of Nursing and Midwifery, Faculty of Medicine, Nursing and HealthMonash UniversityClaytonVictoriaAustralia
| |
Collapse
|
3
|
Vilaro MJ, McAlindon K, Mertens G, Ashley T, Zalake M, Cooks EJ, Krieger JL. Information Architects: Using Community-Engaged and Qualitative Methods to Design a Technology-Based Nutrition and Cancer Risk Intervention for Rural Adults. Cancer Control 2023; 30:10732748221130162. [PMID: 36919704 PMCID: PMC10017944 DOI: 10.1177/10732748221130162] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/16/2023] Open
Abstract
BACKGROUND Nearly half of all cancer deaths are preventable through modification or avoidance of key risk factors. As such, there is a growing urgency to identify effective, low-resource, and scalable technologies that support clinical care and patient self-management of health behaviors. PURPOSE Informed by theories of cognitive load and user-centered design approaches, we develop a culturally tailored, multicomponent digital intervention to engage rural adults between 50-73 years old with their personalized nutrition risk factors for colorectal cancer (CRC) prevention. METHOD A total of 48 adults tested a Virtual Health Assistant (VHA) prototype during focus groups in individual think-aloud interviews to facilitate iterative adaptations to a web-based CRC prevention intervention. Qualitative data was analyzed to identify user needs and preferences related to information and with a focus on avoiding cognitive overload. RESULTS The VHA serves as a conceptual pre-training for users helping them understand CRC prevention key concepts and engendering motivation to act on the promoted behavior. A website was identified as a strategy to fill information gaps and present actionable information, after the VHA interaction. Cognitive load reducing strategies were used including segmenting where information is presented in learner-controlled segments rather than continuously. CONCLUSIONS Findings indicate potential benefits of designing CRC prevention information technologies with the rural older adults. Integrating patient-centered needs before launching health information web content will be important as the rapid growth of telemedicine aims to reach traditionally marginalized and underserved populations. Theoretically informed considerations for potential adverse outcomes (eg, information overload) are discussed.
Collapse
Affiliation(s)
- Melissa J. Vilaro
- Department of Family, Youth and Community Sciences, University of Florida, Gainesville, FL, USA
- Melissa J. Vilaro, PhD, MPH, Institute of Food and Agricultural Sciences, Department of Family, Youth and Community Sciences, University of Florida, PO Box 110310, Gainesville, FL 32611-310, USA.
| | - Kathryn McAlindon
- STEM Translational Communication Center, University of Florida, Gainesville, FL, USA
| | - Gillian Mertens
- STEM Translational Communication Center, University of Florida, Gainesville, FL, USA
| | - Taylor Ashley
- STEM Translational Communication Center, University of Florida, Gainesville, FL, USA
| | - Mohan Zalake
- Computer & Information Sciences & Engineering, University of Florida, Gainesville, FL, USA
| | - Eric J. Cooks
- STEM Translational Communication Center, University of Florida, Gainesville, FL, USA
| | - Janice L. Krieger
- STEM Translational Communication Center, University of Florida, Gainesville, FL, USA
| |
Collapse
|
4
|
Lau KPL, Agarwal P, Parente L, Marcello O, Lovas M, Van J, Vigod SN, Champagne T, Mohan T, Arents BW, Burton T, Flohr C, Drucker AM. Development of a Website for a Living Network Meta-analysis of Atopic Dermatitis Treatments Using a User-Centered Design: Multimethod Study. JMIR Dermatol 2022; 5:e41201. [PMID: 37632894 PMCID: PMC10334921 DOI: 10.2196/41201] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2022] [Revised: 08/25/2022] [Accepted: 08/26/2022] [Indexed: 11/13/2022] Open
Abstract
BACKGROUND A rapid expansion of systemic immunological treatment options for atopic dermatitis (AD) has created a need for clinically relevant and understandable comparative efficacy and safety information for patients and clinicians. Given the scarcity of head-to-head trials, network meta-analysis (NMA) is an alternative way to enable robust comparisons among treatment options; however, NMA results are often complex and difficult to directly implement in shared decision-making. OBJECTIVE The aim of this study is to develop a website that effectively presents the results of a living systematic review and NMA on AD treatments to patient and clinician users. METHODS We conducted a multimethod study using iterative feedback from adults with AD, adult caregivers of children with AD, dermatologists, and allergists within a user-centered design framework. We used questionnaires followed by workshops among patients and clinicians to develop and improve the website interface. Usability testing was done with a caregiver of a patient with eczema. RESULTS Questionnaires were completed by 31 adults with AD or caregivers and 94 clinicians. Patients and caregivers felt it was very important to know about new treatments (20/31, 65%). Clinicians felt the lack of evidence-based comparisons between treatments was a barrier to care (55/93, 59%). "Avoiding dangerous side effects" was ranked as the most important priority for patients (weighted ranking 5.2/7, with higher ranking being more important), and "improving patients' overall symptoms" was the most important priority for clinicians (weighted ranking 5.0/6). A total of 4 patients and 7 clinicians participated in workshops; they appreciated visualizations of the NMA results and found the website valuable for comparing different treatments. The patients suggested changes to simplify the interface and clarify terminology related to comparative efficacy. The user in the usability testing found the website intuitive to navigate. CONCLUSIONS We developed a website, "eczematherapies.com," with a user-centered design approach. Visualizations of NMA results enable users to compare treatments as part of their shared decision-making process.
Collapse
Affiliation(s)
- Karen P L Lau
- Women's College Research Institute, Women's College Hospital, Toronto, ON, Canada
| | - Payal Agarwal
- Women's College Research Institute, Women's College Hospital, Toronto, ON, Canada
- Family and Community Medicine, University of Toronto, Toronto, ON, Canada
| | - Laura Parente
- Healthcare Human Factors, University Health Network, Toronto, ON, Canada
| | - Olivia Marcello
- Healthcare Human Factors, University Health Network, Toronto, ON, Canada
| | - Mike Lovas
- Cancer Digital Intelligence, Princess Margaret Cancer Centre, University Health Network, Toronto, ON, Canada
| | | | - Simone N Vigod
- Women's College Research Institute, Women's College Hospital, Toronto, ON, Canada
- Institute of Health Policy, Management, and Evaluation, Dalla Lana School of Public Health, University of Toronto, Toronto, ON, Canada
- Department of Psychiatry, University of Toronto, Toronto, ON, Canada
| | - Trevor Champagne
- Women's College Research Institute, Women's College Hospital, Toronto, ON, Canada
- Dermatology Division, Sunnybrook Health Sciences Centre, Toronto, ON, Canada
| | - Tanya Mohan
- Specialty Health Network, Shoppers Drug Mart, Toronto, ON, Canada
| | - Bernd Wm Arents
- Dutch Association for People with Atopic Dermatitis, Nijkerk, Netherlands
| | | | - Carsten Flohr
- Unit for Population-Based Dermatology Research, St John's Institute of Dermatology, Guy's & St Thomas' NHS Foundation Trust and King's College London, London, United Kingdom
| | - Aaron M Drucker
- Women's College Research Institute, Women's College Hospital, Toronto, ON, Canada
- Division of Dermatology, Department of Medicine, University of Toronto, Toronto, ON, Canada
| |
Collapse
|
5
|
Rackerseder J, Hornbach C, Dicks P, Kerek-Bodden H, Krieger T. Designing a Patient-Friendly Website for Newly Diagnosed Cancer Patients with the Participatory Health Research Approach. Int J Environ Res Public Health 2022; 19:1969. [PMID: 35206155 DOI: 10.3390/ijerph19041969] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/22/2021] [Revised: 01/25/2022] [Accepted: 02/07/2022] [Indexed: 02/04/2023]
Abstract
High-quality and user-friendly patient information material (PIM) is essential for understanding and accepting a new care programme. When optimising the PIM of the integrated, cross-sectoral psycho-oncological (isPO) care programme, the design of the fifth element of the patient information strategy—the patient-friendly website—was still pending. In this paper, the iterative design process of the patient-friendly isPO website is described. We applied the participatory health research (PHR) approach to enable high levels of participation of its respective end-users (e.g., cancer survivors), service providers, and experts. The design included six steps: (1) initiation, (2) planning, (3) initial idea exploration, (4) creation of a first working version, (5) three optimisation loops, and (6) dissemination. An exploratory mixed-methods design has been used. Qualitative data collection included document analysis, interviews, and participatory action research (PAR) loops with focus groups. Finally, the quality of the newly designed website was quantitatively assessed with the UPIM-Check, a user-friendly instrument for assessing and optimising PIM. The PHR approach was indispensable for the design of our needs-oriented, patient-friendly website. Participants’ high levels of participation strongly contributed to the products’ quality. The final descriptive statistical evaluation shows that the final website was rated very good on average by its end-users.
Collapse
|
6
|
Lewandowska A, Olejnik-Krugly A, Jankowski J, Dziśko M. Subjective and Objective User Behavior Disparity: Towards Balanced Visual Design and Color Adjustment. Sensors (Basel) 2021; 21:s21248502. [PMID: 34960596 PMCID: PMC8706159 DOI: 10.3390/s21248502] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/06/2021] [Revised: 12/03/2021] [Accepted: 12/15/2021] [Indexed: 11/22/2022]
Abstract
Interactive environments create endless possibilities for the design of websites, games, online platforms, and mobile applications. Their visual aspects and functional characteristics influence the user experience. Depending on the project, the purpose of the environment can be oriented toward marketing targets, user experience, or accessibility. Often, these conflicting aspects should be integrated within a single project, and a search for trade-offs is needed. One of these conflicts involves a disparity in user behavior concerning declared preferences and real observed activity in terms of visual attention. Taking into account accessibility guidelines (WCAG) further complicates the problem. In our study, we focused on the analysis of color combinations and their contrast in terms of user-friendliness; visual intensity, which is important for attracting user attention; and recommendations from the Web Accessibility Guidelines (WCAG). We took up the challenge to reduce the disparity between user preferences and WCAG contrast, on one hand, and user natural behavior registered with an eye-tracker, on the other. However, we left the choice of what is more important—human conscious reaction or objective user behavior results—to the designer. The former corresponds to user-friendliness, while the latter, visual intensity, is consistent with marketing expectations. The results show that the ranking of visual objects characterized by different levels of contrast differs when considering the perspectives of user experience, commercial goals, and objective recording. We also propose an interactive tool with the possibility of assigning weights to each criterion to generate a ranking of objects.
Collapse
|
7
|
Massanelli J, Sexton KW, Lesher CT, Jensen HK, Kimbrough MK, Privratsky A, Taylor JR, Bhavaraju A. Integration of Web Analytics Into Graduate Medical Education: Usability Study. JMIR Form Res 2021; 5:e29748. [PMID: 34898459 PMCID: PMC8713092 DOI: 10.2196/29748] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2021] [Revised: 08/17/2021] [Accepted: 09/18/2021] [Indexed: 11/13/2022] Open
Abstract
Background Web analytics is the measurement, collection, analysis, and reporting of website and web application usage data. While common in the e-commerce arena, web analytics is underutilized in graduate medical education (GME). Objective The University of Arkansas for Medical Sciences Department of Surgery website was revamped with input from in-house surgeons in August 2017. This study investigated the use of web analytics to gauge the impact of our department’s website redesign project. Methods Google Analytics software was used to measure website performance before and after implementation of the new website. Eight-month matched periods were compared. Factors tracked included total users, new users, total sessions, sessions per user, pages per session, average session duration, total page views, and bounce rate (the percentage of visitors who visit a site and then leave [ie, bounce] without continuing to another page on the same site). Results Analysis using a nonpaired Student t test demonstrated a statistically significant increase for total page views (before vs after: 33,065 vs 81,852; P<.001) and decrease for bounce rate (before vs after: 50.70% vs 0.23%; P<.001). Total users, new users, total sessions, sessions per user, and pages per session showed improvement. The average session duration was unchanged. Subgroup analysis showed that after the main page, the next 3 most frequently visited pages were related to GME programs in our department. Conclusions Web analytics is a practical measure of a website’s efficacy. Our data suggest that a modern website significantly improves user engagement. An up-to-date website is essential for contemporary GME recruitment, will likely enhance engagement of residency applicants with GME programs, and warrants further investigation.
Collapse
Affiliation(s)
- Jackson Massanelli
- College of Medicine, University of Arkansas for Medical Sciences, Little Rock, AR, United States
| | - Kevin W Sexton
- Division of Trauma and Acute Care Surgery, Department of Surgery, University of Arkansas for Medical Sciences, Little Rock, AR, United States
| | - Chris T Lesher
- College of Medicine, University of Arkansas for Medical Sciences, Little Rock, AR, United States
| | - Hanna K Jensen
- Division of Trauma and Acute Care Surgery, Department of Surgery, University of Arkansas for Medical Sciences, Little Rock, AR, United States
| | - Mary K Kimbrough
- Division of Trauma and Acute Care Surgery, Department of Surgery, University of Arkansas for Medical Sciences, Little Rock, AR, United States
| | - Anna Privratsky
- Division of Trauma and Acute Care Surgery, Department of Surgery, University of Arkansas for Medical Sciences, Little Rock, AR, United States
| | - John R Taylor
- Division of Trauma and Acute Care Surgery, Department of Surgery, University of Arkansas for Medical Sciences, Little Rock, AR, United States
| | - Avi Bhavaraju
- Division of Trauma and Acute Care Surgery, Department of Surgery, University of Arkansas for Medical Sciences, Little Rock, AR, United States
| |
Collapse
|
8
|
Campbell JL, Monkman H. The Application of a Novel, Context Specific, Remote, Usability Assessment Tool to Conduct a Pre-Redesign and Post-Redesign Usability Comparison of a Telemedicine Website. Stud Health Technol Inform 2021; 281:911-915. [PMID: 34042806 DOI: 10.3233/shti210311] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/11/2023]
Abstract
The usability of telemedicine provider websites is an essential component of increasing the public's awareness of, understanding of, and safe and effective use of telemedicine. A newly developed usability data collection tool was used to conduct a usability assessment of the Teladoc website pre- and post- a redesign. The results suggest that the Teladoc website had better usability prior to the redesign. The Teladoc Website Usability Survey (TWUS) developed for the Teladoc website usability assessment can be modified and used in future usability studies of telemedicine provider interfaces. Usability research that takes place in specific context of use settings is more valuable to identify usability problems.
Collapse
Affiliation(s)
| | - Helen Monkman
- School of Health Information Science, University of Victoria, Canada
| |
Collapse
|
9
|
Zhang X, Hu W, Xiao Q. Influences of Medical Crowdfunding Website Design Features on Trust and Intention to Donate: Controlled Laboratory Experiment. J Med Internet Res 2021; 23:e25554. [PMID: 33944787 PMCID: PMC8132978 DOI: 10.2196/25554] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2020] [Revised: 01/10/2021] [Accepted: 04/11/2021] [Indexed: 11/21/2022] Open
Abstract
Background As a type of donation-based crowdfunding, medical crowdfunding has gradually become an important way for patients who have difficulty paying medical bills to seek help from the public. However, many people still have limited confidence in donating money to medical crowdfunding projects. Objective Given that the features of a medical crowdfunding website may be important to gain users’ trust, this study draws upon two-factor and trust theories to explore how different design features of medical crowdfunding websites affect potential donors’ cognition-based trust and affect-based trust, and how these types of trust affect the intention to donate. Methods A 2 (informativeness: high vs low) × 2 (visual cues: cool color vs warm color) × 2 (social cues: with vs without) between-subject laboratory experiment was performed to validate our research model. A total of 320 undergraduate students recruited from a university in China participated in the controlled laboratory experiment. Results Cognition-based trust (β=.528, P<.001) and affect-based trust (β=.344, P<.001) exerted significant effects on the intention to donate of potential donors of medical crowdfunding. Informativeness as a hygiene factor positively influenced potential donors’ cognition-based trust (F1,311=49.764, P<.001) and affect-based trust (F1,311=16.093, P<.001), whereas social cues as a motivating factor significantly influenced potential donors’ cognition-based trust (F1,311=38.160, P<.001) and affect-based trust (F1,311=23.265, P<.001). However, the color of the webpages affected the two dimensions of trust differently. Specifically, medical crowdfunding webpages with warm colors were more likely to induce affect-based trust than those with cool colors (F1,311=17.120, P<.001), whereas no significant difference was found between the effects of cool and warm colors on cognition-based trust (F1,311=1.707, P=.19). Conclusions This study deepens our understanding of the relationships among the design features of medical crowdfunding websites, trust, and intention to donate, and provides guidelines for managers of medical crowdfunding platforms to enhance potential donors’ trust-building by improving the website design features.
Collapse
Affiliation(s)
- Xing Zhang
- School of Management, Wuhan Textile University, Wuhan, China
| | - Wenli Hu
- School of Management, Wuhan Textile University, Wuhan, China
| | - Quan Xiao
- School of Information Management, Jiangxi University of Finance and Economics, Nanchang, China
| |
Collapse
|
10
|
Rotondi AJ, Grady J, Hanusa BH, Haas GL, Spring MR, Abebe KZ, Luther J, Gurklis J. Key Variables for Effective eHealth Designs for Individuals With and Without Mental Health Disorders: 2^12-4 Fractional Factorial Experiment. J Med Internet Res 2021; 23:e23137. [PMID: 33759796 PMCID: PMC8262839 DOI: 10.2196/23137] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2020] [Revised: 12/07/2020] [Accepted: 12/18/2020] [Indexed: 01/26/2023] Open
Abstract
BACKGROUND eHealth applications not only offer the potential to increase service convenience and responsiveness but also expand the ability to tailor services to improve relevance, engagement, and use. To achieve these goals, it is critical that the designs are intuitive. Limited research exists on designs that work for those with a severe mental illness (SMI), many of whom have difficulty traveling for treatments, reject or infrequently seek treatment, and tend to discontinue treatments for significant periods. OBJECTIVE This study aims to evaluate the influence of 12 design variables (eg, navigational depth, reading level, and use of navigational lists) on the usability of eHealth application websites for those with and without SMI. METHODS A 212-4 fractional factorial experiment was used to specify the designs of 256 eHealth websites. This approach systematically varied the 12 design variables. The final destination contents of all websites were identical, and only the designs of the navigational pages varied. The 12 design elements were manipulated systematically to allow the assessment of combinations of design elements rather than only one element at a time. Of the 256 websites, participants (n=222) sought the same information on 8 randomly selected websites. Mixed effect regressions, which accounted for the dependency of the 8 observations within participants, were used to test for main effects and interactions on the ability and time to find information. Classification and regression tree analyses were used to identify effects among the 12 variables on participants' abilities to locate information, for the sample overall and each of the 3 diagnostic groups of participants (schizophrenia spectrum disorder [SSD], other mental illnesses, and no mental illness). RESULTS The best and worst designs were identified for each of these 4 groups. The depth of a website's navigation, that is, the number of screens users needed to navigate to find the desired content, had the greatest influence on usability (ability to find information) and efficiency (time to find information). The worst performing designs for those with SSD had a 9% success rate, and the best had a 51% success rate: the navigational designs made a 42% difference in usability. For the group with other mental illnesses, the design made a 50% difference, and for those with no mental illness, a 55% difference was observed. The designs with the highest usability had several key design similarities, as did those with the poorest usability. CONCLUSIONS It is possible to identify evidence-based strategies for designing eHealth applications that result in significantly better performance. These improvements in design benefit all users. For those with SSD or other SMIs, there are designs that are highly effective. Both the best and worst designs have key similarities but vary in some characteristics.
Collapse
Affiliation(s)
- Armando J Rotondi
- Mental Illness Research, Education and Clinical Center (MIRECC), VA Pittsburgh Health Care System, Department of Veterans Affairs, Pittsburgh, PA, United States.,Center for Health Equity Research and Promotion (CHERP), VA Pittsburgh Health Care System, Department of Veterans Affairs, Pittsburgh, PA, United States.,University of Pittsburgh Center for Behavioral Health, Media, and Technology, University of Pittsburgh, Pittsburgh, PA, United States
| | - Jonathan Grady
- Computer Science, Thomas College, Waterville, ME, United States
| | - Barbara H Hanusa
- Mental Illness Research, Education and Clinical Center (MIRECC), VA Pittsburgh Health Care System, Department of Veterans Affairs, Pittsburgh, PA, United States
| | - Gretchen L Haas
- Mental Illness Research, Education and Clinical Center (MIRECC), VA Pittsburgh Health Care System, Department of Veterans Affairs, Pittsburgh, PA, United States.,Department of Psychiatry, School of Medicine, University of Pittsburgh, Pittsburgh, PA, United States
| | - Michael R Spring
- Department of Information Sciences and Technology, School of Information Sciences, University of Pittsburgh, Pittsburgh, PA, United States
| | - Kaleab Z Abebe
- Center for Research on Health Care Data Center, School of Medicine, University of Pittsburgh, Pittsburgh, PA, United States
| | - James Luther
- Mental Illness Research, Education and Clinical Center (MIRECC), VA Pittsburgh Health Care System, Department of Veterans Affairs, Pittsburgh, PA, United States
| | - John Gurklis
- Behavioral Health, VA Pittsburgh Health Care System, Department of Veterans Affairs, Pittsburgh, PA, United States
| |
Collapse
|
11
|
Abstract
Costa Rica has become a destination for global health education courses, while funding for global health has increased dramatically over the past thirty years. An examination of one Costa Rican group's efforts to market humanitarian discourses, focusing on website design, provides a window into the workings of global health education and details the sometimes-uncomfortable position of non-US health professionals in educational programming. This contributes to theorizations of the intersection of mediatization and care, and suggests links between the legitimation of global health as a discipline, on the one hand, and the reproduction of inequities, on the other.
Collapse
Affiliation(s)
- Steven P Black
- Anthropology, Georgia State University , Atlanta, Georgia, USA
| | - Gabriela Alvarado
- Policy Analysis, Frederick S Pardee Rand Graduate School , Santa Monica, California, USA
| |
Collapse
|
12
|
Robinson LE, Petrey J. An Exploration of a Website Design Process and Results of a Usability Study. Med Ref Serv Q 2019; 38:56-69. [PMID: 30942678 DOI: 10.1080/02763869.2019.1548898] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2018] [Revised: 11/09/2018] [Accepted: 11/09/2018] [Indexed: 06/09/2023]
Abstract
A transition of content management systems provided Kornhauser Health Sciences Library with an opportunity to redesign the library's website to be more user-friendly, efficient, and visually appealing. A multistage approach was taken: (1) informal interviews of various stakeholders from the library, (2) a redesign using information gained from those stakeholders, and (3) a retrospective comparative usability study. This study was conducted with the goal to inform library staff whether the redesigned website improved accuracy and efficiency of information retrieval through the completion of timed tasks. In addition, user satisfaction was measured through guided interview questions.
Collapse
Affiliation(s)
- Lauren E Robinson
- a University of Louisville, Kornhauser Health Sciences Library , Louisville , Kentucky , USA
| | - Jessica Petrey
- a University of Louisville, Kornhauser Health Sciences Library , Louisville , Kentucky , USA
| |
Collapse
|
13
|
Akers L, Andrews JA, Gordon JS. A Multimedia Support Skills Intervention for Female Partners of Male Smokeless Tobacco Users: Use and Perceived Acceptability. JMIR Form Res 2018; 2:e10. [PMID: 30556053 PMCID: PMC6294132 DOI: 10.2196/formative.9948] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2018] [Revised: 04/13/2018] [Accepted: 05/12/2018] [Indexed: 11/30/2022] Open
Abstract
Background UCare is a new multimedia (website+booklet) intervention for women who want their male partner to quit their use of smokeless tobacco. The intervention is based on research showing that perceived partner responsiveness to social support is highest when the supporter conveys respect, understanding, and caring in their actions. The website included both didactic and interactive features, with optional video components, and special activities to help women develop empathy for nicotine addiction. The booklet reinforced the website content, encouraged women to use the website, and served both as a physical reminder of the intervention and a convenient way to share the information with her partner. Objective The objective of this study was to describe the utilization and acceptability of a multimedia intervention among women seeking to support their partner in quitting smokeless tobacco. Lessons learned with respect to design considerations for online interventions are also summarized. Methods We present the evaluation of the intervention components' use and usefulness in a randomized trial. Results In the randomized clinical trial, more than 250,000 visits were made to the website in a 2-year period, with the vast majority from mobile devices. Of the 552 women randomized to receive the intervention, 96.9% (535/552) visited the website at least once, and 30.8% (170/552) completed the core website component, "The Basics." About half of the women (287/552) used the interactive "Take Notes" feature, and 37% (204/552) used the checklists. Few women used the post-Basics features. At 6 weeks, 40.7% (116/285) reported reading the printed and mailed booklet. Website and booklet use were uncorrelated. User ratings for the website and booklet were positive overall. Conclusions Intervention website designers should consider that many users will access the program only once or twice, and many will not complete it. It is also important to distinguish between core and supplemental features and to consider whether the primary purpose is training or support. Furthermore, printed materials still have value. Trial Registration ClinicalTrials.gov NCT01885221; https://clinicaltrials.gov/ct2/show/NCT01885221 (Archived by WebCite at http://www.webcitation.org/6zdIgGGtx).
Collapse
Affiliation(s)
- Laura Akers
- Oregon Research Institute, Eugene, OR, United States
| | | | - Judith S Gordon
- College of Nursing, University of Arizona, Tucson, AZ, United States
| |
Collapse
|
14
|
Rotondi AJ, Spring MR, Hanusa BH, Eack SM, Haas GL. Designing eHealth Applications to Reduce Cognitive Effort for Persons With Severe Mental Illness: Page Complexity, Navigation Simplicity, and Comprehensibility. JMIR Hum Factors 2017; 4:e1. [PMID: 28057610 PMCID: PMC5247620 DOI: 10.2196/humanfactors.6221] [Citation(s) in RCA: 26] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2016] [Revised: 09/23/2016] [Accepted: 10/14/2016] [Indexed: 11/13/2022] Open
Abstract
BACKGROUND eHealth technologies offer great potential for improving the use and effectiveness of treatments for those with severe mental illness (SMI), including schizophrenia and schizoaffective disorder. This potential can be muted by poor design. There is limited research on designing eHealth technologies for those with SMI, others with cognitive impairments, and those who are not technology savvy. We previously tested a design model, the Flat Explicit Design Model (FEDM), to create eHealth interventions for individuals with SMI. Subsequently, we developed the design concept page complexity, defined via the design variables we created of distinct topic areas, distinct navigation areas, and number of columns used to organize contents and the variables of text reading level, text reading ease (a newly added variable to the FEDM), and the number of hyperlinks and number of words on a page. OBJECTIVE The objective of our study was to report the influence that the 19 variables of the FEDM have on the ability of individuals with SMI to use a website, ratings of a website's ease of use, and performance on a novel usability task we created termed as content disclosure (a measure of the influence of a homepage's design on the understanding user's gain of a website). Finally, we assessed the performance of 3 groups or dimensions we developed that organize the 19 variables of the FEDM, termed as page complexity, navigational simplicity, and comprehensibility. METHODS We measured 4 website usability outcomes: ability to find information, time to find information, ease of use, and a user's ability to accurately judge a website's contents. A total of 38 persons with SMI (chart diagnosis of schizophrenia or schizoaffective disorder) and 5 mental health websites were used to evaluate the importance of the new design concepts, as well as the other variables in the FEDM. RESULTS We found that 11 of the FEDM's 19 variables were significantly associated with all 4 usability outcomes. Most other variables were significantly related to 2 or 3 of these usability outcomes. With the 5 tested websites, 7 of the 19 variables of the FEDM overlapped with other variables, resulting in 12 distinct variable groups. The 3 design dimensions had acceptable coefficient alphas. Both navigational simplicity and comprehensibility were significantly related to correctly identifying whether information was available on a website. Page complexity and navigational simplicity were significantly associated with the ability and time to find information and ease-of-use ratings. CONCLUSIONS The 19 variables and 3 dimensions (page complexity, navigational simplicity, and comprehensibility) of the FEDM offer evidence-based design guidance intended to reduce the cognitive effort required to effectively use eHealth applications, particularly for persons with SMI, and potentially others, including those with cognitive impairments and limited skills or experience with technology. The new variables we examined (topic areas, navigational areas, columns) offer additional and very simple ways to improve simplicity.
Collapse
Affiliation(s)
- Armando J Rotondi
- Mental Illness Research, Education and Clinical Center (MIRECC), VA Pittsburgh Health Care System, Department of Veterans Affairs, Pittsburgh, PA, United States.,School of Medicine, Center for Behavioral Health and Smart Technology, University of Pittsburgh, Pittsburgh, PA, United States.,School of Medicine, Clinical and Translational Sciences Institute, University of Pittsburgh, Pittsburgh, United States.,School of Medicine, Department of Critical Care Medicine, University of Pittsburgh, Pittsburgh, United States
| | - Michael R Spring
- Information Science and Technology, School of Information Sciences, University of Pittsburgh, Pittsburgh, PA, United States
| | - Barbara H Hanusa
- Mental Illness Research, Education and Clinical Center (MIRECC), VA Pittsburgh Health Care System, Department of Veterans Affairs, Pittsburgh, PA, United States
| | - Shaun M Eack
- School of Medicine, Clinical and Translational Sciences Institute, University of Pittsburgh, Pittsburgh, United States.,School of Social Work, University of Pittsburgh, Pittsburgh, PA, United States.,School of Medicine, Department of Psychiatry, University of Pittsburgh, Pittsburgh, PA, United States
| | - Gretchen L Haas
- Mental Illness Research, Education and Clinical Center (MIRECC), VA Pittsburgh Health Care System, Department of Veterans Affairs, Pittsburgh, PA, United States.,School of Medicine, Department of Psychiatry, University of Pittsburgh, Pittsburgh, PA, United States
| |
Collapse
|
15
|
Abstract
An academic health sciences library wanted to redesign its website to provide better access to health information in the community. Virtual reference data were used to provide information about user searching behavior. This study analyzed three years (2012-2014) of virtual reference data, including e-mail questions, text messaging, and live chat transcripts, to evaluate the library website for redesigning, especially in areas such as the home page, patrons' terminology, and issues prompting patrons to ask for help. A coding system based on information links in the current library website was created to analyze the data.
Collapse
Affiliation(s)
- Suhua Caroline Fan
- a Health Sciences Library , The University of Tennessee Health Science Center , Memphis , Tennessee , USA
| | - Jennifer M Welch
- a Health Sciences Library , The University of Tennessee Health Science Center , Memphis , Tennessee , USA
| |
Collapse
|
16
|
Rosenzweig M, Smith JE, Curtis A, Puffenberger A. Simplifying the Process for Finding Research Funding: A Cross-Campus Collaboration at a Large Academic Institution. Med Ref Serv Q 2016; 35:52-63. [PMID: 26794196 DOI: 10.1080/02763869.2016.1117289] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
Abstract
This article describes the collaboration between the University of Michigan's M-Library and the University of Michigan Medical School's Office of Research in developing a comprehensive online guide and consultation service. The guide was designed to assist researchers in finding available funding from both internal and external sources and was based on the results of a survey distributed by the Office of Research. Because many of the respondents were unaware of internal funding programs and needed more information on resources external to the university as well, the guide included information on both possibilities in an easy-to-use format that researchers use independently without needing further instruction, although personal consultation was also offered when necessary.
Collapse
Affiliation(s)
- Merle Rosenzweig
- a Taubman Health Sciences Library , University of Michigan , Ann Arbor , Michigan , USA
| | - Judith E Smith
- a Taubman Health Sciences Library , University of Michigan , Ann Arbor , Michigan , USA
| | - Ann Curtis
- b University of Michigan Medical School , Ann Arbor , Michigan , USA
| | - Amy Puffenberger
- b University of Michigan Medical School , Ann Arbor , Michigan , USA
| |
Collapse
|
17
|
Striley KM, Field-Springer K. Hybrids do it better: Lessons from websites of hybrid organizations in modern health movements. Health Mark Q 2016; 33:15-30. [PMID: 26950536 DOI: 10.1080/07359683.2016.1131577] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
Hybrid organizations in modern health movements adopt multiple organizational logistics, allowing them to more effectively achieve social change. We conducted an analysis of 152 probreastfeeding organization websites categorized as institutionalized organizations, grassroots organizations, or hybrid organizations. Through a series of ANOVA analyses, we found that hybrid's websites provide significantly more useful health care information, better maintained dialogue with members, more efficiently mobilized members, commoditized health care issues less, and created member identity while maintaining institutional ties. Ultimately, hybrids tended to incorporate the positive elements from both grassroots and institutional organizations, while rejecting many of the negative elements.
Collapse
Affiliation(s)
- Katie Margavio Striley
- a Department of Communication , The University of North Carolina , Chapel Hill , North Carolina, USA
| | - Kimberly Field-Springer
- b Department of Communication Studies, College of Arts and Sciences , Ashland University , Ashland, Ohio, USA
| |
Collapse
|