1
|
Hickson L, Nickbakht M, Timmer BHB, Dawes P. Developing a prototype web-based decision aid for adults with hearing loss. Int J Audiol 2024; 63:819-826. [PMID: 38071605 DOI: 10.1080/14992027.2023.2279024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2023] [Revised: 10/11/2023] [Accepted: 10/27/2023] [Indexed: 10/02/2024]
Abstract
OBJECTIVE To develop a prototype of a decision aid to be used on a website for adults with hearing loss. Design: Development was guided by the International Patient Decision Aid Standards (IPDAS) and included a survey and think-aloud process. STUDY SAMPLE A total of 153 participants completed a survey about what to include in the decision aid (111 adults with hearing loss, 21 family members of adults with hearing loss, and 21 professionals). Six adults with hearing loss and six family members participated in a think-aloud process to provide feedback as they used an initial version of the decision aid. RESULTS In the survey, 26 of the 38 potential items were identified as being highest priority and were included in the initial version of the decision aid. This initial version was then tested in the think-aloud sessions and a prototype of a web-based version was developed based on participant responses related to: 1) information on the decision aid, 2) ease of use, 3) layout and orders of the items, 4) satisfaction, 5) areas for improvement (e.g., need for graphics). CONCLUSIONS The methodologies used in this study are recommended for developing decision aids for adults with acquired hearing loss.
Collapse
Affiliation(s)
- Louise Hickson
- Centre for Hearing Research, School of Health and Rehabilitation Sciences, The University of Queensland, Brisbane, Australia
| | - Mansoureh Nickbakht
- Centre for Hearing Research, School of Health and Rehabilitation Sciences, The University of Queensland, Brisbane, Australia
| | - Barbra H B Timmer
- Centre for Hearing Research, School of Health and Rehabilitation Sciences, The University of Queensland, Brisbane, Australia
- Sonova AG, Stäfa, Switzerland
| | - Piers Dawes
- Centre for Hearing Research, School of Health and Rehabilitation Sciences, The University of Queensland, Brisbane, Australia
| |
Collapse
|
2
|
Maalouf MF, Wang A, Robitaille S, Liberman AS, Fiore JF, Feldman LS, Lee L. Patient perspective on adapting to bowel dysfunction after rectal cancer surgery. Colorectal Dis 2024. [PMID: 39099084 DOI: 10.1111/codi.17118] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/13/2023] [Revised: 07/08/2024] [Accepted: 07/10/2024] [Indexed: 08/06/2024]
Abstract
AIM Bowel dysfunction continues to be a clinically significant consequence of rectal cancer surgery, affecting quality of life. Rectal cancer patients value self-empowerment and adaptation to change to improve their quality of life in the context of bowel dysfunction. There are limited qualitative data addressing patients' perspectives on adapting to bowel dysfunction. The aim of this study is to evaluate patients' perspectives on adapting to bowel dysfunction after rectal cancer surgery. METHOD Adult patients who underwent rectal cancer surgery with sphincter preservation at a single colorectal referral centre from July 2017 to July 2020 were included. Patients were excluded if they had surgery <1 year since recruitment, received a permanent stoma or developed recurrence or metastasis. Semistructured interviews were held by phone and transcribed verbatim. Bowel dysfunction was assessed via the low anterior resection syndrome (LARS) score. Thematic analysis was used to identify adaptations which patients found helpful for improving bowel dysfunction after rectal cancer surgery. RESULTS A total of 54 patient interviews were included. The distribution of patients with no, minor and major LARS was 39%, 22% and 39%, respectively. Four main themes were conceived from the analysis: implementing lifestyle changes, fostering supportive relationships and self-compassion, communication and access to resources, and adapting to social and cultural challenges. Associated subthemes were identified, namely forward planning, self-compassion and addressing social stigma. CONCLUSION Patients' valuable perspective on adapting to bowel dysfunction involve subtle themes which expand the existing literature. These themes inform a patient-centred approach, which may improve outcomes and quality of care for rectal cancer patients.
Collapse
Affiliation(s)
- Michael F Maalouf
- Department of Surgery, McGill University Health Centre, Montreal, Quebec, Canada
| | - Anna Wang
- Department of Surgery, McGill University Health Centre, Montreal, Quebec, Canada
| | - Stephan Robitaille
- Department of Surgery, McGill University Health Centre, Montreal, Quebec, Canada
| | - A Sender Liberman
- Department of Surgery, McGill University Health Centre, Montreal, Quebec, Canada
- Steinberg-Bernstein Centre for Minimally Invasive Surgery and Innovation, McGill University Health Centre, Montreal, Quebec, Canada
| | - Julio F Fiore
- Department of Surgery, McGill University Health Centre, Montreal, Quebec, Canada
- Steinberg-Bernstein Centre for Minimally Invasive Surgery and Innovation, McGill University Health Centre, Montreal, Quebec, Canada
| | - Liane S Feldman
- Department of Surgery, McGill University Health Centre, Montreal, Quebec, Canada
- Steinberg-Bernstein Centre for Minimally Invasive Surgery and Innovation, McGill University Health Centre, Montreal, Quebec, Canada
| | - Lawrence Lee
- Department of Surgery, McGill University Health Centre, Montreal, Quebec, Canada
- Steinberg-Bernstein Centre for Minimally Invasive Surgery and Innovation, McGill University Health Centre, Montreal, Quebec, Canada
| |
Collapse
|
3
|
Aref HAT, Turk T, Dhanani R, Xiao A, Olson J, Paul P, Dennett L, Yacyshyn E, Sadowski CA. Development and evaluation of shared decision-making tools in rheumatology: A scoping review. Semin Arthritis Rheum 2024; 66:152432. [PMID: 38554593 DOI: 10.1016/j.semarthrit.2024.152432] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2023] [Revised: 03/07/2024] [Accepted: 03/11/2024] [Indexed: 04/01/2024]
Abstract
INTRODUCTION Shared decision-making (SDM) tools are facilitators of decision-making through a collaborative process between patients/caregivers and clinicians. These tools help clinicians understand patient's perspectives and help patients in making informed decisions based on their preferences. Despite their usefulness for both patients and clinicians, SDM tools are not widely implemented in everyday practice. One barrier is the lack of clarity on the development and evaluation processes of these tools. Such processes have not been previously described in the field of rheumatology. OBJECTIVE To describe the development and evaluation processes of shared decision-making (SDM) tools used in rheumatology. METHODS Bibliographic databases (e.g., EMBASE and CINAHL) were searched for relevant articles. Guidelines for the PRISMA extension for scoping reviews were followed. Studies included were: addressing SDM among adults in rheumatology, focusing on development and/or evaluation of SDM tool, full texts, empirical research, and in the English language. RESULTS Of the 2030 records screened, forty-six reports addressing 36 SDM tools were included. Development basis and evaluation measures varied across the studies. The most commonly reported development basis was the International Patient Decision Aids Standards (IPDAS) criteria (19/36, 53 %). Other developmental foundations reported were: The Ottawa Decision Support Framework (ODSF) (6/36, 16 %), Informed Medical Decision Foundation elements (3/36, 8 %), edutainment principles (2/36, 5.5 %), and others (e.g. DISCERN and MARKOV Model) (9/31,29 %). The most commonly used evaluation measures were the Decisional Conflict Scale (18/46, 39 %), acceptability and knowledge (7/46, 15 %), and the preparation for decision-making scale (5/46,11 %). CONCLUSION For better quality and wider implementation of such tools, there is a need for detailed, transparent, systematic, and consistent reporting of development methods and evaluation measures. Using established checklists for reporting development and evaluation is encouraged.
Collapse
Affiliation(s)
- Heba A T Aref
- Faculty of Pharmacy and Pharmaceutical Sciences, College of Health Sciences, University of Alberta, Alberta, Canada
| | - Tarek Turk
- Faculty of Medicine and Dentistry, College of Health Sciences, University of Alberta, Alberta, Canada
| | - Ruhee Dhanani
- Faculty of Pharmacy and Pharmaceutical Sciences, College of Health Sciences, University of Alberta, Alberta, Canada
| | - Andrew Xiao
- Faculty of Medicine and Dentistry, College of Health Sciences, University of Alberta, Alberta, Canada
| | - Joanne Olson
- Faculty of Nursing, College of Health Sciences, University of Alberta, Alberta, Canada
| | - Pauline Paul
- Faculty of Nursing, College of Health Sciences, University of Alberta, Alberta, Canada
| | - Liz Dennett
- Geoffrey and Robyn Sperber Health Sciences Library, University of Alberta, Alberta, Canada
| | - Elaine Yacyshyn
- Faculty of Medicine and Dentistry, College of Health Sciences, University of Alberta, Alberta, Canada
| | - Cheryl A Sadowski
- Faculty of Pharmacy and Pharmaceutical Sciences, College of Health Sciences, University of Alberta, Alberta, Canada.
| |
Collapse
|
4
|
Groos SS, Linn AJ, Kuiper JI, van Schoor NM, van der Velde N, van Weert JCM. Combining user-centered design and behavioral theory to enhance health technologies: A personas-based approach for a primary-care based multifactorial falls risk assessment tool. Int J Med Inform 2024; 186:105420. [PMID: 38518678 DOI: 10.1016/j.ijmedinf.2024.105420] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2023] [Revised: 03/11/2024] [Accepted: 03/18/2024] [Indexed: 03/24/2024]
Abstract
INTRODUCTION Multifactorial falls risk assessment tools (FRATs) can be an effective falls prevention method for older adults, but are often underutilized by health care professionals (HCPs). This study aims to enhance the use and implementation of multifactorial FRATs by combining behavioral theory with the user-centered design (UCD) method of personas construction. Specifically, the study aimed to (1) construct personas that are based on external (i.e., needs, preferences) and intrinsic user characteristics (i.e., behavioral determinants); and (2) use these insights to inform requirements for optimizing an existing Dutch multifactorial FRAT (i.e., the 'Valanalyse'). METHODS Survey data from HCPs (n = 31) was used to construct personas of the 'Valanalyse.' To examine differences between clusters on 68 clustering variables, a multivariate cluster analysis technique with non-parametric analyses and computational methods was used. The aggregated external and intrinsic user characteristics of personas were used to inform key design and implementation requirements for the 'Valanalyse,' respectively, whereby intrinsic user characteristics were matched with appropriate behavior change techniques to guide implementation. RESULTS Significant differences between clusters were observed in 20 clustering variables (e.g., behavioral beliefs, situations for use). These variables were used to construct six personas representing users of each cluster. Together, the six personas helped operationalize four key design requirements (e.g., guide treatment-related decision making) and 14 implementation strategies (e.g., planning coping responses) for optimizing the 'Valanalyse' in Dutch geriatric, primary care settings. CONCLUSION The findings suggest that theory- and evidence-based personas that encompass both external and intrinsic user characteristics are a useful method for understanding how the use and implementation of multifactorial FRATs can be optimized with and for HCPs, providing important implications for developers and eHealth interventions with regards to encouraging technology adoption.
Collapse
Affiliation(s)
- Sara S Groos
- Department of Internal Medicine/Geriatrics, Amsterdam University Medical Centers, Location University of Amsterdam, Amsterdam, The Netherlands; Amsterdam Public Health Research Institute, Aging and Later Life, Amsterdam, The Netherlands.
| | - Annemiek J Linn
- Amsterdam School of Communication Research/ASCoR, University of Amsterdam, The Netherlands
| | | | - Natasja M van Schoor
- Amsterdam Public Health Research Institute, Aging and Later Life, Amsterdam, The Netherlands; Department of Epidemiology and Data Science, Amsterdam University Medical Centers, Location Vrije University, Amsterdam, The Netherlands
| | - Nathalie van der Velde
- Department of Internal Medicine/Geriatrics, Amsterdam University Medical Centers, Location University of Amsterdam, Amsterdam, The Netherlands; Amsterdam Public Health Research Institute, Aging and Later Life, Amsterdam, The Netherlands
| | - Julia C M van Weert
- Amsterdam School of Communication Research/ASCoR, University of Amsterdam, The Netherlands
| |
Collapse
|
5
|
Ruiz S, Ackermann N, Maki J, Carcone AI, Hudson MM, Ehrhardt MJ, Cloakey D, DuChateau D, Griffith SA, Johnson A, Phillips A, Waters EA. Translating a motivational interviewing intervention for childhood cancer survivors into an eHealth tool: A user-centered design process. Transl Behav Med 2024; 14:359-367. [PMID: 38648182 PMCID: PMC11118853 DOI: 10.1093/tbm/ibae014] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/25/2024] Open
Abstract
Childhood cancer survivors have a higher risk of developing cardiomyopathy than members of the general population. Screening echocardiograms can facilitate early detection and treatment of cardiomyopathy. Furthermore, motivational interviewing can increase uptake of cardiac screening. However, such approaches are time- and resource-intensive, which limits their reach to the survivors who need them. We describe how we utilized a user-centered design process to translate an in-person motivational interviewing intervention into an eHealth tool to improve cardiac screening among childhood cancer survivors. We used an iterative, three-phase, user-centered design approach: (i) setting the stage (convening advisory boards and reviewing the original intervention), (ii) content programming and development (writing and programming intervention text and flow), and (iii) intervention testing (research team testing and cognitive interviews.) For cognitive interviews, participants were recruited via institutional participant registries and medical records. Data were analyzed using rapid qualitative analysis. During Phase 1, we identified survivor and provider advisors and outlined elements of the in-person intervention to change for the eHealth tool. During Phases 2 and 3, advisors recommended several modifications that guided the final intervention content and flow. Examples include: acknowledging potential hesitation or apprehension surrounding medical screenings, addressing barriers and facilitators to obtaining screening, and improving the tool's usability and appeal. In Phase 3, cognitive interview participants suggested additional refinements to the intervention language. This translation process shows that continued in-depth engagement of community advisors and iterative testing can improve the applicability of an eHealth to survivors' lived experiences and social contexts.
Collapse
Affiliation(s)
- Sienna Ruiz
- Division of Public Health Sciences, Washington University School of Medicine, St. Louis, MO
| | - Nicole Ackermann
- Division of Public Health Sciences, Washington University School of Medicine, St. Louis, MO
| | - Julia Maki
- Division of Public Health Sciences, Washington University School of Medicine, St. Louis, MO
| | - April Idalski Carcone
- Department of Family Medicine and Public Health Sciences, Wayne State University School of Medicine, Detroit, MI
| | - Melissa M Hudson
- Department of Oncology, St. Jude Children’s Research Hospital, Memphis, TN
| | - Matthew J Ehrhardt
- Department of Oncology, St. Jude Children’s Research Hospital, Memphis, TN
| | | | | | | | | | | | - Erika A Waters
- Division of Public Health Sciences, Washington University School of Medicine, St. Louis, MO
| |
Collapse
|
6
|
Kamboj N, Metcalfe K, Chu CH, Conway A. Designing the User Interface of a Nitroglycerin Dose Titration Decision Support System: User-Centered Design Study. Appl Clin Inform 2024; 15:583-599. [PMID: 39048084 PMCID: PMC11268987 DOI: 10.1055/s-0044-1787755] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2023] [Accepted: 05/14/2024] [Indexed: 07/27/2024] Open
Abstract
BACKGROUND Nurses adjust intravenous nitroglycerin infusions to provide acute relief for angina by manually increasing or decreasing the dosage. However, titration can pose challenges, as excessively high doses can lead to hypotension, and low doses may result in inadequate pain relief. Clinical decision support systems (CDSSs) that predict changes in blood pressure for nitroglycerin dose adjustments may assist nurses with titration. OBJECTIVE This study aimed to design a user interface for a CDSS for nitroglycerin dose titration (Nitroglycerin Dose Titration Decision Support System [nitro DSS]). METHODS A user-centered design (UCD) approach, consisting of an initial qualitative study with semistructured interviews to identify design specifications for prototype development, was used. This was followed by three iterative rounds of usability testing. Nurses with experience titrating nitroglycerin infusions in coronary care units participated. RESULTS A total of 20 nurses participated, including 7 during the qualitative study and 15 during usability testing (2 nurses participated in both phases). Analysis of the qualitative data revealed four themes for the interface design to be (1) clear and consistent, (2) vigilant, (3) interoperable, and (4) reliable. The major elements of the final prototype included a feature for viewing the predicted and actual blood pressure over time to determine the reliability of the predictions, a drop-down option to report patient side effects, a feature to report reasons for not accepting the prediction, and a visual alert indicating any systolic blood pressure predictions below 90 mm Hg. Nurses' ratings on the questionnaires indicated excellent usability and acceptability of the final nitro DSS prototype. CONCLUSION This study successfully applied a UCD approach to collaborate with nurses in developing a user interface for the nitro DSS that supports the clinical decision-making of nurses titrating nitroglycerin.
Collapse
Affiliation(s)
- Navpreet Kamboj
- Lawrence S. Bloomberg Faculty of Nursing, University of Toronto, Toronto, Canada
| | - Kelly Metcalfe
- Lawrence S. Bloomberg Faculty of Nursing, University of Toronto, Toronto, Canada
- Women's College Hospital Research and Innovation Institute, Toronto, Canada
| | - Charlene H. Chu
- Lawrence S. Bloomberg Faculty of Nursing, University of Toronto, Toronto, Canada
- KITE-Toronto Rehabilitation Institute, University Health Network, Toronto, Canada
| | - Aaron Conway
- School of Nursing, Queensland University of Technology (QUT), Brisbane, Australia
| |
Collapse
|
7
|
Gamble AR, McKay MJ, Anderson DB, Pappas E, Alvarez Cooper I, Macpherson S, Harris IA, Filbay SR, McCaffery K, Thompson R, Hoffmann TC, Maher CG, Zadro JR. Development of a patient decision aid for children and adolescents following anterior cruciate ligament rupture: an international mixed-methods study. BMJ Open 2024; 14:e081421. [PMID: 38684251 PMCID: PMC11086191 DOI: 10.1136/bmjopen-2023-081421] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/27/2023] [Accepted: 04/08/2024] [Indexed: 05/02/2024] Open
Abstract
AIM To develop and user test an evidence-based patient decision aid for children and adolescents who are considering anterior cruciate ligament (ACL) reconstruction. DESIGN Mixed-methods study describing the development of a patient decision aid. SETTING A draft decision aid was developed by a multidisciplinary steering group (including various types of health professionals and researchers, and consumers) informed by the best available evidence and existing patient decision aids. PARTICIPANTS People who ruptured their ACL when they were under 18 years old (ie, adolescents), their parents, and health professionals who manage these patients. Participants were recruited through social media and the network outreach of the steering group. PRIMARY AND SECONDARY OUTCOMES Semistructured interviews and questionnaires were used to gather feedback on the decision aid. The feedback was used to refine the decision aid and assess acceptability. An iterative cycle of interviews, refining the aid according to feedback and further interviews, was used. Interviews were analysed using reflexive thematic analysis. RESULTS We conducted 32 interviews; 16 health professionals (12 physiotherapists, 4 orthopaedic surgeons) and 16 people who ruptured their ACL when they were under 18 years old (7 were adolescents and 9 were adults at the time of the interview). Parents participated in 8 interviews. Most health professionals, patients and parents rated the aid's acceptability as good-to-excellent. Health professionals and patients agreed on most aspects of the decision aid, but some health professionals had differing views on non-surgical management, risk of harms, treatment protocols and evidence on benefits and harms. CONCLUSION Our patient decision aid is an acceptable tool to help children and adolescents choose an appropriate management option following ACL rupture with their parents and health professionals. A clinical trial evaluating the potential benefit of this tool for children and adolescents considering ACL reconstruction is warranted.
Collapse
Affiliation(s)
- Andrew R Gamble
- School of Health Sciences, Faculty of Medicine and Health, The University of Sydney, Sydney, New South Wales, Australia
- Sydney Musculoskeletal Health and Institute for Musculoskeletal Health, The University of Sydney, Sydney, New South Wales, Australia
| | - Marnee J McKay
- School of Health Sciences, Faculty of Medicine and Health, The University of Sydney, Sydney, New South Wales, Australia
| | - David B Anderson
- School of Health Sciences, Faculty of Medicine and Health, The University of Sydney, Sydney, New South Wales, Australia
| | - Evangelos Pappas
- School of Health Sciences, Faculty of Medicine and Health, The University of Sydney, Sydney, New South Wales, Australia
- School of Medicine, University of Wollongong, Wollongong, New South Wales, Australia
| | | | - Sophie Macpherson
- School of Health Sciences, Faculty of Medicine and Health, The University of Sydney, Sydney, New South Wales, Australia
| | - Ian A Harris
- Sydney Musculoskeletal Health and Institute for Musculoskeletal Health, The University of Sydney, Sydney, New South Wales, Australia
- Ingham Institute for Applied Medical Research, South Western Sydney Clinical School, UNSW, Sydney, New South Wales, Australia
| | - Stephanie R Filbay
- Centre for Health, Exercise and Sports Medicine, Department of Physiotherapy, The University of Melbourne, Melbourne, Victoria, Australia
| | - Kirsten McCaffery
- Sydney Health Literacy Lab, School of Public Health, Faculty of Medicine and Health, The University of Sydney, Sydney, New South Wales, Australia
| | - Rachel Thompson
- Discipline of Behavioural and Social Sciences in Health, School of Health Sciences, Faculty of Medicine and Health, The University of Sydney, Sydney, New South Wales, Australia
| | - Tammy C Hoffmann
- Institute for Evidence-Based Healthcare, Faculty of Health Sciences and Medicine, Bond University, Gold Coast, Queensland, Australia
| | - Christopher G Maher
- Sydney Musculoskeletal Health and Institute for Musculoskeletal Health, The University of Sydney, Sydney, New South Wales, Australia
| | - Joshua R Zadro
- Sydney Musculoskeletal Health and Institute for Musculoskeletal Health, The University of Sydney, Sydney, New South Wales, Australia
| |
Collapse
|
8
|
Shuldiner J, Kiran T, Agarwal P, Daneshvarfard M, Eldridge K, Kim S, Greiver M, Jokhio I, Ivers N. Developing an Audit and Feedback Dashboard for Family Physicians: User-Centered Design Process. JMIR Hum Factors 2023; 10:e47718. [PMID: 37943586 PMCID: PMC10667970 DOI: 10.2196/47718] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2023] [Revised: 06/29/2023] [Accepted: 07/22/2023] [Indexed: 11/10/2023] Open
Abstract
BACKGROUND Audit and feedback (A&F), the summary and provision of clinical performance data, is a common quality improvement strategy. Successful design and implementation of A&F-or any quality improvement strategy-should incorporate evidence-informed best practices as well as context-specific end user input. OBJECTIVE We used A&F theory and user-centered design to inform the development of a web-based primary care A&F dashboard. We describe the design process and how it influenced the design of the dashboard. METHODS Our design process included 3 phases: prototype development based on A&F theory and input from clinical improvement leaders; workshop with family physician quality improvement leaders to develop personas (ie, fictional users that represent an archetype character representative of our key users) and application of those personas to design decisions; and user-centered interviews with family physicians to learn about the physician's reactions to the revised dashboard. RESULTS The team applied A&F best practices to the dashboard prototype. Personas were used to identify target groups with challenges and behaviors as a tool for informed design decision-making. Our workshop produced 3 user personas, Dr Skeptic, Frazzled Physician, and Eager Implementer, representing common users based on the team's experience of A&F. Interviews were conducted to further validate findings from the persona workshop and found that (1) physicians were interested in how they compare with peers; however, if performance was above average, they were not motivated to improve even if gaps compared to other standards in their care remained; (2) burnout levels were high as physicians are trying to catch up on missed care during the pandemic and are therefore less motivated to act on the data; and (3) additional desired features included integration within the electronic medical record, and more up-to-date and accurate data. CONCLUSIONS We found that carefully incorporating data from user interviews helped operationalize generic best practices for A&F to achieve an acceptable dashboard that could meet the needs and goals of physicians. We demonstrate such a design process in this paper. A&F dashboards should address physicians' data skepticism, present data in a way that spurs action, and support physicians to have the time and capacity to engage in quality improvement work; the steps we followed may help those responsible for quality improvement strategy implementation achieve these aims.
Collapse
Affiliation(s)
| | - Tara Kiran
- Department of Family and Community Medicine, University of Toronto, Toronto, ON, Canada
- St Michael's Hospital, Unity Health Toronto, Toronto, ON, Canada
- MAP Centre for Urban Health Solutions, St Michael's Hospital, Toronto, ON, Canada
- Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, ON, Canada
| | - Payal Agarwal
- Women's College Hospital, Toronto, ON, Canada
- Department of Family and Community Medicine, University of Toronto, Toronto, ON, Canada
| | - Maryam Daneshvarfard
- MAP Centre for Urban Health Solutions, St Michael's Hospital, Toronto, ON, Canada
| | - Kirsten Eldridge
- Department of Family and Community Medicine, University of Toronto, Toronto, ON, Canada
| | - Susie Kim
- Department of Family and Community Medicine, University of Toronto, Toronto, ON, Canada
- Women's College Academic Family Health Team, Women's College Hospital, Toronto, ON, Canada
| | - Michelle Greiver
- North York General Hospital Office of Research and Innovation, Toronto, ON, Canada
| | | | - Noah Ivers
- Women's College Hospital, Toronto, ON, Canada
- Department of Family and Community Medicine, University of Toronto, Toronto, ON, Canada
- Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, ON, Canada
| |
Collapse
|
9
|
Maalouf MF, Robitaille S, Penta R, Pook M, Liberman AS, Fiore JF, Feldman LS, Lee L. Understanding the Impact of Bowel Dysfunction on Quality of Life After Rectal Cancer Surgery From the Patient's Perspective. Dis Colon Rectum 2023; 66:1067-1075. [PMID: 36989059 DOI: 10.1097/dcr.0000000000002621] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 03/30/2023]
Abstract
BACKGROUND Bowel dysfunction is an important consequence of rectal cancer surgery' and the specific quality-of-life domains that are affected remain unclear and unaddressed by generic surveys. OBJECTIVE This study aimed to identify quality-of-life domains most affected by rectal cancer surgery. DESIGN Qualitative content analysis. SETTINGS Semistructured interviews conducted by telephone with patients recruited from a single university-affiliated colorectal referral center. PATIENTS Adult patients were included if they underwent rectal cancer surgery with sphincter preservation from July 2017 to July 2020. Patients were excluded if their surgery was <1 year since the recruitment date, received a permanent stoma, or developed recurrence or metastasis. MAIN OUTCOME MEASURES Bowel dysfunction was evaluated via the low anterior resection syndrome score. Interview transcripts were coded by 2 independent reviewers and evaluated for concordance. Qualitative content analysis was used to identify themes, and their frequency of occurrence was quantified (percent total number of interviews). RESULTS A total of 54 patient interviews were conducted. Analysis revealed 5 quality-of-life-related themes impacted by bowel dysfunction: experiencing psychological and emotional stress, challenging roles and relationships within society, encountering physical limitations, restricting leisure and recreational activities, and learning self-empowerment and adapting to change. Patients with minor and major bowel dysfunction were more likely to report disruption to their social activities and their role as a sexual partner versus those with no bowel dysfunction. Patients with major bowel dysfunction were more likely to report effects on sleep versus those with no and minor bowel dysfunction. LIMITATIONS Single center, self-reported, and observer bias. CONCLUSION The impact of bowel dysfunction on quality of life includes a wide range of themes that extend beyond traditional measures. These results may help better inform patients in the preoperative setting and serve as a basis for the development of a more patient-centered quality-of-life survey. COMPRENDER EL IMPACTO DE LA DISFUNCIN INTESTINAL EN LA CALIDAD DE VIDA DESPUS DE LA CIRUGA DE CNCER DE RECTO DESDE LA PERSPECTIVA DEL PACIENTE ANTECEDENTES:La disfunción intestinal es una consecuencia importante de la cirugía del cáncer de recto y los dominios específicos de la calidad de vida que se ven afectados siguen sin estar claros y sin abordarse en las encuestas genéricas.OBJETIVO:Identificar los dominios de calidad de vida más afectados por la cirugía del cáncer de recto.DISEÑO:Análisis cualitativo de contenido.ÁMBITOS:Entrevistas semiestructuradas realizadas por teléfono con pacientes reclutados de un único centro de referencia colorrectal afiliado a una universidad.PACIENTES:Pacientes adultos intervenidos de cáncer de recto con preservación de esfínter del 07/2017 al 07/2020. Los pacientes fueron excluidos si su cirugía fue <1 año desde la fecha de reclutamiento, recibieron un estoma permanente o desarrollaron recurrencia o metástasis.PRINCIPALES MEDIDAS DE RESULTADO:La disfunción intestinal se evaluó a través de la puntuación del síndrome de resección anterior baja. Dos revisores independientes codificaron las transcripciones de las entrevistas y evaluaron su concordancia. Se utilizó el análisis de contenido cualitativo para identificar los temas, cuantificando su frecuencia de aparición (porcentaje del número total de entrevistas).RESULTADOS:Se realizaron un total de 54 entrevistas a pacientes. El análisis reveló cinco temas relacionados con la calidad de vida afectados por la disfunción intestinal: experimentar estrés psicológico y emocional, roles y relaciones desafiantes dentro de la sociedad, encontrar limitaciones físicas, restringir actividades recreativas y de ocio, y autoempoderamiento y adaptación al cambio. Los pacientes con disfunción intestinal menor y mayor tenían más probabilidades de informar la interrupción de las actividades sociales y el papel como pareja sexual en comparación con aquellos sin disfunción intestinal. Los pacientes con disfunción intestinal importante tenían más probabilidades de informar efectos sobre el sueño en comparación con aquellos sin disfunción intestinal o con disfunción intestinal menor.LIMITACIONES:Sesgo de un solo centro, autoinformado y observador.CONCLUSIÓN:El impacto de la disfunción intestinal en la calidad de vida incluye una amplia gama de temas que se extienden más allá de las medidas tradicionales. Estos resultados pueden ayudar a informar mejor a los pacientes en el entorno preoperatorio y servir como base para el desarrollo de una encuesta de calidad de vida más centrada en el paciente. (Traducción-Dr. Yesenia Rojas-Khalil ).
Collapse
Affiliation(s)
- Michael F Maalouf
- Steinberg-Bernstein Centre for Minimally Invasive Surgery and Innovation, McGill University Health Centre, Montreal, Quebec, Canada
| | - Stephan Robitaille
- Department of Surgery, McGill University Health Centre, Montreal, Quebec, Canada
- Steinberg-Bernstein Centre for Minimally Invasive Surgery and Innovation, McGill University Health Centre, Montreal, Quebec, Canada
| | - Ruxandra Penta
- Steinberg-Bernstein Centre for Minimally Invasive Surgery and Innovation, McGill University Health Centre, Montreal, Quebec, Canada
| | - Makena Pook
- Steinberg-Bernstein Centre for Minimally Invasive Surgery and Innovation, McGill University Health Centre, Montreal, Quebec, Canada
| | - A Sender Liberman
- Department of Surgery, McGill University Health Centre, Montreal, Quebec, Canada
- Steinberg-Bernstein Centre for Minimally Invasive Surgery and Innovation, McGill University Health Centre, Montreal, Quebec, Canada
| | - Julio F Fiore
- Department of Surgery, McGill University Health Centre, Montreal, Quebec, Canada
- Steinberg-Bernstein Centre for Minimally Invasive Surgery and Innovation, McGill University Health Centre, Montreal, Quebec, Canada
| | - Liane S Feldman
- Department of Surgery, McGill University Health Centre, Montreal, Quebec, Canada
- Steinberg-Bernstein Centre for Minimally Invasive Surgery and Innovation, McGill University Health Centre, Montreal, Quebec, Canada
| | - Lawrence Lee
- Department of Surgery, McGill University Health Centre, Montreal, Quebec, Canada
- Steinberg-Bernstein Centre for Minimally Invasive Surgery and Innovation, McGill University Health Centre, Montreal, Quebec, Canada
| |
Collapse
|
10
|
Gan JFL, McKay MJ, Jones CMP, Harris IA, McCaffery K, Thompson R, Hoffmann TC, Adie S, Maher CG, Zadro JR. Developing a patient decision aid for Achilles tendon rupture management: a mixed-methods study. BMJ Open 2023; 13:e072553. [PMID: 37316308 DOI: 10.1136/bmjopen-2023-072553] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 06/16/2023] Open
Abstract
OBJECTIVE To develop and user-test a patient decision aid portraying the benefits and harms of non-surgical management and surgery for Achilles tendon ruptures. DESIGN Mixed methods. SETTING A draft decision aid was developed using guidance from a multidisciplinary steering group and existing patient decision aids. Participants were recruited through social media. PARTICIPANTS People who have previously sustained an Achilles tendon rupture and health professionals who manage these patients. PRIMARY AND SECONDARY OUTCOMES Semi-structured interviews and questionnaires were used to gather feedback on the decision aid from health professionals and patients who had previously suffered an Achilles tendon rupture. The feedback was used to redraft the decision aid and assess acceptability. An iterative cycle of interviews, redrafting according to feedback and further interviews was used. Interviews were analysed using reflexive thematic analysis. Questionnaire data were analysed descriptively. RESULTS We interviewed 18 health professionals (13 physiotherapists, 3 orthopaedic surgeons, 1 chiropractor, 1 sports medicine physician) and 15 patients who had suffered an Achilles tendon rupture (median time since rupture was 12 months). Most health professionals and patients rated the aid's acceptability as good-excellent. Interviews showcased agreement among health professionals and patients on most aspects of the decision aid: introduction, treatment options, comparing benefits and harms, questions to ask health professionals and formatting. However, health professionals had differing views on details about Achilles tendon retraction distance, factors that modify the risk of harms, treatment protocols and evidence on benefits and harms. CONCLUSION Our patient decision aid is an acceptable tool to both patients and health professionals, and our study highlights the views of key stakeholders on important information to consider when developing a patient decision aid for Achilles tendon rupture management. A randomised controlled trial evaluating the impact of this tool on the decision-making of people considering Achilles tendon surgery is warranted.
Collapse
Affiliation(s)
- Jan F L Gan
- Discipline of Physiotherapy, School of Health Sciences, Faculty of Medicine and Health, The University of Sydney, Camperdown, New South Wales, Australia
| | - Marnee J McKay
- Discipline of Physiotherapy, School of Health Sciences, Faculty of Medicine and Health, The University of Sydney, Camperdown, New South Wales, Australia
| | - Caitlin M P Jones
- Sydney Musculoskeletal Health, The University of Sydney, Sydney, New South Wales, Australia
| | - Ian A Harris
- Sydney Musculoskeletal Health, The University of Sydney, Sydney, New South Wales, Australia
- Ingham Institute for Applied Medical Research, South Western Sydney Clinical School, University of New South Wales, Sydney, New South Wales, Australia
| | - Kirsten McCaffery
- Sydney Health Literacy Lab, School of Public Health, The University of Sydney, Sydney, New South Wales, Australia
| | - Rachel Thompson
- Discipline of Behavioural and Social Sciences in Health, School of Health Sciences, Faculty of Medicine and Health, The University of Sydney, Sydney, New South Wales, Australia
| | - Tammy C Hoffmann
- Institute for Evidence-Based Healthcare, Faculty of Health Sciences and Medicine, Bond University, Gold Coast, Queensland, Australia
| | - Sam Adie
- South West Sydney Clinical School, University of New South Wales Medicine and Health, Liverpool, New South Wales, Australia
| | - Christopher G Maher
- Sydney Musculoskeletal Health, The University of Sydney, Sydney, New South Wales, Australia
| | - Joshua R Zadro
- Sydney Musculoskeletal Health, The University of Sydney, Sydney, New South Wales, Australia
| |
Collapse
|
11
|
Chan A, Cohen R, Robinson KM, Bhardwaj D, Gregson G, Jutai JW, Millar J, Ríos Rincón A, Roshan Fekr A. Evidence and User Considerations of Home Health Monitoring for Older Adults: Scoping Review. JMIR Aging 2022; 5:e40079. [PMID: 36441572 PMCID: PMC9745651 DOI: 10.2196/40079] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/06/2022] [Revised: 10/03/2022] [Accepted: 10/10/2022] [Indexed: 11/30/2022] Open
Abstract
BACKGROUND Home health monitoring shows promise in improving health outcomes; however, navigating the literature remains challenging given the breadth of evidence. There is a need to summarize the effectiveness of monitoring across health domains and identify gaps in the literature. In addition, ethical and user-centered frameworks are important to maximize the acceptability of health monitoring technologies. OBJECTIVE This review aimed to summarize the clinical evidence on home-based health monitoring through a scoping review and outline ethical and user concerns and discuss the challenges of the current user-oriented conceptual frameworks. METHODS A total of 2 literature reviews were conducted. We conducted a scoping review of systematic reviews in Scopus, MEDLINE, Embase, and CINAHL in July 2021. We included reviews examining the effectiveness of home-based health monitoring in older adults. The exclusion criteria included reviews with no clinical outcomes and lack of monitoring interventions (mobile health, telephone, video interventions, virtual reality, and robots). We conducted a quality assessment using the Assessment of Multiple Systematic Reviews (AMSTAR-2). We organized the outcomes by disease and summarized the type of outcomes as positive, inconclusive, or negative. Second, we conducted a literature review including both systematic reviews and original articles to identify ethical concerns and user-centered frameworks for smart home technology. The search was halted after saturation of the basic themes presented. RESULTS The scoping review found 822 systematic reviews, of which 94 (11%) were included and of those, 23 (24%) were of medium or high quality. Of these 23 studies, monitoring for heart failure or chronic obstructive pulmonary disease reduced exacerbations (4/7, 57%) and hospitalizations (5/6, 83%); improved hemoglobin A1c (1/2, 50%); improved safety for older adults at home and detected changing cognitive status (2/3, 66%) reviews; and improved physical activity, motor control in stroke, and pain in arthritis in (3/3, 100%) rehabilitation studies. The second literature review on ethics and user-centered frameworks found 19 papers focused on ethical concerns, with privacy (12/19, 63%), autonomy (12/19, 63%), and control (10/19, 53%) being the most common. An additional 7 user-centered frameworks were studied. CONCLUSIONS Home health monitoring can improve health outcomes in heart failure, chronic obstructive pulmonary disease, and diabetes and increase physical activity, although review quality and consistency were limited. Long-term generalized monitoring has the least amount of evidence and requires further study. The concept of trade-offs between technology usefulness and acceptability is critical to consider, as older adults have a hierarchy of concerns. Implementing user-oriented frameworks can allow long-term and larger studies to be conducted to improve the evidence base for monitoring and increase the receptiveness of clinicians, policy makers, and end users.
Collapse
Affiliation(s)
- Andrew Chan
- Faculty of Rehabilitation Medicine, Department of Occupational Therapy, University of Alberta, Edmonton, AB, Canada
- Innovation and Technology Hub, Glenrose Rehabilitation Research, Edmonton, AB, Canada
| | - Rachel Cohen
- KITE Research Institute, Toronto Rehabilitation Institute, University Health Network, Toronto, ON, Canada
- Institute of Biomedical Engineering, University of Toronto, Toronto, ON, Canada
| | - Katherine-Marie Robinson
- School of Engineering Design and Teaching Innovation, Faculty of Engineering, University of Ottawa, Ottawa, ON, Canada
- Department of Philosophy, Faculty of Arts, University of Ottawa, Ottawa, ON, Canada
| | - Devvrat Bhardwaj
- Department of Electrical Engineering and Computer Science, Faculty of Engineering, University of Ottawa, Ottawa, ON, Canada
| | - Geoffrey Gregson
- Faculty of Rehabilitation Medicine, Department of Occupational Therapy, University of Alberta, Edmonton, AB, Canada
- Innovation and Technology Hub, Glenrose Rehabilitation Research, Edmonton, AB, Canada
| | - Jeffrey W Jutai
- Interdisciplinary School of Health Sciences, Faculty of Health Sciences, University of Ottawa, Ottawa, ON, Canada
- LIFE Research Institute, University of Ottawa, Ottawa, ON, Canada
| | - Jason Millar
- School of Engineering Design and Teaching Innovation, Faculty of Engineering, University of Ottawa, Ottawa, ON, Canada
- Department of Philosophy, Faculty of Arts, University of Ottawa, Ottawa, ON, Canada
| | - Adriana Ríos Rincón
- Faculty of Rehabilitation Medicine, Department of Occupational Therapy, University of Alberta, Edmonton, AB, Canada
- Innovation and Technology Hub, Glenrose Rehabilitation Research, Edmonton, AB, Canada
| | - Atena Roshan Fekr
- KITE Research Institute, Toronto Rehabilitation Institute, University Health Network, Toronto, ON, Canada
- Institute of Biomedical Engineering, University of Toronto, Toronto, ON, Canada
| |
Collapse
|
12
|
Yan H, Kukora SK, Pituch K, Deldin PJ, Arslanian-Engoren C, Zikmund-Fisher BJ. Adapting user-centered design principles to improve communication of peer parent narratives on pediatric tracheostomy. BMC Med Inform Decis Mak 2022; 22:197. [PMID: 35879768 PMCID: PMC9316812 DOI: 10.1186/s12911-022-01911-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/11/2021] [Accepted: 06/21/2022] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Parents who have to make tracheostomy decisions for their critically ill child may face forecasting errors and wish to learn from peer parents. We sought to develop an intervention with peer parent narratives to help parents anticipate and prepare for future challenges before making a decision. METHODS To ensure that the intervention reflects parents' needs (rather than experts' opinions), we adapted a user-centered design (UCD) process to identify decision-critical information and refine the presentation format by interviewing parents who had tracheostomy decision making experience. Phase 1 (n = 10) presented 15 possible forecasting errors and asked participants to prioritize and justify the problematic ones. It also asked participants to comment on the draft narratives and preferred delivery mode and time of the intervention. Phase 2 (n = 9 additional parents and 1 previous parent) iteratively collected feedback over four waves of user interviews to guide revisions to the informational booklet. RESULTS Phase 1 revealed that parents wanted information to address all forecasting errors as soon as tracheostomy becomes an option. They also highlighted diverse family situations and the importance of offering management strategies. The resulting prototype booklet contained five sections: introduction, child's quality of life, home care, practical challenges, and resources. Feedback from Phase 2 focused on emphasizing individualized situations, personal choice, seriousness of the decision, and caregiver health as well as presenting concrete illustrations of future challenges with acknowledgement of positive outcomes and advice. We also learned that parents preferred to use the booklet with support from the care team rather than read it alone. CONCLUSIONS A UCD process enabled inclusion of parental perspectives that were initially overlooked and tailoring of the intervention to meet parental expectations. Similar UCD-based approaches may be valuable in the design of other types of patient communications (e.g., decision aids).
Collapse
Affiliation(s)
- Haoyang Yan
- Department of Psychology, University of Michigan, 530 Church Street, Ann Arbor, MI, 48109, USA. .,Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, 625 N Michigan Avenue, 21st Floor, Chicago, IL, 60611, USA.
| | - Stephanie K Kukora
- Department of Pediatrics, C.S. Mott Children's Hospital, Michigan Medicine, 1540 E Hospital Drive, Ann Arbor, MI, 48109, USA
| | - Kenneth Pituch
- Department of Pediatrics, C.S. Mott Children's Hospital, Michigan Medicine, 1540 E Hospital Drive, Ann Arbor, MI, 48109, USA
| | - Patricia J Deldin
- Department of Psychology, University of Michigan, 530 Church Street, Ann Arbor, MI, 48109, USA.,Department of Psychiatry, University of Michigan, 1500 E Medical Center Drive, Ann Arbor, MI, 48109, USA
| | - Cynthia Arslanian-Engoren
- Department of Health Behavior and Biological Sciences, School of Nursing, University of Michigan, 400 North Ingalls, Ann Arbor, MI, 48109, USA
| | - Brian J Zikmund-Fisher
- Department of Health Behavior and Health Education, School of Public Health, University of Michigan, 1415 Washington Heights, Ann Arbor, MI, 48109, USA.,Department of Internal Medicine, University of Michigan, 2800 Plymouth Road, Ann Arbor, MI, 48109, USA
| |
Collapse
|
13
|
Blair L, Vergales J, Peregoy L, Seegal H, Keim-Malpass J. Acceptability of an interstage home monitoring mobile application for caregivers of children with single ventricle physiology: Toward technology-integrated family management. J SPEC PEDIATR NURS 2022; 27:e12372. [PMID: 35365917 DOI: 10.1111/jspn.12372] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/07/2021] [Revised: 12/31/2021] [Accepted: 03/02/2022] [Indexed: 11/29/2022]
Abstract
PURPOSE Infants with single ventricle physiology experience numerous vulnerable transitions, and the interstage period for shunt-dependent children represents the time of highest risk for morbidity and mortality. Data exchange, physiological monitoring, and communication between clinicians and caregivers through interstage home monitoring are critical. The purpose of this study is to report on the acceptability of a technology-enhanced home monitoring mobile application for interstage family management of children with single ventricle physiology. DESIGN AND METHODS This study employed a qualitative descriptive study design and recruited caregivers that were part of a broader quality improvement project where they were beta users of a mobile health application specifically developed for the interstage home monitoring time period. RESULTS Eleven caregivers were enrolled in this study that was a part of the early phases of beta testing the mobile application from a human-centered design perspective. In general, the participants had a favorable sentiment toward the technology-integrated family management aspects that the mobile application allowed for during the interstage process. The acceptability findings can be organized through the following themes: time needed for mobile application, family as integrated members of care team, connectedness and confidence, and resolving technical issues. CONCLUSIONS Evaluation of the feasibility and acceptability of this technology from the perspective of family/caregivers is a critical component of human-centered design. The integration of technology-facilitated communication shows immense promise for patient populations undergoing vulnerable transitions in care. Future study is needed to determine the role mobile applications have in improved clinical outcomes, enhanced provider clinical-decision support, and family engagement in care.
Collapse
Affiliation(s)
- Lisa Blair
- Department of Nursing, College of Nursing, University of Kentucky, Lexington, Kentucky, USA.,Department of Medicine, College of Medicine, University of Kentucky, Lexington, Kentucky, USA
| | - Jeffrey Vergales
- Department of Pediatric Cardiology, School of Medicine, University of Virginia, Charlottesville, Virginia, USA
| | - Leslie Peregoy
- Department of Pediatric Cardiology, School of Medicine, University of Virginia, Charlottesville, Virginia, USA
| | - Hallie Seegal
- Department of Acute and Specialty Care, School of Nursing, University of Virginia, Charlottesville, Virginia, USA
| | - Jessica Keim-Malpass
- Department of Pediatric Cardiology, School of Medicine, University of Virginia, Charlottesville, Virginia, USA.,Department of Acute and Specialty Care, School of Nursing, University of Virginia, Charlottesville, Virginia, USA
| |
Collapse
|
14
|
Robinson A, Husband A, Slight R, Slight SP. Designing Digital Health Technology to Support Patients Before and After Bariatric Surgery: Qualitative Study Exploring Patient Desires, Suggestions, and Reflections to Support Lifestyle Behavior Change. JMIR Hum Factors 2022; 9:e29782. [PMID: 35254271 PMCID: PMC8933804 DOI: 10.2196/29782] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2021] [Revised: 10/05/2021] [Accepted: 11/06/2021] [Indexed: 11/13/2022] Open
Abstract
Background A patient’s capability, motivation, and opportunity to change their lifestyle are determinants of successful outcomes following bariatric surgery. Lifestyle changes before and after surgery, including improved dietary intake and physical activity levels, have been associated with greater postsurgical weight loss and improved long-term health. Integrating patient-centered digital technologies within the bariatric surgical pathway could form part of an innovative strategy to promote and sustain healthier behaviors, and provide holistic patient support, to improve surgical success. Previous research focused on implementing digital technologies and measuring effectiveness in surgical cohorts. However, there is limited work concerning the desires, suggestions, and reflections of patients undergoing bariatric surgery. This qualitative investigation explores patients’ perspectives on technology features that would support behavior changes during the pre- and postoperative periods, to potentially maintain long-term healthy lifestyles following surgery. Objective This study aims to understand how digital technologies can be used to support patient care during the perioperative journey to improve weight loss outcomes and surgical success, focusing on what patients want from digital technologies, how they want to use them, and when they would be of most benefit during their surgical journey. Methods Patients attending bariatric surgery clinics in one hospital in the North of England were invited to participate. Semistructured interviews were conducted with purposively sampled pre- and postoperative patients to discuss lifestyle changes and the use of digital technologies to complement their care. The interviews were audio recorded and transcribed verbatim. Reflexive thematic analysis enabled the development of themes from the data. Ethical approval was obtained from the National Health Service Health Research Authority. Results A total of 20 patients were interviewed (preoperative phase: 40% (8/20); postoperative phase: 60% (12/20). A total of 4 overarching themes were developed and related to the optimization of technology functionality. These centered on providing tailored content and support; facilitating self-monitoring and goal setting; delivering information in an accessible, trusted, and usable manner; and meeting patient information-seeking and engagement needs during the surgical pathway. Functionalities that delivered personalized feedback and postoperative follow-up were considered beneficial. Individualized goal setting functionality could support a generation of digitally engaged patients with bariatric conditions as working toward achievable targets was deemed an effective strategy for motivating behavior change. The creation of digital package of care checklists between patients and clinicians was a novel finding from this study. Conclusions Perceptions of patients undergoing bariatric surgery validated the integration of digital technologies within the surgical pathway, offering enhanced connectedness and support. Recommendations are made relating to the design, content, and functionality of digital interventions to best address the needs of this cohort. These findings have the potential to influence the co-design and integration of person-centered, perioperative technologies.
Collapse
Affiliation(s)
- Anna Robinson
- School of Pharmacy, Newcastle University, Newcastle upon Tyne, United Kingdom.,Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, United Kingdom
| | - Andrew Husband
- School of Pharmacy, Newcastle University, Newcastle upon Tyne, United Kingdom.,Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, United Kingdom
| | - Robert Slight
- Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, United Kingdom.,Newcastle upon Tyne Hospitals NHS Foundation Trust, Newcastle upon Tyne, United Kingdom
| | - Sarah P Slight
- School of Pharmacy, Newcastle University, Newcastle upon Tyne, United Kingdom.,Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, United Kingdom
| |
Collapse
|
15
|
Jaffar A, Mohd-Sidik S, Foo CN, Admodisastro N, Abdul Salam SN, Ismail ND. Improving Pelvic Floor Muscle Training Adherence Among Pregnant Women: Validation Study. JMIR Hum Factors 2022; 9:e30989. [PMID: 35113025 PMCID: PMC8855292 DOI: 10.2196/30989] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2021] [Revised: 11/10/2021] [Accepted: 11/30/2021] [Indexed: 01/11/2023] Open
Abstract
BACKGROUND Mobile health apps, for example, the Tät, have been shown to be potentially effective in improving pelvic floor muscle training (PFMT) among women, but their effectiveness in pregnant women was limited. Adherence to daily PFMT will improve pelvic floor muscle strength leading to urinary incontinence (UI) improvement during the pregnancy. OBJECTIVE This study aims to document the validation process in developing the Kegel Exercise Pregnancy Training app, which was designed to improve the PFMT adherence among pregnant women. METHODS We utilized an intervention mapping approach incorporated within the mobile health development and evaluation framework. The framework involved the following steps: (1) conceptualization, (2) formative research, (3) pretesting, (4) pilot testing, (5) randomized controlled trial, and (6) qualitative research. The user-centered design-11 checklist was used to evaluate the user-centeredness properties of the app. RESULTS A cross-sectional study was conducted to better understand PFMT and UI among 440 pregnant women. The study reported a UI prevalence of 40.9% (180/440), with less than half having good PFMT practice despite their good knowledge. Five focus group discussions were conducted to understand the app design preferred by pregnant women. They agreed a more straightforward design should be used for better app usability. From these findings, a prototype was designed and developed accordingly, and the process conformed to the user-centered design-11 (UCD-11) checklist. A PFMT app was developed based on the mHealth development and evaluation framework model, emphasizing higher user involvement in the application design and development. The application was expected to improve its usability, acceptability, and ease of use. CONCLUSIONS The Kegel Exercise Pregnancy Training app was validated using a thorough design and development process to ensure its effectiveness in evaluating the usability of the final prototype in our future randomized control trial study.
Collapse
Affiliation(s)
- Aida Jaffar
- Department of Psychiatry, Faculty of Medicine and Health Sciences, Universiti Putra Malaysia, Selangor, Malaysia.,Primary Care Unit, Faculty of Medicine and Defence Health, Universiti Pertahanan Nasional Malaysia, Wilayah Persekutuan, Malaysia
| | - Sherina Mohd-Sidik
- Department of Psychiatry, Faculty of Medicine and Health Sciences, Universiti Putra Malaysia, Selangor, Malaysia
| | - Chai Nien Foo
- Department of Population Medicine, Universiti Tunku Abdul Rahman, Selangor, Malaysia
| | - Novia Admodisastro
- Software Engineering & Information System Department, Faculty of Computer Science & Information Technology, Universiti Putra Malaysia, Selangor, Malaysia
| | - Sobihatun Nur Abdul Salam
- School of Multimedia Technology and Communication, College of Arts and Sciences, Universiti Utara Malaysia, Kedah, Malaysia
| | - Noor Diana Ismail
- Klinik Kesihatan Bt 9 Cheras, Ministry of Health, Selangor, Malaysia
| |
Collapse
|
16
|
Varghese S, Hahn-Goldberg S, Deng Z, Bradley-Ridout G, Guilcher SJT, Jeffs L, Madho C, Okrainec K, Rosenberg-Yunger ZRS, McCarthy LM. Medication Supports at Transitions Between Hospital and Other Care Settings: A Rapid Scoping Review. Patient Prefer Adherence 2022; 16:515-560. [PMID: 35241910 PMCID: PMC8887864 DOI: 10.2147/ppa.s348152] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/06/2021] [Accepted: 01/24/2022] [Indexed: 11/23/2022] Open
Abstract
PURPOSE Transitions in care (TiC) often involves managing medication changes and can be vulnerable moments for patients. Medication support, where medication changes are reviewed with patients and caregivers to increase knowledge and confidence about taking medications, is key to successful transitions. Little is known about the optimal tools and processes for providing medication support. This study aimed to identify describe patient or caregiver-centered medication support processes or tools that have been studied within 3 months following TiC between hospitals and other care settings. METHODS Rapid scoping review; English-language publications from OVID MEDLINE, OVID EMBASE, Cochrane Library and EBSCO CINAHL (2004-July 2019) that assessed medication support interventions delivered within 3 months following discharge were included. A subset of titles and abstracts were assessed by two reviewers to evaluate agreement and once reasonable agreement was achieved, the remainder were assessed by one reviewer. Eligibility assessment for full-text articles and data charting were completed by an experienced reviewer. RESULTS A total of 7671 unique citations were assessed; 60 studies were included. Half of the studies (n = 30/60) were randomized controlled trials. Most studies (n = 45/60) did not discuss intervention development, particularly whether end users were involved in intervention design. Many studies (n = 37/60) assessed multi-component interventions with written/print and verbal education components. Few studies (n = 5/60) included an electronic component. Very few studies (n = 4/60) included study populations at high risk of adverse events at TiC (eg, people with physical or intellectual disabilities, low literacy or language barriers). CONCLUSION The majority of studies were randomized controlled trials involving verbal counselling and/or physical document delivered to the patient before discharge. Few studies involved electronic components or considered patients at high-risk of adverse events. Future studies would benefit from improved reporting on development, consideration for electronic interventions, and improved reporting on patients with higher medication-related needs.
Collapse
Affiliation(s)
- Shawn Varghese
- Leslie Dan Faculty of Pharmacy, University of Toronto, Toronto, Ontario, Canada
- Women’s College Research Institute, Women’s College Hospital, Toronto, Ontario, Canada
- Michael G.Degroote School Of Medicine, McMaster University, Hamilton, Ontario, Canada
| | - Shoshana Hahn-Goldberg
- Leslie Dan Faculty of Pharmacy, University of Toronto, Toronto, Ontario, Canada
- OpenLab, University Health Network, Toronto, Ontario, Canada
| | - ZhiDi Deng
- Leslie Dan Faculty of Pharmacy, University of Toronto, Toronto, Ontario, Canada
| | - Glyneva Bradley-Ridout
- Leslie Dan Faculty of Pharmacy, University of Toronto, Toronto, Ontario, Canada
- Gerstein Science Information Centre, University of Toronto, Toronto, Ontario, Canada
| | - Sara J T Guilcher
- Leslie Dan Faculty of Pharmacy, University of Toronto, Toronto, Ontario, Canada
- Institute for Health Policy Management and Evaluation, University of Toronto, Toronto, Ontario, Canada
| | - Lianne Jeffs
- Institute for Health Policy Management and Evaluation, University of Toronto, Toronto, Ontario, Canada
- Sinai Health, Toronto, Ontario, Canada
- Lawrence S. Bloomberg Faculty of Nursing, University of Toronto, Toronto, Ontario, Canada
| | - Craig Madho
- OpenLab, University Health Network, Toronto, Ontario, Canada
| | - Karen Okrainec
- Toronto General Research Institute, University Health Network, Toronto, Ontario, Canada
| | - Zahava R S Rosenberg-Yunger
- Ted Rogers School of Management, School of Health Services Management, Ryerson University, Toronto, Ontario, Canada
| | - Lisa M McCarthy
- Leslie Dan Faculty of Pharmacy, University of Toronto, Toronto, Ontario, Canada
- Women’s College Research Institute, Women’s College Hospital, Toronto, Ontario, Canada
- Temerty Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
- Institute for Better Health, Trillium Health Partners, Mississauga, ON, Canada
- Correspondence: Lisa M McCarthy, Clinician Scientist, Institute for Better Health, Trillium Health Partners, Tel +1 416-566-2793, Email
| |
Collapse
|
17
|
Zadro J, Jones C, Harris I, Buchbinder R, O'Connor DA, McCaffery K, Thompson RE, Karunaratne S, Teng MJ, Maher C, Hoffmann T. Development of a patient decision aid on subacromial decompression surgery and rotator cuff repair surgery: an international mixed-methods study. BMJ Open 2021; 11:e054032. [PMID: 34462283 PMCID: PMC8407224 DOI: 10.1136/bmjopen-2021-054032] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/31/2022] Open
Abstract
OBJECTIVE To develop and user test a patient decision aid for people with subacromial pain syndrome that presents evidence-based information on the benefits and harms of subacromial decompression surgery and rotator cuff repair surgery. DESIGN Mixed-methods study outlining the development of a patient decision aid. SETTING We assembled a multidisciplinary steering group, and used existing decision aids and decision science to draft the decision aid. Participants were recruited through social media (not restricted by country nor setting), local hospitals and the authors' collaboration network. PARTICIPANTS People with shoulder pain and health professionals who manage people with shoulder pain. PRIMARY AND SECONDARY OUTCOMES We interviewed participants to gather feedback on the decision aid, assessed useability and acceptability (using qualitative and quantitative methods) and performed iterative cycles of redrafting the decision aid and reinterviewing participants as necessary. Interview data were analysed using thematic analysis. Quantitative data were summarised descriptively. RESULTS We interviewed 26 health professionals (11 physiotherapists, 7 orthopaedic surgeons, 4 general practitioners, 3 chiropractors and 1 osteopath) and 14 people with shoulder pain. Most health professionals and people with shoulder pain rated all aspects of decision aid acceptability as adequate-to-excellent (eg, length, presentation, comprehensibility). Interviews highlighted agreement among health professionals and people with shoulder pain on most aspects of the decision aid (eg, treatment options, summary of benefits, harms and practical issues, questions to ask a health professional, graphics, formatting). However, some aspects of the decision aid elicited divergent views among health professionals (eg, causes and symptoms of shoulder pain, evidence on benefits and harms). CONCLUSION This decision aid could be an acceptable and valuable tool for helping people with subacromial pain syndrome make informed treatment choices. A randomised controlled trial evaluating whether this decision aid reduces people's intentions to undergo shoulder surgery and facilitates informed treatment choices is underway.Trial registration number ACTRN12621000992808.
Collapse
Affiliation(s)
- Joshua Zadro
- Institute for Musculoskeletal Health, Sydney School of Public Health, University of Sydney and Sydney Local Health District, Camperdown, New South Wales, Australia
| | - Caitlin Jones
- Institute for Musculoskeletal Health, Sydney School of Public Health, University of Sydney and Sydney Local Health District, Camperdown, New South Wales, Australia
| | - Ian Harris
- Ingham Institute for Applied Medical Research, South Western Sydney Clinical School, UNSW, Sydney, New South Wales, Australia
| | - Rachelle Buchbinder
- Dept of Epidemiology and Preventive Medicine, Monash University, Melbourne, Victoria, Australia
| | - Denise A O'Connor
- School of Public Health and Preventive Medicine, Monash University, Melbourne, Victoria, Australia
| | - Kirsten McCaffery
- Sydney Health Literacy Lab, School of Public Health, The University of Sydney, Sydney, New South Wales, Australia
| | | | - Sascha Karunaratne
- Surgical Outcomes Research Centre (SOuRCe), Royal Prince Alfred Hospital, Camperdown, New South Wales, Australia
| | - Min Jiat Teng
- Institute for Musculoskeletal Health, Sydney School of Public Health, University of Sydney and Sydney Local Health District, Camperdown, New South Wales, Australia
| | - Christopher Maher
- Institute for Musculoskeletal Health, Sydney School of Public Health, University of Sydney and Sydney Local Health District, Camperdown, New South Wales, Australia
| | - Tammy Hoffmann
- Institute for Evidence-Based Healthcare, Faculty of Health Sciences and Medicine, Bond University, Gold Coast, Queensland, Australia
| |
Collapse
|
18
|
Witteman HO, Maki KG, Vaisson G, Finderup J, Lewis KB, Dahl Steffensen K, Beaudoin C, Comeau S, Volk RJ. Systematic Development of Patient Decision Aids: An Update from the IPDAS Collaboration. Med Decis Making 2021; 41:736-754. [PMID: 34148384 DOI: 10.1177/0272989x211014163] [Citation(s) in RCA: 61] [Impact Index Per Article: 20.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
BACKGROUND The 2013 update of the evidence informing the quality dimensions behind the International Patient Decision Aid Standards (IPDAS) offered a model process for developers of patient decision aids. OBJECTIVE To summarize and update the evidence used to inform the systematic development of patient decision aids from the IPDAS Collaboration. METHODS To provide further details about design and development methods, we summarized findings from a subgroup (n = 283 patient decision aid projects) in a recent systematic review of user involvement by Vaisson et al. Using a new measure of user-centeredness (UCD-11), we then rated the degree of user-centeredness reported in 66 articles describing patient decision aid development and citing the 2013 IPDAS update on systematic development. We contacted the 66 articles' authors to request their self-reports of UCD-11 items. RESULTS The 283 development processes varied substantially from minimal iteration cycles to more complex processes, with multiple iterations, needs assessments, and extensive involvement of end users. We summarized minimal, medium, and maximal processes from the data. Authors of 54 of 66 articles (82%) provided self-reported UCD-11 ratings. Self-reported scores were significantly higher than reviewer ratings (reviewers: mean [SD] = 6.45 [3.10]; authors: mean [SD] = 9.62 [1.16], P < 0.001). CONCLUSIONS Decision aid developers have embraced principles of user-centered design in the development of patient decision aids while also underreporting aspects of user involvement in publications about their tools. Templates may reduce the need for extensive development, and new approaches for rapid development of aids have been proposed when a more detailed approach is not feasible. We provide empirically derived benchmark processes and a reporting checklist to support developers in more fully describing their development processes.[Box: see text].
Collapse
Affiliation(s)
- Holly O Witteman
- Department of Family and Emergency Medicine, Faculty of Medicine, Laval University, Quebec City, Canada.,VITAM Research Centre, Quebec City, Canada.,CHU de Québec Research Centre, Quebec City, Canada
| | - Kristin G Maki
- Department of Health Services Research, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
| | - Gratianne Vaisson
- Department of Family and Emergency Medicine, Faculty of Medicine, Laval University, Quebec City, Québec, Canada
| | - Jeanette Finderup
- Research Centre for Patient Involvement & Department of Renal Medicine, Aarhus University & Aarhus University Hospital, Aarhus, Denmark
| | - Krystina B Lewis
- School of Nursing, Faculty of Health Sciences, University of Ottawa, Ottawa, ON, Canada.,University of Ottawa Heart Institute, Ottawa, ON, Canada
| | - Karina Dahl Steffensen
- Center for Shared Decision Making/Department of Oncology, Lillebaelt University Hospital of Southern Denmark, Vejle, Denmark.,Institute of Regional Health Research, Faculty of Health Sciences, Vejle, Denmark
| | - Caroline Beaudoin
- Department of Family and Emergency Medicine, Laval University, Quebec, Canada
| | - Sandrine Comeau
- Department of Family and Emergency Medicine, Laval University, Quebec, Canada
| | - Robert J Volk
- Department of Health Services Research, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
| |
Collapse
|
19
|
Witteman HO, Vaisson G, Provencher T, Chipenda Dansokho S, Colquhoun H, Dugas M, Fagerlin A, Giguere AM, Haslett L, Hoffman A, Ivers NM, Légaré F, Trottier ME, Stacey D, Volk RJ, Renaud JS. An 11-Item Measure of User- and Human-Centered Design for Personal Health Tools (UCD-11): Development and Validation. J Med Internet Res 2021; 23:e15032. [PMID: 33724194 PMCID: PMC8074832 DOI: 10.2196/15032] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2019] [Revised: 08/27/2020] [Accepted: 10/03/2020] [Indexed: 11/19/2022] Open
Abstract
BACKGROUND Researchers developing personal health tools employ a range of approaches to involve prospective users in design and development. OBJECTIVE The aim of this paper was to develop a validated measure of the human- or user-centeredness of design and development processes for personal health tools. METHODS We conducted a psychometric analysis of data from a previous systematic review of the design and development processes of 348 personal health tools. Using a conceptual framework of user-centered design, our team of patients, caregivers, health professionals, tool developers, and researchers analyzed how specific practices in tool design and development might be combined and used as a measure. We prioritized variables according to their importance within the conceptual framework and validated the resultant measure using principal component analysis with Varimax rotation, classical item analysis, and confirmatory factor analysis. RESULTS We retained 11 items in a 3-factor structure explaining 68% of the variance in the data. The Cronbach alpha was .72. Confirmatory factor analysis supported our hypothesis of a latent construct of user-centeredness. Items were whether or not: (1) patient, family, caregiver, or surrogate users were involved in the steps that help tool developers understand users or (2) develop a prototype, (3) asked their opinions, (4) observed using the tool or (5) involved in steps intended to evaluate the tool, (6) the process had 3 or more iterative cycles, (7) changes between cycles were explicitly reported, (8) health professionals were asked their opinion and (9) consulted before the first prototype was developed or (10) between initial and final prototypes, and (11) a panel of other experts was involved. CONCLUSIONS The User-Centered Design 11-item measure (UCD-11) may be used to quantitatively document the user/human-centeredness of design and development processes of patient-centered tools. By building an evidence base about such processes, we can help ensure that tools are adapted to people who will use them, rather than requiring people to adapt to tools.
Collapse
Affiliation(s)
- Holly O Witteman
- Université Laval, Quebec City, QC, Canada
- VITAM Research Centre for Sustainable Health, Quebec City, QC, Canada
- CHU de Québec-Université Laval, Quebec City, QC, Canada
| | - Gratianne Vaisson
- Université Laval, Quebec City, QC, Canada
- CHU de Québec-Université Laval, Quebec City, QC, Canada
| | | | | | | | - Michele Dugas
- Université Laval, Quebec City, QC, Canada
- VITAM Research Centre for Sustainable Health, Quebec City, QC, Canada
| | - Angela Fagerlin
- University of Utah, Salt Lake City, UT, United States
- Salt Lake City VA Center for Informatics Decision Enhancement and Surveillance, Salt Lake City, UT, United States
| | - Anik Mc Giguere
- Université Laval, Quebec City, QC, Canada
- VITAM Research Centre for Sustainable Health, Quebec City, QC, Canada
| | - Lynne Haslett
- East End Community Health Centre, Toronto, ON, Canada
| | - Aubri Hoffman
- The University of Texas MD Anderson Cancer Center, Houston, TX, United States
| | - Noah M Ivers
- University of Toronto, Toronto, ON, Canada
- Women's College Hospital, Toronto, ON, Canada
| | - France Légaré
- Université Laval, Quebec City, QC, Canada
- VITAM Research Centre for Sustainable Health, Quebec City, QC, Canada
| | - Marie-Eve Trottier
- Université Laval, Quebec City, QC, Canada
- CHU de Québec-Université Laval, Quebec City, QC, Canada
| | - Dawn Stacey
- University of Ottawa, Ottawa, ON, Canada
- Ottawa Hospital Research Institute, Ottawa, ON, Canada
| | - Robert J Volk
- The University of Texas MD Anderson Cancer Center, Houston, TX, United States
| | - Jean-Sébastien Renaud
- Université Laval, Quebec City, QC, Canada
- VITAM Research Centre for Sustainable Health, Quebec City, QC, Canada
| |
Collapse
|