1
|
Juraga D, Rukavina T, Marinović Glavić M, Bilajac L, Racz A, Bally ELS, Zanutto O, Alhambra-Borrás T, Ferrando M, Subotić A, Raat H, Vasiljev V. Implementation of a value-based approach for older people who have suffered an acute myocardial infarction: study protocol. Front Public Health 2025; 12:1518469. [PMID: 39830183 PMCID: PMC11738907 DOI: 10.3389/fpubh.2024.1518469] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2024] [Accepted: 12/06/2024] [Indexed: 01/22/2025] Open
Abstract
Introduction Due to the rapid aging of the global population, new approaches are required to improve the quality of life of older people and to reduce healthcare system expenditures. One of the approaches that can be used is value-based healthcare. This article describes a value-based solution for older people who have suffered a myocardial infarction. Methods This solution combines the work of healthcare professionals and informal caregivers and the use of modern and user-friendly technologies to support the achievement of patients' values. Patients older than 65 years who have suffered a myocardial infarction will be divided into control and intervention groups within a pre-post-controlled design research study. Members of the intervention group will be provided with a personalized plan developed by healthcare professionals and based on the results from the baseline questionnaire. Discussion Two ValueCare digital solution components will be developed: a mobile application for the participants and a web platform for the professionals, researchers, and informal caregivers. Together with smartwatches, which will track important health aspects, and applications, this approach would enable older people to improve their health through correct lifestyle choices and their professional and informal caregivers to track their progress. With the use of the described technology and the multidisciplinary approach, the unmet needs and values of participants could be achieved. Using this approach, it could be possible to reduce overall healthcare expenses through the active involvement of both older people and their informal caregivers through a shared decision-making process with healthcare professionals. Clinical trial registration The ISRCTN registry number is 25089186. The date of trial registration is 16/11/2021.
Collapse
Affiliation(s)
- Denis Juraga
- Department of Social Medicine and Epidemiology, Faculty of Medicine, University of Rijeka, Rijeka, Croatia
| | - Tomislav Rukavina
- Department of Social Medicine and Epidemiology, Faculty of Medicine, University of Rijeka, Rijeka, Croatia
- Teaching Institute of Public Health of Primorje-Gorski Kotar County, Rijeka, Croatia
| | - Mihaela Marinović Glavić
- Department of Social Medicine and Epidemiology, Faculty of Medicine, University of Rijeka, Rijeka, Croatia
| | - Lovorka Bilajac
- Department of Social Medicine and Epidemiology, Faculty of Medicine, University of Rijeka, Rijeka, Croatia
- Teaching Institute of Public Health of Primorje-Gorski Kotar County, Rijeka, Croatia
- Department of Public Health, Faculty of Health Studies, University of Rijeka, Rijeka, Croatia
| | | | - Esmee L. S. Bally
- Department of Public Health, Erasmus University Medical Centre, Rotterdam, Netherlands
| | - Oscar Zanutto
- European Project Office Department, Istituto Per Servizi Di Ricovero E Assistenza Agli Anziani (Institute for Hospitalization and Care for the Elderly), Treviso, Italy
| | | | - Maite Ferrando
- R&D+I Consultancy, Kveloce I+D+i (Senior Europa SL), Valencia, Spain
| | - Alen Subotić
- Department of Emergency Medicine, Velika Gorica, Croatia
| | - Hein Raat
- Department of Public Health, Erasmus University Medical Centre, Rotterdam, Netherlands
| | - Vanja Vasiljev
- Department of Social Medicine and Epidemiology, Faculty of Medicine, University of Rijeka, Rijeka, Croatia
| |
Collapse
|
2
|
Sanghvi J, Qian D, Olumuyide E, Mokuolu DC, Keswani A, Morewood GH, Burnett G, Park CH, Gal JS. Scoping Review: Anesthesiologist Involvement in Alternative Payment Models, Value Measurement, and Nonclinical Capabilities for Success in the United States of America. Anesth Analg 2025; 140:27-37. [PMID: 38324349 DOI: 10.1213/ane.0000000000006763] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/08/2024]
Abstract
The US healthcare sector is undergoing significant payment reforms, leading to the emergence of Alternative Payment Models (APMs) aimed at improving clinical outcomes and patient experiences while reducing costs. This scoping review provides an overview of the involvement of anesthesiologists in APMs as found in published literature. It specifically aims to categorize and understand the breadth and depth of their participation, revolving around 3 main axes or "Aims": (1) shaping APMs through design and implementation, (2) gauging the value and quality of care provided by anesthesiologists within these models, and (3) enhancing nonclinical abilities of anesthesiologists for promoting more value in care. To map out the existing literature, a comprehensive search of relevant electronic databases was conducted, yielding a total of 2173 articles, of which 24 met the inclusion criteria, comprising 21 prospective or retrospective cohort studies, 2 surveys, and 1 case-control cohort study. Eleven publications (45%) discussed value-based, bundled, or episode-based payments, whereas the rest discussed non-payment-based models, such as Enhanced Recovery After Surgery (7 articles, 29%), Perioperative Surgical Home (4 articles, 17%), or other models (3 articles, 13%).The review identified key themes related to each aim. The most prominent themes for aim 1 included protocol standardization (16 articles, 67%), design and implementation leadership (8 articles, 33%), multidisciplinary collaboration (7 articles, 29%), and role expansion (5 articles, 21%). For aim 2, the common themes were Process-Based & Patient-Centric Metrics (1 article, 4%), Shared Accountability (3 articles, 13%), and Time-Driven Activity-Based Costing (TDABC) (3 articles, 13%). Furthermore, we identified a wide range of quality metrics, spanning 8 domains that were used in these studies to evaluate anesthesiologists' performance. For aim 3, the main extracted themes included Education on Healthcare Transformation and Policies (3 articles, 13%), Exploring Collaborative Leadership Skills (5 articles, 21%), and Embracing Advanced Analytics and Data Transparency (4 articles, 17%).Findings revealed the pivotal role of anesthesiologists in the design, implementation, and refinement of these emerging delivery and payment models. Our results highlight that while payment models are shifting toward value, patient-centered metrics have yet to be widely accepted for use in measuring quality and affecting payment for anesthesiologists. Gaps remain in understanding how anesthesiologists assess their direct impact and strategies for enhancing the sustainability of anesthesia practices. This review underscores the need for future research contributing to the successful adaptation of clinical practices in this new era of healthcare delivery.
Collapse
Affiliation(s)
| | | | | | - Deborah C Mokuolu
- Department of Anesthesiology, Perioperative and Pain Medicine, Icahn School of Medicine at Mount Sinai, New York, New York
| | - Aakash Keswani
- Department of Anesthesiology, Perioperative and Pain Medicine, Icahn School of Medicine at Mount Sinai, New York, New York
| | - Gordon H Morewood
- Department of Anesthesiology, Temple University Health System, Philadelphia, Pennsylvania
| | - Garrett Burnett
- Department of Anesthesiology, Perioperative and Pain Medicine, Icahn School of Medicine at Mount Sinai, New York, New York
| | - Chang H Park
- Department of Anesthesiology, Perioperative and Pain Medicine, Icahn School of Medicine at Mount Sinai, New York, New York
| | - Jonathan S Gal
- Department of Anesthesiology, Perioperative and Pain Medicine, Icahn School of Medicine at Mount Sinai, New York, New York
| |
Collapse
|
3
|
Zeng C, Martin NE, Pusic AL, Edelen MO, Liu JB. Enhancing representativeness of patient-reported outcomes in routine radiation oncology care: a quality improvement protocol to address non-response. BMJ Open 2024; 14:e097127. [PMID: 39672577 PMCID: PMC11647348 DOI: 10.1136/bmjopen-2024-097127] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/26/2024] [Accepted: 11/27/2024] [Indexed: 12/15/2024] Open
Abstract
INTRODUCTION Non-response significantly undermines the representativeness of patient-reported outcome (PRO) data, thereby compromising its utility for facilitating high-value, equitable, patient-centred care in cancer clinics. Quality improvement studies are needed to assess the representativeness of PRO data collected in routine care, identify the underlying causes of non-response and develop novel methods to ensure data representativeness. Using a multilevel framework and a mixed-methods approach, we have three aims: (1) characterise the non-response of the Global-10 across clinic, provider and patient levels; (2) identify multilevel causes of non-response and potential strategies to improve representativeness in PRO collection; and (3) develop effective modifications to missing-data methods to enhance the representativeness of pre-existing PRO data. METHODS AND ANALYSIS Our primary data source is the Patient Reported Outcomes Measurement Information System Global-10, collected as part of routine care at the Radiation Oncology clinics within the Mass General Brigham (MGB) healthcare system. Other sources include (1) Harvard Catalyst for provider-specific data, (2) MGB administrative data, (3) public Centers for Medicare & Medicaid Services data and (4) the National Plan and Provider Enumeration System. We will conduct quantitative analyses to assess variations in Global-10 non-response across multilevel factors. Additionally, we will use qualitative interviews with patients and clinical professionals to understand the causes of non-response and to formulate strategies to expand the reach of PRO collection to underrepresented cancer patients, improve their completions and enhance overall data representativeness. Finally, we will integrate implementation science knowledge and findings from the first two aims into missing-data methods to manage non-response in the pre-existing Global-10 data and to evaluate their performance in preserving representativeness. ETHICS AND DISSEMINATION The study protocol was reviewed and approved by the Institutional Review Board at the Dana-Farber/Harvard Cancer Center (24-225). Written informed consent will be obtained from participants. Study findings will be disseminated through peer-reviewed publications and presentations at national and international conferences.
Collapse
Affiliation(s)
- Chengbo Zeng
- Patient Reported Outcomes, Value and Experience (PROVE) Center, Department of Surgery, Brigham and Women's Hospital, Boston, Massachusetts, USA
- Harvard Medical School, Boston, Massachusetts, USA
| | - Neil E Martin
- Harvard Medical School, Boston, Massachusetts, USA
- Department of Radiation Oncology, Brigham and Women's Hospital, Boston, Massachusetts, USA
- Department of Radiation Oncology, Dana-Farber Cancer Institute, Boston, Massachusetts, USA
| | - Andrea L Pusic
- Patient Reported Outcomes, Value and Experience (PROVE) Center, Department of Surgery, Brigham and Women's Hospital, Boston, Massachusetts, USA
- Harvard Medical School, Boston, Massachusetts, USA
- Division of Plastic and Reconstructive Surgery, Department of Surgery, Brigham and Women's Hospital, Boston, Massachusetts, USA
| | - Maria O Edelen
- Patient Reported Outcomes, Value and Experience (PROVE) Center, Department of Surgery, Brigham and Women's Hospital, Boston, Massachusetts, USA
- Harvard Medical School, Boston, Massachusetts, USA
- RAND Corporation, Boston, Massachusetts, USA
| | - Jason B Liu
- Patient Reported Outcomes, Value and Experience (PROVE) Center, Department of Surgery, Brigham and Women's Hospital, Boston, Massachusetts, USA
- Harvard Medical School, Boston, Massachusetts, USA
- Division of Surgical Oncology, Department of Surgery, Brigham and Women's Hospital, Boston, Massachusetts, USA
| |
Collapse
|
4
|
Ochoa L, Porter KH, Walsh BM, Torp D, Heebner NR, Hoch MC. An observational study: Correlation between self-perceived readiness and physical performance in healthy individuals. Musculoskelet Sci Pract 2024; 74:103217. [PMID: 39549323 DOI: 10.1016/j.msksp.2024.103217] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/25/2024] [Revised: 11/02/2024] [Accepted: 11/11/2024] [Indexed: 11/18/2024]
Abstract
INTRODUCTION In complex environments, individuals need to anticipate and react to stimuli by integrating complex systems and skills. Identifying the perceptual-cognitive, physical, and health characteristics that afford effective performance is necessary for developing training and readiness strategies. Measuring readiness by establishing a relationship between the Acute Readiness Monitoring Scale (ARMS) and performance during perceptual-cognitive tasks is essential. Therefore, this study aimed to determine the relationship between self-perceived readiness, physical performance, and perceptual-cognitive performance in healthy young adults. MATERIALS AND METHODS Cross-sectional design with healthy and physically active young adults (n = 35). Participants completed a measure of self-perceived readiness (the ARMS), physical performance (i.e., Vertical Jump (VJ) and Ballistic Push-Up), and perceptual-cognitive exercises (i.e., Single Leg Memory Hop (SLMH), Reactive VJ, Reactive Ballistic Push-Up, Reactive Agility Run Decide, and Upper and Lower Extremity Reaction Tests). Data was analyzed using Pearson's r (r) correlation to identify associations. RESULTS Statistically significant moderate correlations were detected between ARMS Total and VJ (Peak Power Normalized and Flight Time) (r = 0.434, p = 0.010) and (r = 0.420, p = 0.013), and SLMH Distance Normalized (r = 0.409, p = 0.016). Moderate negative correlations between the ARMS Total and Reactive VJ Reaction Time (r = -0.473, p = 0.005). CONCLUSION The ARMS can be an effective tool for measuring acute self-perceived readiness. This suggests that individuals who work in dynamic environments may benefit from training that targets perceptual-cognitive skills. Although moderate, self-perceived readiness was associated with better resilience, health, and performance exercises. Results highlight the importance of protocols targeting populations who work in complex environments for increased performance.
Collapse
Affiliation(s)
- Lina Ochoa
- U.S Army Major, Occupational Therapist, AMEDD Student Detachment (ASD), 187th Medical Battalion, 32nd Medical Brigade, JBSA - Fort Sam Houston, TX, 78234, USA; University of Kentucky Sports Medicine Research Institute, 720 Sports Center Drive, Lexington, KY, 40506, USA.
| | - Ke'La H Porter
- University of Kentucky Sports Medicine Research Institute, 720 Sports Center Drive, Lexington, KY, 40506, USA
| | - Bridget M Walsh
- University of Kentucky Sports Medicine Research Institute, 720 Sports Center Drive, Lexington, KY, 40506, USA
| | - Danielle Torp
- University of Kentucky Sports Medicine Research Institute, 720 Sports Center Drive, Lexington, KY, 40506, USA
| | - Nicholas R Heebner
- University of Kentucky Sports Medicine Research Institute, 720 Sports Center Drive, Lexington, KY, 40506, USA
| | - Matthew C Hoch
- University of Kentucky Sports Medicine Research Institute, 720 Sports Center Drive, Lexington, KY, 40506, USA
| |
Collapse
|
5
|
Sirotiak Z, Lee DC, Brellenthin AG. Associations between physical activity, long COVID symptom intensity, and perceived health among individuals with long COVID. Front Psychol 2024; 15:1498900. [PMID: 39507087 PMCID: PMC11538967 DOI: 10.3389/fpsyg.2024.1498900] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2024] [Accepted: 10/11/2024] [Indexed: 11/08/2024] Open
Abstract
Introduction Physical activity (PA) is associated with better perceived health among individuals with chronic conditions. However, PA's relationship with perceived health in people with long COVID is unclear and may be modified by long COVID symptom burden. Methods Participants with self-reported long COVID (N = 379) responded to an online survey cross-sectionally assessing PA levels, perceived physical and mental health, and intensity of CDC-defined long COVID symptoms on a 0-100 scale. Linear regression analyses assessed the associations between PA and perceived physical and mental health, after accounting for sociodemographic, health behavior, and long COVID intensity variables, with post-hoc analyses comparing health across PA levels. Results Increasing levels of PA were associated with increases in perceived physical health (β = 0.27, p < 0.001) and mental health (β = 0.19, p < 0.001) after accounting for sociodemographic and health behavior variables. PA remained significantly associated with perceived physical health (β = 0.15, p < 0.001) but not perceived mental health (β = 0.09, p = 0.067) after the adding long COVID intensity to the model. Insufficiently active and active groups reported significant better physical and mental health than the inactive group (ps < 0.05), while the highly active group did not significantly differ from any other group on perceived physical or mental health (ps > 0.05). Inactive individuals reported significantly greater long COVID symptom burden compared to each other PA level (ps < 0.05). Conclusion Higher levels of PA may be associated with better physical health among individuals with long COVID, even after accounting for symptom intensity. However, long COVID symptom intensity may confound the relationship between PA and mental health among individuals with long COVID.
Collapse
Affiliation(s)
- Zoe Sirotiak
- Department of Kinesiology, Iowa State University, Ames, IA, United States
| | - Duck-chul Lee
- Department of Health and Human Development, University of Pittsburgh, Pittsburgh, PA, United States
| | | |
Collapse
|
6
|
Vorensky M, Orstad SL, Squires A, Parraga S, Byrne K, Merriwether EN. Relationships Between Socioecological Factors and Self-Efficacy to Participate in Physical Activity for Adults With Chronic Musculoskeletal Pain: An Integrative Review. Phys Ther 2024; 104:pzae120. [PMID: 39214075 PMCID: PMC11523622 DOI: 10.1093/ptj/pzae120] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/28/2023] [Revised: 04/19/2024] [Accepted: 06/16/2024] [Indexed: 09/04/2024]
Abstract
OBJECTIVE Self-efficacy for leisure-time or health-promoting physical activity (SEPA) is a psychosocial determinant of physical activity. The socioecological model can provide a robust perspective of SEPA. The objective of this study was to synthesize the evidence on multilevel correlates of SEPA among individuals with chronic musculoskeletal pain. The second aim examined the extent to which socioecological disparities are associated with SEPA among individuals with chronic musculoskeletal pain. METHODS An integrative review was conducted. Included studies needed to investigate the relationship between SEPA and socioecological factors at the interpersonal, institutional, community, and/or macrosystem level among adults with chronic musculoskeletal pain (≥3 months). Searches in PubMed, EMBASE, PsycINFO, and CINAHL were performed (December 30, 2020, and October 12, 2022), yielding 4047 records after duplicates were removed. Two independent reviewers completed screening, full-text reviews, and data extraction. After title and abstract screening and full-text reviews, 17 studies were included. The constant comparison method included: data reduction, data display, data comparison, and conclusion drawing/verification. Quality of evidence was assessed using the Joanna Briggs Institute appraisal tools. RESULTS Five themes emerged with respect to relationships between SEPA and socioecological factors: social relations, social comparisons, patient-provider relationship, organizational resources, and accessibility to physical activity. Relationships between interpersonal factors and SEPA were most prominently studied. One study examined and addressed potential disparities in SEPA at the macrosystem level. CONCLUSION A spectrum of relationships from supporting to straining SEPA were found at the interpersonal level. Relationships between institutional, community, and macrosystem factors and SEPA were comparably sparse. Gaps in the literature were identified regarding how health disparities present across the socioecological model with respect to SEPA. IMPACT Clinicians can use this review to evaluate how SEPA can be supported or threatened by factors across the socioecological model. This may be a preliminary step towards examining and addressing health disparities in SEPA.
Collapse
Affiliation(s)
- Mark Vorensky
- Department of Rehabilitation and Movement Sciences, School of Health Professions, Rutgers University, Newark, New Jersey, USA
- Rusk Rehabilitation, NYU Langone Health, New York, New York, USA
| | - Stephanie L Orstad
- Department of Medicine, NYU Grossman School of Medicine, New York, New York, USA
| | | | - Susan Parraga
- Department of Medicine, NYU Grossman School of Medicine, New York, New York, USA
- Tufts University School of Medicine, Boston, Massachusetts, USA
| | - Katherine Byrne
- Department of Physical Therapy, NYU Steinhardt School of Culture, Education, and Human Development, New York, New York, USA
| | - Ericka N Merriwether
- Department of Medicine, NYU Grossman School of Medicine, New York, New York, USA
- Department of Physical Therapy, NYU Steinhardt School of Culture, Education, and Human Development, New York, New York, USA
| |
Collapse
|
7
|
Kissi A, Vorensky M, Sturgeon JA, Vervoort T, van Alboom I, Guck A, Perera RA, Rao S, Trost Z. Racial Differences in Movement-Related Appraisals and Pain Behaviors Among Adults With Chronic Low Back Pain. THE JOURNAL OF PAIN 2024; 25:104438. [PMID: 38065466 PMCID: PMC11058036 DOI: 10.1016/j.jpain.2023.11.021] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/15/2023] [Revised: 11/10/2023] [Accepted: 11/27/2023] [Indexed: 01/12/2024]
Abstract
Research documents racial disparities in chronic low back pain (CLBP). Few studies have examined racial disparities in movement-related appraisals and no studies have examined anticipatory appraisals prior to or pain behaviors during functional activities among individuals with CLBP. This cross-sectional study examined racial differences in anticipatory appraisals of pain, concerns about harm, and anxiety, appraisals of pain and anxiety during movement, and observed pain behaviors during 3 activities of daily living (supine-to-standing bed task, sitting-to-standing chair task, floor-to-waist lifting task) in a sample (N = 126) of non-Hispanic Black (31.0%), Hispanic (30.2%), and non-Hispanic White (38.9%) individuals with CLBP. Hispanic participants reported more expected pain, concerns about harm, and pre-movement anxiety prior to the bed and chair tasks compared to non-Hispanic White participants. Hispanic participants reported more pain during the bed task and more anxiety during the bed and chair tasks compared to non-Hispanic White participants. Non-Hispanic Black participants reported more expected pain, concerns about harm, and pre-movement anxiety prior to the bed task and more pre-movement anxiety prior to the chair task compared to non-Hispanic White participants. Non-Hispanic Black participants reported more anxiety during the bed and chair tasks compared to non-Hispanic White participants. Non-Hispanic Black participants were observed to have significantly more verbalizations of pain during the bed task compared to non-Hispanic White participants. Current findings identify racial disparities in important cognitive-behavioral and fear-avoidance mechanisms of pain. Results indicate a need to revisit traditional theoretical and treatment models in CLBP, ensuring racial disparities in pain cognitions are considered. PERSPECTIVE: This study examined racial disparities in anticipatory and movement-related appraisals, and pain behaviors during activities of daily living among Non-Hispanic Black, Non-Hispanic White, and Hispanic individuals with CLBP. Racial disparities identified in the current study have potentially important theoretical implications surrounding cognitive-behavioral and fear-avoidance mechanisms of pain.
Collapse
Affiliation(s)
- Ama Kissi
- Department of Experimental-Clinical and Health Psychology, Ghent University, Henri Dunantlaan 2, 9000 Ghent, Belgium
| | - Mark Vorensky
- Rusk Rehabilitation, NYU Langone Health, 333 East 38 Street, New York, NY 10016, United States of America
- Department of Physical Therapy, New York University, 380 2 Ave, New York, NY 10010, United States of America
- Department of Physical Therapy, Touro University, 3 Times Square, New York, NY 10036, United States of America
| | - John A. Sturgeon
- Department of Anesthesiology, University of Michigan, 24 Frank Lloyd Wright Dr, Ann Arbor, MI 48105, United States of America
| | - Tine Vervoort
- Department of Experimental-Clinical and Health Psychology, Ghent University, Henri Dunantlaan 2, 9000 Ghent, Belgium
| | - Ischa van Alboom
- Department of Experimental-Clinical and Health Psychology, Ghent University, Henri Dunantlaan 2, 9000 Ghent, Belgium
| | - Adam Guck
- Department of Family Medicine, John Peter Smith Health Network, Fort Worth, TX 76104, United States of America
| | - Robert A. Perera
- Department of Physical Medicine and Rehabilitation, Virginia Commonwealth University, 1223 E Marshall St, Richmond, VA 23298, United States of America
| | - Smita Rao
- Department of Physical Therapy, New York University, 380 2 Ave, New York, NY 10010, United States of America
| | - Zina Trost
- Department of Physical Medicine and Rehabilitation, Virginia Commonwealth University, 1223 E Marshall St, Richmond, VA 23298, United States of America
| |
Collapse
|
8
|
Reis G, Savassi LCM, Ferreira TS, Reis LLF, Simplicio MIC, Ribeiro LB, Silva EADSM, Lat PK, Harari O, Forrest JI, Dron L, Park JJH, Thorlund K, Mills EJ. Matched vs Nonmatched Placebos in a Randomized Trial of COVID-19 Treatments. JAMA Netw Open 2024; 7:e2410335. [PMID: 38767921 PMCID: PMC11107303 DOI: 10.1001/jamanetworkopen.2024.10335] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/11/2023] [Accepted: 03/07/2024] [Indexed: 05/22/2024] Open
Abstract
Importance Matched placebo interventions are complex and resource intensive. Recent evidence suggests matched placebos may not always be necessary. Previous studies have predominantly evaluated potential bias of nonmatched placebos (ie, differing on dose, frequency of administration, or formulation) in pain and mental health, but to date no systematic examination has been conducted in infectious disease. Objective To test for differences between nonmatched and matched placebo arms with respect to clinical outcome measures across multiple therapeutics for COVID-19. Design, Setting, and Participants In a comparative effectiveness research study, a post hoc analysis was conducted of data on individual patients enrolled in a large, multiarm, platform randomized clinical trial in symptomatic adult outpatients with COVID-19 between January 15, 2021, to September 28, 2023, in which the outcomes of both matched and nonmatched placebo groups were reported. Bayesian and frequentist covariate-adjusted techniques were compared with 7 intervention-placebo pairs. Exposures Seven matched and nonmatched placebo pairs (for a total of 7 comparisons) were evaluated throughout the primary platform trial. Comparisons were made between treatment and its associated matched (concurrent) placebo, as well as with nonmatched placebo (alone and in combination) assessed at a similar time point. Main Outcomes and Measures Outcomes assessed included hospitalizations, EuroQol 5-Dimension 5-level scores, and PROMIS Global-10 scores. Results A total of 7 intervention-control pairs (N = 2684) were assessed, including 1620 (60.4%) women, with mean (SD) age, 47 (15.2) years; the most common comorbidities were obesity (41.9%) and hypertension (37.9%). In a meta-analysis with decoupled SEs, accounting for overlapping placebo patients, the overall odds ratio (OR) of nonmatched compared with matched placebo was 1.01 (95% credible interval, 0.77-1.32), with posterior probability of equivalence, defined as 0.8 ≤ OR ≤ 1.2 (a deviation from perfect equivalence ie, OR = 1, by no more than 0.2) of 85.4%, implying no significant difference. Unadjusted analysis of the event rate difference between all nonmatched and matched placebo groups did not identify any notable differences across all 7 treatment-placebo combinations assessed. Similar analysis that was conducted for patient-reported quality of life outcomes did not yield statistically significant differences. Conclusions and Relevance In this post hoc study of a randomized clinical platform trial, pooling matched and nonmatched placebo patient data did not lead to inconsistencies in treatment effect estimation for any of the investigational drugs. These findings may have significant implications for future platform trials, as the use of nonmatched placebo may improve statistical power, or reduce barriers to placebo implementation.
Collapse
Affiliation(s)
- Gilmar Reis
- Research Division, Cardresearch-Cardiologia Assistencial e de Pesquisa, Belo Horizonte, Brazil
- Department of Medicine, Pontifícia Universidade Católica de Minas Gerais, Belo Horizonte, Brazil
- Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada
- David Sackett Research Institute, Belo Horizonte, Brazil
| | - Leonardo Cançado Monteiro Savassi
- Research Division, Cardresearch-Cardiologia Assistencial e de Pesquisa, Belo Horizonte, Brazil
- David Sackett Research Institute, Belo Horizonte, Brazil
- Public Health, Mental and Family Medicine Department, Ouro Preto Federal University, Ouro Preto, Brazil
| | - Thiago Santiago Ferreira
- Research Division, Cardresearch-Cardiologia Assistencial e de Pesquisa, Belo Horizonte, Brazil
- David Sackett Research Institute, Belo Horizonte, Brazil
| | - Luiza Lanna França Reis
- Research Division, Cardresearch-Cardiologia Assistencial e de Pesquisa, Belo Horizonte, Brazil
- David Sackett Research Institute, Belo Horizonte, Brazil
| | - Maria Izabel Campos Simplicio
- Research Division, Cardresearch-Cardiologia Assistencial e de Pesquisa, Belo Horizonte, Brazil
- David Sackett Research Institute, Belo Horizonte, Brazil
| | - Luciene Barra Ribeiro
- Research Division, Cardresearch-Cardiologia Assistencial e de Pesquisa, Belo Horizonte, Brazil
- David Sackett Research Institute, Belo Horizonte, Brazil
| | | | | | - Ofir Harari
- Core Clinical Sciences, Vancouver, British Columbia, Canada
| | | | - Louis Dron
- Cascade Outcomes Research, Vancouver, British Columbia, Canada
| | - Jay J. H. Park
- Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada
- Core Clinical Sciences, Vancouver, British Columbia, Canada
| | - Kristian Thorlund
- Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada
| | - Edward J. Mills
- Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada
- Purpose Life Sciences, Vancouver, British Columbia, Canada
| |
Collapse
|
9
|
D’Adamo CR, Kaplan MB, Campbell PS, McLaughlin K, Swartz JS, Wattles KR, Lukaczer D, Scheinbaum S. Functional medicine health coaching improved elimination diet compliance and patient-reported health outcomes: Results from a randomized controlled trial. Medicine (Baltimore) 2024; 103:e37148. [PMID: 38394515 PMCID: PMC11309605 DOI: 10.1097/md.0000000000037148] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/10/2023] [Accepted: 01/11/2024] [Indexed: 02/25/2024] Open
Abstract
BACKGROUND The objective of this study was to determine whether an elimination diet with virtually provided functional medicine health coaching support would be more effective than a typical self-guided elimination diet with respect to dietary compliance and patient-reported health and quality of life. METHODS A parallel arm, randomized controlled trial was conducted among a sample of healthcare professionals. Participants were randomized to either an elimination diet with 5 sessions of functional medicine health coaching support (intervention arm) or a self-guided elimination diet (control arm). Outcomes assessed at baseline and at the conclusion of the 10-week study included PROMIS Global Health (GH) and medical symptoms questionnaire (MSQ). Compliance with the elimination diet was assessed at the conclusion of the study. Baseline and end of study outcomes were compared within study arms via paired t tests and between study arms with unpaired t tests. Subgroup analysis of symptomatology at baseline was performed. RESULTS 125 randomized participants (n = 64 intervention, n = 61 control) provided baseline outcomes data. There were statistically and clinically significant within-group improvements in patient-reported outcomes in both the intervention arm (PROMIS GH-physical = 4.68, PROMIS GH-mental = 3.53, MSQ = 28.9) and control arm (PROMIS GH-physical = 48.4, PROMIS GH-mental = 3.18, MSQ = 24.1). There were no between-group differences in the primary analysis (P > .1). However, participants with more symptoms at baseline had statistically and clinically significant between-group differences in PROMIS GH-mental health (3.90, P = .0038) and MSQ (12.3, P = .047) scores that favored the functional medicine health coaching arm. CONCLUSIONS An elimination diet, whether self-guided or with functional medicine health coaching support, may improve patient-reported health outcomes among relatively healthy healthcare professionals. While studies in more diverse samples are needed, functional medicine health coaching support appears to be superior to a self-guided approach with regard to both dietary compliance and improving health outcomes among those with greater symptomatology.
Collapse
Affiliation(s)
- Christopher R. D’Adamo
- Center for Integrative Medicine, University of Maryland School of Medicine, Baltimore, MD
| | | | | | | | | | | | - Dan Lukaczer
- The Institute for Functional Medicine, Federal Way, WA
| | | |
Collapse
|
10
|
Williams H, Steinberg S, Leon K, Vingum R, Hu M, Berzin R, Hagg H, Hanaway P. Predictive Criterion Validity of the Parsley Symptom Index Against the Patient-Reported Outcomes Measurement Information System-10 in a Chronic Disease Cohort: Retrospective Cohort Study. JMIR Form Res 2024; 8:e53316. [PMID: 38363587 PMCID: PMC10907938 DOI: 10.2196/53316] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2023] [Revised: 01/11/2024] [Accepted: 01/14/2024] [Indexed: 02/17/2024] Open
Abstract
BACKGROUND Approximately 60% of US adults live with chronic disease, imposing a significant burden on patients and the health care system. With the rise of telehealth, patient-reported outcomes measures (PROMs) have emerged as pivotal tools for managing chronic disease. While numerous PROMs exist, few have been designed explicitly for telehealth settings. The Parsley Symptom Index (PSI) is an electronic patient-reported outcome measure (ePROM) developed specifically for telehealth environments. OBJECTIVE Our aim is to determine whether the PSI predicts changes in the established Patient-Reported Outcomes Measurement Information System-10 (PROMIS-10) Global Health, a 10-question short form. METHODS We conducted a retrospective cohort study using data from 367 unique patients, amassing 1170 observations between August 30, 2017, and January 30, 2023. Patients completed the PSI and the PROMIS-10 multiple times throughout the study period. Using univariate regression models, we assess the predictive criterion validity of the PSI against PROMIS-10 scores. RESULTS This study revealed significant relationships between the PSI and PROMIS-10 physical and mental health scores through comprehensive univariate analyses, thus establishing support for the criterion validity of the PSI. These analyses highlighted the PSI's potential as an insightful tool for understanding and predicting both mental and physical health dimensions. CONCLUSIONS Our findings emphasize the importance of the PSI in capturing the nuanced interactions between symptomatology and health outcomes. These insights reinforce the value of the PSI in clinical contexts and support its potential as a versatile tool in both research and practice.
Collapse
Affiliation(s)
- Hants Williams
- Applied Health Informatics, School of Health Professions, Stony Brook University, Stony Brook, NY, United States
| | | | | | - Ryan Vingum
- Untold Content, Cincinnati, OH, United States
| | - Mengyao Hu
- Applied Health Informatics, School of Health Professions, Stony Brook University, Stony Brook, NY, United States
| | | | | | | |
Collapse
|
11
|
Woznica DN, Milligan M, Krymis H, Peters KC, O'Connor MI, Grant RA. Telemedical Interdisciplinary Care Team Evaluation and Treatment of People With Low Back Pain: A Retrospective Observational Study. Arch Rehabil Res Clin Transl 2023; 5:100269. [PMID: 37744196 PMCID: PMC10517362 DOI: 10.1016/j.arrct.2023.100269] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/26/2023] Open
Abstract
Objective To evaluate the effects of an interdisciplinary care team (ICT) model delivered by telemedicine on patients with low back pain (LBP). Design Retrospective analysis of deidentified pre-existing data. Setting Retrospective observational study of patients presenting with LBP to a nationwide telemedicine practice using an ICT model. Participants Over a 9-month period all patients with a diagnosis related to LBP and who had an ICT evaluation (medical doctor, advanced practice provider, health coach, and physical therapist) were included in the study (n=36). A minimum of 2 follow-up physical therapy visits were required for inclusion. Interventions Patients were evaluated for LBP, received a diagnosis, and were offered a multidisciplinary treatment plan. Additional real-time audio visual medical, health coaching, registered dietician, and physical therapy services were received as deemed clinically appropriate. Main Outcome Measures Baseline, 30 day, and final pain (mean 81 day) measurements via numerical pain rating scale (NPRS). Baseline and final Patient-Reported Outcomes Measurement Information System (PROMIS)-10 Global Mental/Physical domains. Secondary Outcome Measures Use of prescription medication, referral for imaging, need for injections, or surgery. Results 36 patients met criteria. Pain levels included mild (n=6, 16.7%), moderate (n=19, 52.8%), and severe (n=11, 30.6%). Clinically significant pain improvements were noted in 83.3% (n=25) of those with moderate or severe pain. PROMIS Mental and Physical Health categorization from Fair/Poor to Good/Excellent significantly improved over time. The initial 20% (n=7) in Fair/Poor Mental Health improved to 6.3% (n=2) at finish, while the 80% (n=28) in Good/Excellent Mental Health at start improved to 93.8% (n=30) at finish. Regarding Physical Health, 51.4% (n=18) rated Fair/Poor at start and 31.3% (n=10) at finish, while the 48.6% (n=17) rated Good/Excellent at start improved to 68.8% (n=22) at finish. The need for prescription medication was low (n=6, 16.7%) and spinal imaging orders were negligible (n=1, 2.8%). Injections were warranted in 11.4% (n=4) of patients and surgical referral with operative treatment in 2.8% (n=1). Conclusion Interdisciplinary care delivered through telemedicine can significantly improve pain and support improved health-related quality of life in patients with LBP, with low rates of imaging, prescription, and interventional use.
Collapse
|
12
|
Nagineviciute M, Bartuseviciene E, Blazeviciene A. Woman-Centered Care: Standardized Outcomes Measure. MEDICINA (KAUNAS, LITHUANIA) 2023; 59:1537. [PMID: 37763656 PMCID: PMC10533153 DOI: 10.3390/medicina59091537] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/27/2023] [Revised: 08/23/2023] [Accepted: 08/24/2023] [Indexed: 09/29/2023]
Abstract
Background and Objectives: Patient- or woman-centered care, prioritizing women's perspectives, needs, and preferences, is a widely recommended approach to enhance the quality of maternity care services. It aligns with the broader principles of patient-centered care, emphasizing the importance of a collaborative and respectful relationship between healthcare providers and women. This study evaluates low-risk pregnancies managed by midwives and obstetrician-gynecologists in Lithuania using patient-reported outcome measures and patient-reported experience measures. Materials and Methods: A prospective cohort study was conducted between September 2022 and April 2023. Data were collected through patient-reported questionnaires. Results: A total of 153 pregnant women who had singleton, low-risk pregnancies participated in the study, of whom 24.8% had their pregnancies supervised by a midwife, and 75.2% of the participants had their pregnancies supervised by an obstetrician-gynecologist. The study found no statistically significant differences in assessed patient-reported outcome measures and patient-reported experience measures between both models of care. Conclusions: Adopting patient-centered approaches enables healthcare systems to understand and address women's specific needs and preferences, fostering high-quality and woman-centered care. This research adds to the growing evidence supporting midwife-led care and emphasizes the importance of personalized, woman-centered approaches in maternity care, ultimately enhancing maternal health outcomes and promoting positive experiences for low-risk pregnant women. The quality of care provided by midwives remains uncompromised and equivalently proficient compared to the care provided by collaborative teams.
Collapse
Affiliation(s)
- Milda Nagineviciute
- Department of Nursing, Faculty of Nursing, Lithuanian University of Health Sciences, 44307 Kaunas, Lithuania;
| | - Egle Bartuseviciene
- Department of Obstetrics and Gynecology, Faculty of Medicine, Lithuanian University of Health Sciences, 44307 Kaunas, Lithuania;
| | - Aurelija Blazeviciene
- Department of Nursing, Faculty of Nursing, Lithuanian University of Health Sciences, 44307 Kaunas, Lithuania;
| |
Collapse
|
13
|
Craner JR, Lake ES, Barr AC, Kirby KE, O'Neill M. Childhood Adversity among Adults with Chronic Pain: Prevalence and Association with Pain-Related Outcomes. Clin J Pain 2022; 38:551-561. [PMID: 35777964 DOI: 10.1097/ajp.0000000000001054] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2022] [Accepted: 06/16/2022] [Indexed: 11/25/2022]
Abstract
OBJECTIVES Adverse childhood experiences (ACEs) have been linked to the development and impact of chronic pain in adulthood. The goal of this study was to investigate the prevalence of ACEs in a treatment-seeking sample of adults with chronic pain and the relationship between number and type(s) of ACEs and pain-related outcomes. METHODS Adults (N=1794) presenting for treatment at a multidisciplinary pain management center completed self-report measures of childhood adversity, pain, functioning, emotional distress, and adjustment to pain. RESULTS Participants endorsing ≥4 ACEs had significantly worse pain-related outcomes and lower quality of life compared to individuals reporting fewer ACEs. Having ≥3 ACEs was associated with higher anxiety and depression levels. Experiences of childhood neglect negatively affected mental health-related outcomes independent of number of ACEs. Significant sex differences were found in the number and type of ACEs reported, but not in the relationship between ACEs and outcome variables. CONCLUSION Findings suggest that the number and type of self-reported ACE(s) are associated with pain-related variables and psychosocial functioning in adults with chronic pain. Results highlight the importance of assessment of ACEs and trauma-informed care with patients with chronic pain.
Collapse
Affiliation(s)
- Julia R Craner
- Mary Free Bed Rehabilitation Hospital, 235 Wealthy St. SE, Grand Rapids, MI 49503.,Michigan State University College of Human Medicine, 15 Michigan St. NE, Grand Rapids, MI 49503
| | - Eric S Lake
- Mary Free Bed Rehabilitation Hospital, 235 Wealthy St. SE, Grand Rapids, MI 49503.,Michigan State University College of Human Medicine, 15 Michigan St. NE, Grand Rapids, MI 49503
| | - Aex C Barr
- Mary Free Bed Rehabilitation Hospital, 235 Wealthy St. SE, Grand Rapids, MI 49503.,Michigan State University College of Human Medicine, 15 Michigan St. NE, Grand Rapids, MI 49503
| | - Krissa E Kirby
- Mary Free Bed Rehabilitation Hospital, 235 Wealthy St. SE, Grand Rapids, MI 49503
| | - Mariceli O'Neill
- Mary Free Bed Rehabilitation Hospital, 235 Wealthy St. SE, Grand Rapids, MI 49503
| |
Collapse
|
14
|
Ligezka AN, Mohamed A, Pascoal C, Ferreira VDR, Boyer S, Lam C, Edmondson A, Krzysciak W, Golebiowski R, Perez-Ortiz J, Morava E. Patient-reported outcomes and quality of life in PMM2-CDG. Mol Genet Metab 2022; 136:145-151. [PMID: 35491370 DOI: 10.1016/j.ymgme.2022.04.002] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/15/2022] [Revised: 04/10/2022] [Accepted: 04/11/2022] [Indexed: 12/15/2022]
Abstract
Patient-reported outcomes (PROs) measure important aspects of disease burden, however they have received limited attention in the care of patients with Congenital Disorders of Glycosylation (CDG). We evaluated the PROs and correlation between clinical disease severity scoring and reported quality of life (QoL) in a PMM2-CDG patient cohort. Twenty-five patients with diagnosis of PMM2-CDG were enrolled as part of the Frontiers in Congenital Disorders of Glycosylation Consortium (FCDGC) natural history study. Patient- Reported Outcomes Measurement Information System (PROMIS) was completed by caregivers to assess health-related QoL. Clinical disease severity was scored by medical providers using the Nijmegen Progression CDG Rating Scale (NPCRS). The domains such as physical activity, strength impact, upper extremity, physical mobility, and a satisfaction in social roles (peer relationships) were found to be the most affected in the PMM2-CDG population compared to US general population. We found a strong correlation between NPCRS 1 (current functional ability) and three out of ten PROMIS subscales. NPCRS 2 (laboratory and organ function) and NPCRS 3 (neurological involvement) did not correlate with PROMIS. Mental health domains, such as anxiety, were positively correlated with depressive symptoms (r = 0.76, p = 0.004), fatigue (r = 0.67, p = 0.04). Surprisingly, patients with severely affected physical mobility showed low anxiety scores according to PROMIS (inverse correlation, r = -0.74, p = 0.005). Additionally, there was a positive correlation between upper extremity and physical mobility (r = 0.75, p = 002). Here, we found that PROMIS is an informative additional tool to measure CDG disease burden, which could be used as clinical trial outcome measures. The addition of PROMIS to clinical follow-up could help improve the quality of care for PMM2-CDG by facilitating a holistic approach for clinical decision-making. SYNOPSIS: We recommend PROMIS as an informative tool to measure disease burden in PMM2-CDG in addition to traditional CDG disease severity scores.
Collapse
Affiliation(s)
- Anna N Ligezka
- Department of Clinical Genomics, Mayo Clinic, Rochester, MN 55905, USA; Department of Medical Diagnostics, Faculty of Pharmacy, Jagiellonian University Medical College, Medyczna 9, 30-688 Krakow, Poland
| | - Anab Mohamed
- Department of Clinical Genomics, Mayo Clinic, Rochester, MN 55905, USA
| | - Carlota Pascoal
- UCIBIO, Departamento Ciências da Vida, NOVA School of Science and Technology, NOVA University of Lisbon, Associate Laboratory i4HB - Institute for Health and Bioeconomy, School of Science and Technology, 2819-516 Caparica, Portugal; Portuguese Association for CDG, Lisboa, CDG & Allies - Professionals and Patient Associations International Network (CDG & Allies - PPAIN), Portugal
| | - Vanessa Dos Reis Ferreira
- UCIBIO, Departamento Ciências da Vida, NOVA School of Science and Technology, NOVA University of Lisbon, Associate Laboratory i4HB - Institute for Health and Bioeconomy, School of Science and Technology, 2819-516 Caparica, Portugal; Portuguese Association for CDG, Lisboa, CDG & Allies - Professionals and Patient Associations International Network (CDG & Allies - PPAIN), Portugal
| | - Suzanne Boyer
- Department of Clinical Genomics, Mayo Clinic, Rochester, MN 55905, USA
| | - Christina Lam
- Division of Genetic Medicine, Department of Pediatrics, University of Washington School of Medicine, Seattle, WA 98105, USA; Center for Integrative Brain Research, Seattle Children's Research Institute, Seattle, WA 98101, USA
| | - Andrew Edmondson
- Section of Biochemical Genetics, Division of Human Genetics, Department of Pediatrics, Children's Hospital of Philadelphia, Philadelphia, PA 19104, USA
| | - Wirginia Krzysciak
- Department of Medical Diagnostics, Faculty of Pharmacy, Jagiellonian University Medical College, Medyczna 9, 30-688 Krakow, Poland
| | - Raphael Golebiowski
- Department of Psychiatry and Psychology, Mayo Clinic, Rochester, MN 55905, USA
| | - Judit Perez-Ortiz
- Department of Pediatric and Adolescent Medicine, Mayo Clinic, Rochester, MN 55905, USA
| | - Eva Morava
- Department of Clinical Genomics, Mayo Clinic, Rochester, MN 55905, USA; Biochemical Genetics Laboratory, Department of Laboratory Medicine and Pathology, Mayo Clinic, Rochester, MN 55905, USA; Metabolic disease center, University Hospitals Leuven, Leuven, Belgium.
| |
Collapse
|