1
|
Zainal NH, Bossarte RM, Gildea SM, Hwang I, Kennedy CJ, Liu H, Luedtke A, Marx BP, Petukhova MV, Post EP, Ross EL, Sampson NA, Sverdrup E, Turner B, Wager S, Kessler RC. Developing an individualized treatment rule for Veterans with major depressive disorder using electronic health records. Mol Psychiatry 2024; 29:2335-2345. [PMID: 38486050 PMCID: PMC11399319 DOI: 10.1038/s41380-024-02500-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/16/2023] [Revised: 02/23/2024] [Accepted: 02/27/2024] [Indexed: 09/16/2024]
Abstract
Efforts to develop an individualized treatment rule (ITR) to optimize major depressive disorder (MDD) treatment with antidepressant medication (ADM), psychotherapy, or combined ADM-psychotherapy have been hampered by small samples, small predictor sets, and suboptimal analysis methods. Analyses of large administrative databases designed to approximate experiments followed iteratively by pragmatic trials hold promise for resolving these problems. The current report presents a proof-of-concept study using electronic health records (EHR) of n = 43,470 outpatients beginning MDD treatment in Veterans Health Administration Primary Care Mental Health Integration (PC-MHI) clinics, which offer access not only to ADMs but also psychotherapy and combined ADM-psychotherapy. EHR and geospatial databases were used to generate an extensive baseline predictor set (5,865 variables). The outcome was a composite measure of at least one serious negative event (suicide attempt, psychiatric emergency department visit, psychiatric hospitalization, suicide death) over the next 12 months. Best-practices methods were used to adjust for nonrandom treatment assignment and to estimate a preliminary ITR in a 70% training sample and to evaluate the ITR in the 30% test sample. Statistically significant aggregate variation was found in overall probability of the outcome related to baseline predictors (AU-ROC = 0.68, S.E. = 0.01), with test sample outcome prevalence of 32.6% among the 5% of patients having highest predicted risk compared to 7.1% in the remainder of the test sample. The ITR found that psychotherapy-only was the optimal treatment for 56.0% of patients (roughly 20% lower risk of the outcome than if receiving one of the other treatments) and that treatment type was unrelated to outcome risk among other patients. Change in aggregate treatment costs of implementing this ITR would be negligible, as 16.1% fewer patients would be prescribed ADMs and 2.9% more would receive psychotherapy. A pragmatic trial would be needed to confirm the accuracy of the ITR.
Collapse
Affiliation(s)
- Nur Hani Zainal
- Department of Health Care Policy, Harvard Medical School, Boston, MA, USA
| | - Robert M Bossarte
- Department of Psychiatry and Behavioral Neurosciences, University of South Florida, Tampa, FL, USA
| | - Sarah M Gildea
- Department of Health Care Policy, Harvard Medical School, Boston, MA, USA
| | - Irving Hwang
- Department of Health Care Policy, Harvard Medical School, Boston, MA, USA
| | - Chris J Kennedy
- Department of Psychiatry, Massachusetts General Hospital, Boston, MA, USA
| | - Howard Liu
- Department of Health Care Policy, Harvard Medical School, Boston, MA, USA
- Center of Excellence for Suicide Prevention, Canandaigua VA Medical Center, Canandaigua, NY, USA
| | - Alex Luedtke
- Department of Statistics, University of Washington, Seattle, WA, USA
- Vaccine and Infectious Disease Division, Fred Hutchinson Cancer Research Center, Seattle, WA, USA
| | - Brian P Marx
- National Center for PTSD, VA Boston Healthcare System, Boston, MA, USA
- Department of Psychiatry, Boston University School of Medicine, Boston, MA, USA
| | - Maria V Petukhova
- Department of Health Care Policy, Harvard Medical School, Boston, MA, USA
| | - Edward P Post
- Center for Clinical Management Research, VA Ann Arbor Health Care System, Ann Arbor, MI, USA
- Department of Medicine, University of Michigan Medical School, Ann Arbor, MI, USA
| | - Eric L Ross
- Department of Psychiatry, Larner College of Medicine, University of Vermont, Burlington, VT, USA
| | - Nancy A Sampson
- Department of Health Care Policy, Harvard Medical School, Boston, MA, USA
| | - Erik Sverdrup
- Graduate School of Business, Stanford University, Stanford, CA, USA
| | - Brett Turner
- Harvard T.H. Chan School of Public Health, Boston, MA, USA
| | - Stefan Wager
- Graduate School of Business, Stanford University, Stanford, CA, USA
| | - Ronald C Kessler
- Department of Health Care Policy, Harvard Medical School, Boston, MA, USA.
| |
Collapse
|
2
|
Clinton-Lisell V, Litzinger C. Is it really a neuromyth? A meta-analysis of the learning styles matching hypothesis. Front Psychol 2024; 15:1428732. [PMID: 39055994 PMCID: PMC11270031 DOI: 10.3389/fpsyg.2024.1428732] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2024] [Accepted: 06/17/2024] [Indexed: 07/28/2024] Open
Abstract
Learning styles have been a contentious topic in education for years. The purpose of this study was to conduct a meta-analysis of the effects of matching instruction to modality learning styles compared to unmatched instruction on learning outcomes. A systematic search of the research findings yielded 21 eligible studies with 101 effect sizes and 1,712 participants for the meta-analysis. Based on robust variance estimation, there was an overall benefit of matching instruction to learning styles, g = 0.31, SE = 0.12, 95% CI = [0.05, 0.57], p = 0.02. However, only 26% of learning outcome measures indicated matched instruction benefits for at least two styles, indicating a crossover interaction supportive of the matching hypothesis. In total, 12 studies without sufficient statistical details for the meta-analysis were also examined for an indication of a crossover effect; 25% of these studies had findings indicative of a crossover interaction. Given the time and financial expenses of implementation coupled with low study quality, the benefits of matching instruction to learning styles are interpreted as too small and too infrequent to warrant widespread adoption.
Collapse
|
3
|
Li L, Levine RA, Fan J. Causal Effect Random Forest of Interaction Trees for Learning Individualized Treatment Regimes with Multiple Treatments in Observational Studies. Stat (Int Stat Inst) 2022. [DOI: 10.1002/sta4.457] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Affiliation(s)
- Luo Li
- Computational Science Research Center San Diego State University California USA
| | - Richard A. Levine
- Department of Mathematics and Statistics San Diego State University California USA
- Analytics Studies and Institutional Research San Diego State University California USA
| | - Juanjuan Fan
- Department of Mathematics and Statistics San Diego State University California USA
| |
Collapse
|
4
|
Chen Y, Wang Y, Zeng D. Synthesizing independent stagewise trials for optimal dynamic treatment regimes. Stat Med 2020; 39:4107-4119. [PMID: 32804414 PMCID: PMC7814466 DOI: 10.1002/sim.8712] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2020] [Revised: 05/29/2020] [Accepted: 07/09/2020] [Indexed: 11/09/2022]
Abstract
Dynamic treatment regimes (DTRs) adaptively prescribe treatments based on patients' intermediate responses and evolving health status over multiple treatment stages. Data from sequential multiple assignment randomization trials (SMARTs) are recommended to be used for learning DTRs. However, due to re-randomization of the same patients over multiple treatment stages and a prolonged follow-up period, SMARTs are often difficult to implement and costly to manage, and patient adherence is always a concern in practice. To lessen such practical challenges, we propose an alternative approach to learn optimal DTRs by synthesizing independent trials over different stages. Specifically, at each stage, data from a single randomized trial along with patients' natural medical history and health status in previous stages are used. We use a backward learning method to estimate optimal treatment decisions at a particular stage, where patients' future optimal outcome increments are estimated using data observed from independent trials with future stages' information. Under some conditions, we show that the proposed method yields consistent estimation of the optimal DTRs and we obtain the same learning rates as those from SMARTs. We conduct simulation studies to demonstrate the advantage of the proposed method. Finally, we learn optimal DTRs for treating major depressive disorder (MDD) by stagewise synthesis of two randomized trials. We perform a validation study on independent subjects and show that the synthesized DTRs lead to the greatest MDD symptom reduction compared to alternative methods.
Collapse
Affiliation(s)
- Yuan Chen
- Department of Biostatistics, Columbia University, New York, New York, USA
| | - Yuanjia Wang
- Department of Biostatistics, Columbia University, New York, New York, USA
| | - Donglin Zeng
- Department of Biostatistics, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, USA
| |
Collapse
|