1
|
Williams MJ, Vogel JP, Gallos ID, Ramson JA, Chou D, Oladapo OT. The use of network meta-analysis in updating WHO living maternal and perinatal health recommendations. BMJ Glob Health 2023; 8:e013109. [PMID: 38084476 PMCID: PMC10711830 DOI: 10.1136/bmjgh-2023-013109] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2023] [Accepted: 10/21/2023] [Indexed: 12/18/2023] Open
Abstract
Drawing on two recent examples of WHO living guidelines in maternal and perinatal health, this paper elucidates a pragmatic, stepwise approach to using network meta-analysis (NMA) in guideline development in the presence of multiple treatment options. NMA has important advantages. These include the ability to compare multiple interventions in a single coherent analysis, provide direct estimates of the relative effects of all available interventions, infer indirect effect estimates for interventions not directly compared and generate rankings of the available treatment options. It can be difficult to harness these advantages in the face of a lack of current guidance on using NMA evidence in guideline development, with several challenges emerging. Challenges include the choice of conceptual approach, the volume and complexity of the evidence, the contribution of treatment rankings, and the fact that the preferable treatment is not always obvious. This paper describes a layered approach to resolving these challenges, which supports systematic guideline decision-making and development of trustworthy clinical guidelines when multiple treatment options are available.
Collapse
Affiliation(s)
| | - Joshua P Vogel
- Maternal, Child and Adolescent Health Program, Burnet Institute, Melbourne, Victoria, Australia
| | - Ioannis D Gallos
- UNDP/UNFPA/UNICEF/WHO/World Bank Special Programme of Research, Development and Research Training in Human Reproduction (HRP), Department of Sexual and Reproductive Health and Research, World Health Organization, Geneva, Switzerland
| | - Jenny A Ramson
- Maternal, Child and Adolescent Health Program, Burnet Institute, Melbourne, Victoria, Australia
| | - Doris Chou
- UNDP/UNFPA/UNICEF/WHO/World Bank Special Programme of Research, Development and Research Training in Human Reproduction (HRP), Department of Sexual and Reproductive Health and Research, World Health Organization, Geneva, Switzerland
| | - Olufemi T Oladapo
- UNDP/UNFPA/UNICEF/WHO/World Bank Special Programme of Research, Development and Research Training in Human Reproduction (HRP), Department of Sexual and Reproductive Health and Research, World Health Organization, Geneva, Switzerland
| |
Collapse
|
2
|
Duan R, Tong J, Sutton AJ, Asch DA, Chu H, Schmid CH, Chen Y. Origami plot: a novel multivariate data visualization tool that improves radar chart. J Clin Epidemiol 2023; 156:85-94. [PMID: 36822444 PMCID: PMC10599795 DOI: 10.1016/j.jclinepi.2023.02.020] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2022] [Revised: 02/07/2023] [Accepted: 02/15/2023] [Indexed: 02/23/2023]
Abstract
OBJECTIVES We propose the origami plot, which maintains the original functionality of a radar chart and avoids potential misuse of its connected regions, with newly added features to better assist multicriteria decision-making. STUDY DESIGN AND SETTING Built upon a radar chart, the origami plot adds additional auxiliary axes and points such that the area of the connected region of all dots is invariant to the ordering of axes. As such, it enables ranking different individuals by the overall performance for multicriteria decision-making while maintaining the intuitive visual appeal of the radar chart. We develop extensions of the origami plot, including the weighted origami plot, which allows reweighting of each attribute to define the overall performance, and the pairwise origami plot, which highlights comparisons between two individuals. RESULTS We illustrate the different versions of origami plots using the hospital compare database developed by the Centers for Medicare & Medicaid Services (CMS). The plot shows individual hospital's performance on mortality, readmission, complication, and infection, as well as patient experience and timely and effective care, as well as their overall performance across these metrics. The weighted origami plot allows weighing the attributes differently when some are more important than others. We illustrate the potential use of the pairwise origami plot in electronic health records (EHR) system to monitor five clinical measures (body mass index [BMI]), fasting glucose level, blood pressure, triglycerides, and low-density lipoprotein ([LDL] cholesterol) of a patient across multiple hospital visits. CONCLUSION The origami plot is a useful visualization tool to assist multicriteria decision making. It improves radar charts by avoiding potential misuse of the connected regions. It has several new features and allows flexible customization.
Collapse
Affiliation(s)
- Rui Duan
- Department of Biostatistics, Harvard T.H. Chan School of Public Health, Boston, MA, USA.
| | - Jiayi Tong
- Department of Biostatistics, Epidemiology and Informatics, University of Pennsylvania, Philadelphia, PA, USA
| | - Alex J Sutton
- Department of Health Sciences, University of Leicester, Leicester, UK
| | - David A Asch
- Division of General Internal Medicine, University of Pennsylvania, Philadelphia, PA, USA; Leonard Davis Institute of Health Economics, Philadelphia, PA, USA
| | - Haitao Chu
- Division of Biostatistics, University of Minnesota, Minneapolis, MN, USA; Statistical Research and Innovation, Global Biometrics and Data Management, Pfizer Inc., New York, NY, USA
| | | | - Yong Chen
- Department of Biostatistics, Epidemiology and Informatics, University of Pennsylvania, Philadelphia, PA, USA; Leonard Davis Institute of Health Economics, Philadelphia, PA, USA.
| |
Collapse
|
3
|
Ostinelli EG, Efthimiou O, Naci H, Furukawa TA, Leucht S, Salanti G, Wainwright L, Zangani C, De Crescenzo F, Smith K, Stevens K, Liu Q, Cipriani A. Vitruvian plot: a visualisation tool for multiple outcomes in network meta-analysis. EVIDENCE-BASED MENTAL HEALTH 2022; 25:e65-e70. [PMID: 35613849 PMCID: PMC9811072 DOI: 10.1136/ebmental-2022-300457] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/23/2022] [Accepted: 05/10/2022] [Indexed: 01/17/2023]
Abstract
OBJECTIVE A network meta-analysis (NMA) usually assesses multiple outcomes across several treatment comparisons. The Vitruvian plot aims to facilitate communication of multiple outcomes from NMAs to patients and clinicians. METHODS We developed this tool following the recommendations on the communication of benefit-risk information from the available literature. We collected and implemented feedback from researchers, statisticians, methodologists, clinicians and people with lived experience of physical and mental health issues. RESULTS We present the Vitruvian plot, which graphically presents absolute estimates and relative performance of competing interventions against a common comparator for several outcomes of interest. We use two alternative colour schemes to highlight either the strength of statistical evidence or the confidence in the evidence. Confidence in the evidence is evaluated across six domains (within-study bias, reporting bias, indirectness, imprecision, heterogeneity and incoherence) using the Confidence in Network Meta-Analysis (CINeMA) system. CONCLUSIONS The Vitruvian plot allows reporting of multiple outcomes from NMAs, with colourings appropriate to inform credibility of the presented evidence.
Collapse
Affiliation(s)
- Edoardo Giuseppe Ostinelli
- Department of Psychiatry, University of Oxford, Oxford, UK,Oxford Precision Psychiatry Lab, NIHR Oxford Health Biomedical Research Centre, Oxford, UK,Oxford Health NHS Foundation Trust, Warneford Hospital, Oxford, UK
| | - Orestis Efthimiou
- Department of Psychiatry, University of Oxford, Oxford, UK,Institute of Primary Health Care (BIHAM), University of Bern, Bern, Switzerland,Institute of Social and Preventive Medicine, University of Bern, Bern, Switzerland
| | - Huseyin Naci
- Department of Health Policy, London School of Economics and Political Science, London, UK
| | - Toshi A Furukawa
- Department of Health Promotion and Human Behavior, School of Public Health, Kyoto, Japan
| | - Stefan Leucht
- Department of Psychiatry and Psychotherapy, Technical University of Munich, Munchen, Germany
| | - Georgia Salanti
- Institute of Social and Preventive Medicine, University of Bern, Bern, Switzerland
| | - Laurence Wainwright
- Oxford Precision Psychiatry Lab, NIHR Oxford Health Biomedical Research Centre, Oxford, UK
| | - Caroline Zangani
- Department of Psychiatry, University of Oxford, Oxford, UK,Oxford Precision Psychiatry Lab, NIHR Oxford Health Biomedical Research Centre, Oxford, UK,Oxford Health NHS Foundation Trust, Warneford Hospital, Oxford, UK
| | - Franco De Crescenzo
- Department of Psychiatry, University of Oxford, Oxford, UK,Oxford Precision Psychiatry Lab, NIHR Oxford Health Biomedical Research Centre, Oxford, UK
| | - Katharine Smith
- Department of Psychiatry, University of Oxford, Oxford, UK,Oxford Precision Psychiatry Lab, NIHR Oxford Health Biomedical Research Centre, Oxford, UK,Oxford Health NHS Foundation Trust, Warneford Hospital, Oxford, UK
| | - Katherine Stevens
- Oxford Precision Psychiatry Lab, NIHR Oxford Health Biomedical Research Centre, Oxford, UK
| | - Qiang Liu
- Department of Psychiatry, University of Oxford, Oxford, UK,Oxford Precision Psychiatry Lab, NIHR Oxford Health Biomedical Research Centre, Oxford, UK
| | - Andrea Cipriani
- Department of Psychiatry, University of Oxford, Oxford, UK,Oxford Precision Psychiatry Lab, NIHR Oxford Health Biomedical Research Centre, Oxford, UK,Oxford Health NHS Foundation Trust, Warneford Hospital, Oxford, UK
| |
Collapse
|
5
|
Fadda V, Bartoli L, Ferracane E, Trippoli S, Messori A. Simplified figure to present direct and indirect comparisons: Revisiting the graph 10 years later. World J Methodol 2021; 11:228-230. [PMID: 34322372 PMCID: PMC8299911 DOI: 10.5662/wjm.v11.i4.228] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/19/2021] [Revised: 05/09/2021] [Accepted: 05/27/2021] [Indexed: 02/06/2023] Open
Abstract
A “simplified” figure was proposed in 2011 to summarize the results of controlled trials that evaluate different treatments aimed at the same disease condition. The original criteria for classifying individual binary comparisons included superiority, inferiority and no significance difference; hence, they did not differentiate between no proof of difference vs proof of no difference. We updated the criteria employed in the original “simplified” figure in order to include this differentiation. A revised version of the simplified figure is proposed and described herein. An example of application is also presented. The example is focused on first-line treatments for paroxysmal atrial fibrillation. Three treatments (medical therapy, cryoballoon ablation, radiofrequency ablation) are compared with one another through direct and indirect comparisons.
Collapse
|