Spie charts for quantifying treatment effectiveness and safety in multiple outcome network meta-analysis: a proof-of-concept study

The use of network meta-analysis in updating WHO living maternal and perinatal health recommendations

Drawing on two recent examples of WHO living guidelines in maternal and perinatal health, this paper elucidates a pragmatic, stepwise approach to using network meta-analysis (NMA) in guideline development in the presence of multiple treatment options. NMA has important advantages. These include the ability to compare multiple interventions in a single coherent analysis, provide direct estimates of the relative effects of all available interventions, infer indirect effect estimates for interventions not directly compared and generate rankings of the available treatment options. It can be difficult to harness these advantages in the face of a lack of current guidance on using NMA evidence in guideline development, with several challenges emerging. Challenges include the choice of conceptual approach, the volume and complexity of the evidence, the contribution of treatment rankings, and the fact that the preferable treatment is not always obvious. This paper describes a layered approach to resolving these challenges, which supports systematic guideline decision-making and development of trustworthy clinical guidelines when multiple treatment options are available.

Estimating and visualising the trade-off between benefits and harms on multiple clinical outcomes in network meta-analysis

BACKGROUND

The relative treatment effects estimated from network meta-analysis can be employed to rank treatments from the most preferable to the least preferable option. These treatment hierarchies are typically based on ranking metrics calculated from a single outcome. Some approaches have been proposed in the literature to account for multiple outcomes and individual preferences, such as the coverage area inside a spie chart, that, however, does not account for a trade-off between efficacy and safety outcomes. We present the net-benefit standardised area within a spie chart, [Formula: see text] to explore the changes in treatment performance with different trade-offs between benefits and harms, according to a particular set of preferences.

METHODS

We combine the standardised areas within spie charts for efficacy and safety/acceptability outcomes with a value λ specifying the trade-off between benefits and harms. We derive absolute probabilities and convert outcomes on a scale between 0 and 1 for inclusion in the spie chart.

RESULTS

We illustrate how the treatments in three published network meta-analyses perform as the trade-off λ varies. The decrease of the [Formula: see text] quantity appears more pronounced for some drugs, e.g. haloperidol. Changes in treatment performance seem more frequent when SUCRA is employed as outcome measures in the spie charts.

CONCLUSIONS

[Formula: see text] should not be interpreted as a ranking metric but it is a simple approach that could help identify which treatment is preferable when multiple outcomes are of interest and trading-off between benefits and harms is important.

Effects of non-pharmacological interventions on loneliness among community-dwelling older adults: A systematic review, network meta-analysis, and meta-regression

BACKGROUND

The highly prevalent late-life loneliness, together with its deleterious health impacts, calls for increasing attention to the need for effective interventions targeting on this growing public health problem. With the increasing evidence on interventions for combating loneliness, it is timely to identify their comparative effectiveness.

OBJECTIVE

This systematic review, meta-analysis and network meta-analysis was to identify and compare the effects of various non-pharmacological interventions on loneliness in community-dwelling older adults.

METHODS

Systematic search was conducted in nine electronic databases from inception to 30th March 2023 for studies investigating the effects of non-pharmacological interventions on loneliness among community-dwelling older adults. The interventions were categorized according to the nature and purpose of use. Pairwise meta-analysis and network meta-analyses were sequentially performed to identify the effects of each category of interventions and their comparative intervention effectiveness, respectively. Meta-regression was performed to examine any influence of study design and participants' characteristics on the intervention effectiveness. The study protocol was registered at PROSPERO (CRD42022307621).

RESULTS

A total of 60 studies with 13,295 participants were included. The interventions were categorized as psychological interventions, social support interventions (by digital and non-digital means), behavioral activation, exercise intervention with and without social engagement, multi-component intervention and health promotion. Pairwise meta-analysis identified the positive effect of psychological interventions (Hedges' g = -2.33; 95%CI [-4.40, -0.25]; Z = -2.20, p = 0.003), non-digital social support interventions (Hedges' g = -0.63; 95%CI [-1.16, -0.10]; Z = 2.33, p = 0.02) and multi-component interventions (Hedges' g = -0.28 95%CI [-0.54, -0.03]; Z = -2.15, p = 0.03) on reducing loneliness. Subgroup analysis provided additional insights: i) social support and exercise interventions which integrated active strategies to optimize the social engagement demonstrated more promising intervention effects; ii) behavioral activation and multicomponent interventions worked better for older adults who were male or reported loneliness, respectively, and iii) counseling-based psychological interventions was more effective than mind-body practice. Network meta-analysis consistently pointed to the greatest therapeutic benefits of psychological interventions, and this was followed by exercise-based interventions, non-digital social support interventions and behavioral activation. Meta-regression further suggested that the therapeutic effects of the tested interventions were independent of the various factors relating to study design and participants' characteristics.

CONCLUSIONS

This review highlights the more superior effects of psychological interventions in improving loneliness among older adults. Interventions which have an attribute to optimize social dynamic and connectivity may also be effective.

TWEETABLE ABSTRACT

Psychological intervention is the best to beat late-life loneliness, but increasing social dynamic and connectivity may add an impact.

Origami plot: a novel multivariate data visualization tool that improves radar chart

OBJECTIVES

We propose the origami plot, which maintains the original functionality of a radar chart and avoids potential misuse of its connected regions, with newly added features to better assist multicriteria decision-making.

STUDY DESIGN AND SETTING

Built upon a radar chart, the origami plot adds additional auxiliary axes and points such that the area of the connected region of all dots is invariant to the ordering of axes. As such, it enables ranking different individuals by the overall performance for multicriteria decision-making while maintaining the intuitive visual appeal of the radar chart. We develop extensions of the origami plot, including the weighted origami plot, which allows reweighting of each attribute to define the overall performance, and the pairwise origami plot, which highlights comparisons between two individuals.

RESULTS

We illustrate the different versions of origami plots using the hospital compare database developed by the Centers for Medicare & Medicaid Services (CMS). The plot shows individual hospital's performance on mortality, readmission, complication, and infection, as well as patient experience and timely and effective care, as well as their overall performance across these metrics. The weighted origami plot allows weighing the attributes differently when some are more important than others. We illustrate the potential use of the pairwise origami plot in electronic health records (EHR) system to monitor five clinical measures (body mass index [BMI]), fasting glucose level, blood pressure, triglycerides, and low-density lipoprotein ([LDL] cholesterol) of a patient across multiple hospital visits.

CONCLUSION

The origami plot is a useful visualization tool to assist multicriteria decision making. It improves radar charts by avoiding potential misuse of the connected regions. It has several new features and allows flexible customization.

Vitruvian plot: a visualisation tool for multiple outcomes in network meta-analysis

OBJECTIVE

A network meta-analysis (NMA) usually assesses multiple outcomes across several treatment comparisons. The Vitruvian plot aims to facilitate communication of multiple outcomes from NMAs to patients and clinicians.

METHODS

We developed this tool following the recommendations on the communication of benefit-risk information from the available literature. We collected and implemented feedback from researchers, statisticians, methodologists, clinicians and people with lived experience of physical and mental health issues.

RESULTS

We present the Vitruvian plot, which graphically presents absolute estimates and relative performance of competing interventions against a common comparator for several outcomes of interest. We use two alternative colour schemes to highlight either the strength of statistical evidence or the confidence in the evidence. Confidence in the evidence is evaluated across six domains (within-study bias, reporting bias, indirectness, imprecision, heterogeneity and incoherence) using the Confidence in Network Meta-Analysis (CINeMA) system.

CONCLUSIONS

The Vitruvian plot allows reporting of multiple outcomes from NMAs, with colourings appropriate to inform credibility of the presented evidence.

Development and design validation of a novel network meta-analysis presentation tool for multiple outcomes: a qualitative descriptive study

OBJECTIVE

The Grades of Recommendations, Assessment, Development and Evaluation working group recently developed an innovative approach to interpreting results from network meta-analyses (NMA) through minimally and partially contextualised methods; however, the optimal method for presenting results for multiple outcomes using this approach remains uncertain. We; therefore, developed and iteratively modified a presentation method that effectively summarises NMA results of multiple outcomes for clinicians using this new interpretation approach.

DESIGN

Qualitative descriptive study.

SETTING

A steering group of seven individuals with experience in NMA and design validation studies developed two colour-coded presentation formats for evaluation. Through an iterative process, we assessed the validity of both formats to maximise their clarity and ease of interpretation.

PARTICIPANTS

26 participants including 20 clinicians who routinely provide patient care, 3 research staff/research methodologists and 3 residents.

MAIN OUTCOME MEASURES

Two team members used qualitative content analysis to independently analyse transcripts of all interviews. The steering group reviewed the analyses and responded with serial modifications of the presentation format.

RESULTS

To ensure that readers could easily discern the benefits and safety of each included treatment across all assessed outcomes, participants primarily focused on simple information presentations, with intuitive organisational decisions and colour coding. Feedback ultimately resulted in two presentation versions, each preferred by a substantial group of participants, and development of a legend to facilitate interpretation.

CONCLUSION

Iterative design validation facilitated the development of two novel formats for presenting minimally or partially contextualised NMA results for multiple outcomes. These presentation approaches appeal to audiences that include clinicians with limited familiarity with NMAs.