Defending psychiatry or defending the trivial effects of therapeutic interventions? A citation content analysis of an influential paper

Systematic review and citation content analysis of the CHIME framework for mental health recovery processes: recommendations for developing influential conceptual frameworks

OBJECTIVES

To identify design features of the CHIME conceptual framework of mental health recovery which are associated with high rates of citation.

RESEARCH DESIGN AND METHODS

Systematic review of all citations of the Connectedness, Hope, Identity, Meaning, and Empowerment (CHIME) framework of mental health recovery. Papers citing CHIME were screened and extracted from three citation databases. Citation content analysis was used to investigate associations between nine CHIME design features. Citations were investigated across six forms of visibility: all citations; Anglophone vs non-Anglophone; academic vs non-academic; academic discipline; professional group; and clinical population.

RESULTS

There were 915 eligible documents identified. Six CHIME framework design features met predefined thresholds for high levels of influence: (i) using a systematic review methodology for development, (ii) adopting a memorable acronym, (iii) having disaggregable components, and being unaligned to a (iv) particular discipline (i.e., transdisciplinary), (v) professional group, or (vi) diagnostic population. Documents from Anglophone countries were more likely to cite CHIME with reference to trans-professional (χ2=3.96, df=1, p=0.05) and ethnicity sub-group analysis (p=0.039) design features than non-Anglophone documents. Non-academic documents were more likely to cite the acronym design feature than academic papers (χ2=5.73, df=1, p=0.01). Public Health-related publications were more likely to cite CHIME within a trans-diagnostic framework (χ2=16.39, df=1, p<0.001) than other disciplines.

CONCLUSIONS

The influence and impact of conceptual frameworks for recovery are increased when the framework is underpinned by a systematic review, includes disaggregable components which can be summarized using a memorable acronym, and when the framework is transdisciplinary, trans-professional, and trans-diagnostic.

Diversity in citations to a single study: A citation context network analysis of how evidence from a prospective cohort study was cited

Between its origin in the 1950s and its endorsement by a consensus conference in 1984, the diet–heart hypothesis was the subject of intense controversy. Paul et al. (1963) is a highly cited prospective cohort study that reported findings inconvenient for this hypothesis, reporting no association between diet and heart disease; however, many other findings were also reported. By citation context and network analysis of 343 citing papers, I show how Paul et al. was cited in the 20 years after its publication. Generally, different findings were cited by different communities focusing on different risk factors; these communities were established by either research foci title terms or via cluster membership as established via modularity maximization. The most frequently cited findings were the significant associations between heart disease and serum cholesterol (n = 85), blood pressure (n = 57), and coffee consumption (n = 54). The lack of association between diet and heart disease was cited in just 41 papers. Yet, no single empirical finding was referred to in more than 25% of the citing papers. This raises questions about the value of inferring impact from citation counts alone and raises problems for studies using such counts to measure citation bias.

Citation Context Analysis as a Method for Conducting Rigorous and Impactful Literature Reviews

Citation context analysis is a detailed and rigorous form of literature review that goes beyond traditional narrative and systematic reviews to better understand the impact of seminal works and influential authors. We discuss the types of questions citation context analyses can answer and provide a set of guidelines for how to effectively conduct them. Citation context analysis holds promise for enabling a more systematic assessment of how theories are used, empirically tested, and critiqued by subsequent citing authors. This has implications for both theory development and testing, and for the improvement of citation practices within the field of organizational studies and the social and physical sciences more broadly.