Research Designs and Statistical Methods Trends in the Annals of Rehabilitation Medicine

Methodological Issues in Rehabilitation Research: A Scoping Review

OBJECTIVE

To identify, synthesize, and categorize the methodological issues faced by the rehabilitation field.

DATA SOURCES

A scoping review was conducted using studies identified in MEDLINE, the Cochrane Library, EMBASE, Web of Science, Scopus, Physiotherapy Evidence Database, and Google Scholar up to August 2018.

STUDY SELECTION

We included all type of publications describing methodological issues in rehabilitation research where rehabilitation is described as a multimodal process. The methodological issues have been categorized and classified.

DATA EXTRACTION

The synthesis included qualitative and quantitative analysis. To focus the attention on rehabilitation, we post hoc divided in "specific issues" (highly related to, even if not exclusive of, rehabilitation research) and "generic issues" (common in biomedical research).

DATA SYNTHESIS

Seventy-one publications were included: 68% were narrative reviews, 15% systematic reviews, 7% editorials, 4% meta-epidemiologic studies, and 5% others. Specific methodological issues include the following: problematic application of randomized controlled trials (32%), absent definition of core outcome sets (28%), poor interventions description (22%), weak methodological (conducting) and reporting quality (21%), scarce clinical practice applicability (14%), lack of blinding assessor (10%), inadequate randomization methods or inadequate allocation concealment (8%), and inadequate participants description and recruitment (8%). "Generic" issues included the following: data and statistical description (31%), authors' methodological training (7%), peer review process (6%, n=4), funding declaration (6%), ethical statement (3%), protocol registration (3%), and conflict of interest declaration (1%).

CONCLUSIONS

Methodological and reporting issues might influence the quality of the evidence produced in rehabilitation research. The next steps to move forward in the field of rehabilitation could be to evaluate the influence of all these issues on the validity of trial results through meta-epidemiologic studies and to develop specific checklists to provide guidance to authors to improve the reporting and conduct of trials in this field.

A Bibliometric Analysis Using Alternative Metrics for Articles in the Annals of Rehabilitation Medicine

OBJECTIVE

To investigate the articles in the Annals of Rehabilitation Medicine (ARM) using a bibliometric analysis to verify whether there is a correlation between the topics of interest for expert groups and the public media.

METHODS

A total of 1,088 ARM articles from the third issue of 2011 to the third issue of 2019 were analyzed. We conducted a bibliometric analysis of the articles using conventional metrics (CM) and alternative metrics (AM). The CM was investigated by collating the type of publication, number of citations, and the specific field of rehabilitation medicine for each article. The AM was analyzed using the Altmetric Attention Score (AAS) provided by Altmetric, the leading AM company. The correlation between the number of citations and the AAS was tested using the Spearman rank correlation coefficient.

RESULTS

The combined ratio of original articles and case reports was over 90% in this study; however, the total distribution was significantly different compared to previous bibliometric studies (p<0.05). There were 233 articles that satisfied both conditions of at least one citation and at least one AAS point. The number of citations and the AAS were found to have a statistically significant positive linear correlation on a scatter plot (r=0.216, p=0.001).

CONCLUSION

There is a significant correlation between AM and CM, which means itis important to increase the dissemination of academic knowledge through the public media and increase the status of the journal by increasing the citation-related index.

Trends in statistical methods in articles published in Archives of Plastic Surgery between 2012 and 2017

This review article presents an assessment of trends in statistical methods and an evaluation of their appropriateness in articles published in the Archives of Plastic Surgery (APS) from 2012 to 2017. We reviewed 388 original articles published in APS between 2012 and 2017. We categorized the articles that used statistical methods according to the type of statistical method, the number of statistical methods, and the type of statistical software used. We checked whether there were errors in the description of statistical methods and results. A total of 230 articles (59.3%) published in APS between 2012 and 2017 used one or more statistical method. Within these articles, there were 261 applications of statistical methods with continuous or ordinal outcomes, and 139 applications of statistical methods with categorical outcome. The Pearson chi-square test (17.4%) and the Mann-Whitney U test (14.4%) were the most frequently used methods. Errors in describing statistical methods and results were found in 133 of the 230 articles (57.8%). Inadequate description of P-values was the most common error (39.1%). Among the 230 articles that used statistical methods, 71.7% provided details about the statistical software programs used for the analyses. SPSS was predominantly used in the articles that presented statistical analyses. We found that the use of statistical methods in APS has increased over the last 6 years. It seems that researchers have been paying more attention to the proper use of statistics in recent years. It is expected that these positive trends will continue in APS.