Validity and reliability of the heart failure-specific health literacy scale in Turkish

Inadequate health literacy is common among adults with HF. The disease management process in HF closely depends on health literacy. No questionnaire is used to assess health literacy among Turkish patients with heart failure. This study aimed to determine the validity and reliability of the Turkish form of the 'Heart Failure-Specific Health Literacy Scale'. The research is a methodological study design. The study was conducted at the cardiology clinic between May and July 2021, located in the eastern part of Türkiye. The study sample consisted of 121 patients with HF. Data were collected using the Personal Information Form and the Heart Failure-Specific Health Literacy Scale. The patients' mean age was 62.88 ± 12.55 and 66.9% were men. Based on the factor analysis, three factors with eigenvalue above 1 have been identified. These model has been determined as x2 = 80.209, sd = 49 and p = 0.003. The fit indices were as follows: x2/SD = 1.637; RMSEA = 0.073, GFI = 0.90, CFI = 0.94, IFI = 0.95, TLI = 0.92 and NFI = 0.87. The scale has a total Cronbach's alpha of 0.66. With test-retest analysis, it was determined that it had a good, positive and significant correlation in terms of both the scale and its sub-dimensions. The Turkish form of the form is a valid and reliable tool.

Clinical and methodological implications for research elements in systematic reviews on COVID-19 treatment were often unstructured and under-reported: a metaresearch study

OBJECTIVES

Numerous systematic reviews (SRs) have been published in the first months of the COVID-19 pandemic and clinical trials were designed rapidly highlighting the importance of informative implications for research (IfRs) sections in SRs. IfR is one item of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses 2020 checklist and the Cochrane Handbook suggests considering population, intervention, control, outcome (PICO) and Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) domains when developing IfR. We aimed (1) to assess whether SRs on COVID-19 treatments included any IfR statements and, for SRs with an IfR statement, (2) to examine which elements informed the IfR statement.

STUDY DESIGN AND SETTING

We conducted a metaresearch study based on SRs on COVID-19 treatment identified in the Living OVerview of the Evidence COVID-19 database in May 2021 as part of another research project (CRD42021240423). We defined an IfR statement as at least one sentence that contained at least one bit of information that could be informative for planning future research. We extracted any IfR statements anywhere in the SRs on predefined IfR variables, in particular PICO elements, study design, and concepts underlying GRADE domains. Three authors extracted data independently after piloting the data extraction form. We resolved discrepancies in weekly discussions to ensure a high-quality data extraction.

RESULTS

We included 326 SRs, of which 284 SRs (87.1%) stated IfR. Of these 284 SRs, 201 (70.8%) reported using Preferred Reporting Items for Systematic Reviews and Meta-Analyses and 66 (23.2%) using GRADE. IfR statements (n = 284) addressing PICO were unstructured and commonly reported 'population' (n = 195, 68.7%), 'intervention' (n = 242, 85.2%), and 'outcome' (n = 127, 44.7%) but not 'control' (n = 29, 10.2%). Concepts underlying GRADE domains were infrequently reported in IfR statements of SRs (n = 284): 'risk of bias' (n = 14, 4.9%), 'imprecision' (n = 8, 2.8%), 'inconsistency' (n = 7, 2.5%), 'publication bias' (n = 3, 1.1%), and 'indirectness' (n = 1, 0.4%). Additional IfR elements mentioned in IfR were 'better reporting' of future studies (n = 17, 6.0%) and 'standardization of procedures in clinical trials' (n = 12, 4.2%).

CONCLUSION

Almost 90% of SRs on COVID-19 treatments reported IfR. IfR statements addressing PICO were unstructured across SRs and concepts underlying GRADE were rarely reported to inform IfR. Further work is needed to assess generalizability beyond COVID-19 and to define more precisely which IfR elements should be considered, and how they should be reported in SRs of interventions. Until then, considering PICO elements and concepts underlying GRADE to derive IfR seems to be a sensible starting point.

The Social Insurance Literacy Questionnaire (SILQ): Development and Psychometric Evaluation

PURPOSE

For clients to understand social insurance decisions and processes, information from authorities needs to be comprehensible, and clients need sufficient individual abilities. These dimensions are captured by the concept social insurance literacy, which has been operationalized into a measure, the Social Insurance Literacy Questionnaire (SILQ). The aim of this study was to describe the development of the SILQ and evaluate its psychometric properties using Rasch measurement theory.

METHODS

The development of the SILQ included a Delphi study and cognitive interviews. A preliminary version, divided on four scales corresponding to the domains of the concept (obtaining information, understanding information, acting on information, and system comprehensibility) was psychometrically evaluated according to Rasch measurement theory, in a survey to a stratified random sample of people on sick leave (n = 1151) sent out in the fall of 2020.

RESULTS

Overall, the items in the final version of the SILQ demonstrated good fit to the Rasch model, and the response scale worked as intended. Unidimensionality was supported for all scales, but minor problems with local dependency was detected for three items. The person separation was 0.80 for the Obtain scale, 0.82 for the Understand scale, 0.68 for the Act scale, and 0.81 for the System scale. Corresponding ordinal alpha values were 0.91, 0.91, 0.86, and 0.91, respectively.

CONCLUSION

This study is a first step toward exploring literacy in the social insurance field. The SILQ covers individual abilities and systems' comprehensibility, and the results show that it has acceptable psychometric properties.

Methodological quality of systematic reviews in dentistry including animal studies: a cross-sectional study

BACKGROUND

The overall confidence in the results of systematic reviews including animal models can be heterogeneous. We assessed the methodological quality of systematic reviews including animal models in dentistry as well as the overall confidence in the results of those systematic reviews.

MATERIAL & METHODS

PubMed, Web of Science and Scopus were searched for systematic reviews including animal studies in dentistry published later than January 2010 until 18th of July 2022. Overall confidence in the results was assessed using a modified version of the A MeaSurement Tool to Assess systematic Reviews (AMSTAR-2) checklist. Checklist items were rated as yes, partial yes, no and not applicable. Linear regression analysis was used to investigate associations between systematic review characteristics and the overall adherence to the AMSTAR-2 checklist. The overall confidence in the results was calculated based on the number of critical and non-critical weaknesses presented in the AMSTAR-2 items and rated as high, moderate, low and critical low.

RESULTS

Of initially 951 retrieved systematic reviews, 190 were included in the study. The overall confidence in the results was low in 43 (22.6%) and critically low in 133 (70.0%) systematic reviews. While some AMSTAR-2 items were regularly reported (e.g. conflict of interest, selection in duplicate), others were not (e.g.

FUNDING

n = 1; 0.5%). Multivariable linear regression analysis showed that the adherence scores of AMSTAR-2 was significantly associated with publication year, journal impact factor (IF), topic, and the use of tools to assess risk of bias (RoB) of the systematic reviews.

CONCLUSION

Although the methodological quality of dental systematic reviews of animal models improved over the years, it is still suboptimal. The overall confidence in the results was mostly low or critically low. Systematic reviews, which were published later, published in a journal with a higher IF, focused on non-surgery topics, and used at least one tool to assess RoB correlated with greater adherence to the AMSTAR-2 guidelines.

A structured approach to information retrieval improved identification of funding and researchers' conflicts of interest in trials included in Cochrane reviews

OBJECTIVES

To compare the contemporary Cochrane review approach for retrieving information on trial funding and researchers' conflicts of interest with a structured approach for information retrieval.

STUDY DESIGN AND SETTING

Methodological study of 100 Cochrane reviews from August to December 2020 and one randomly selected trial from each review. Reporting of trial funding and researchers' conflicts of interest in reviews was compared with information identified using a structured retrieval process, and time to retrieve information was noted. We also formulated a guide to systematic reviewers for efficient information retrieval.

RESULTS

Sixty-eight of 100 Cochrane reviews reported trial funding and 24 reported trial researchers' conflicts of interest. A simple structured approach, searching only trial publications (including conflicts of interest disclosure forms), identified funding for 16 additional trials and conflicts of interest information for 39 additional trials. A comprehensive structured approach, searching multiple information sources, identified funding for two additional trials and conflicts of interest for 14 additional trials. The median time to retrieve information was 10 minutes per trial (interquartile range: 7-15) for the simple approach and 20 minutes (11-43) for the comprehensive approach.

CONCLUSION

A structured information retrieval approach improves identification of funding and researchers' conflicts of interest in trials included in Cochrane reviews.

A methodological framework allows the identification of personomic markers to consider when designing personalized interventions

OBJECTIVES

To develop a methodological framework to identify and prioritize personomic markers (e.g., psychosocial situation, beliefs…) to consider for personalizing interventions and to test in smoking cessation interventions.

STUDY DESIGN AND SETTING

(1) We identified potential personomic markers considered in protocols of personalized interventions, in reviews of predictors of smoking cessation, and in interviews with general practitioners. (2) Physicians, and patient smokers or former smokers selected the markers they considered most relevant during online paired comparison experiments. Data were analyzed with Bradley Terry Luce models.

RESULTS

Thirty-six personomic markers were identified from research evidence. They were evaluated by 795 physicians (median age: 34, IQR [30-38]; 95% general practitioners) and 793 patients (median age: 54, IQR [42-64], 71.4% former smokers) during 11,963 paired comparisons. Physicians identified patients' motivation for quitting (e.g., Prochaska stages), patients' preferences, and patients' fears and beliefs (e.g., concerns about weight gain) as the most relevant elements to personalize smoking cessation. Patients considered their motivation for quitting, smoking behavior (e.g., smoking at home/at work), and tobacco dependence (e.g., Fagerström Test) as the most relevant elements to consider.

CONCLUSION

We provide a methodological framework to prioritize which personomic markers should be considered when developing smoking cessation interventions.

Current status of the reporting quality of abstracts in systematic reviews related to implant dentistry: a literature survey

The aim of this study was to assess the reporting quality of abstracts in systematic reviews (SRs) related to implant dentistry and to assess the possible factors associated with the reporting quality. Abstracts of SRs in the field of implant dentistry, published in the last 5 years, were searched. The reporting quality was assessed and scored using the PRISMA for Abstracts checklist (PRISMA-A). The overall PRISMA-A score (OPS) and relative score (OPS%) per review were calculated according to adherence to the criteria presented in the checklist. Multivariable linear regression was performed to identify possible factors associated with reporting quality. Overall, 310 SRs were eligible for this study. Based on the maximum PRISMA-A score (score of 12), the mean OPS was 6.5 and OPS% was 54.2%. The items 'title', 'objectives', and 'number of included studies' were those most frequently reported in the abstracts, while the items 'registration' and 'funding' were the least reported. According to multivariable linear regression, the geographical origin of the articles was the only factor associated with better quality of abstract reporting, with higher OPS for SRs from Europe when compared to North America (coefficient 0.73; P = 0.049). The reporting quality of abstracts in SRs related to implant dentistry is suboptimal and needs to be improved. Journals should encourage adherence to reporting checklists in SRs.

Reporting of flow diagrams in randomised controlled trials published in periodontology and implantology: a survey

BACKGROUND

Item 13 of the CONSORT guidelines recommends documentation of the participant flow in randomised clinical trials (RCTs) using a diagram. In the medical literature, the reporting of the flow of participants in RCTs has been assessed to be inadequate. The quality of reporting flow diagrams in periodontology and implantology remains unknown. The aim of this study was to assess the reporting of flow diagrams in RCTs published in periodontology and implantology journals.

MATERIALS AND METHODS

RCTs published between 15^th January 2018 and 15^th January 2022 in twelve high-ranked periodontology and implantology journals were identified. Trial characteristics at the RCT level were extracted. The flow diagram included in each RCT was assessed for completeness of reporting in relation to published criteria and the CONSORT flow diagram template.

RESULTS

From the 544 eligible articles, 85% were single-centre, 82% of parallel-group design and 79% investigated surgical interventions. Three-hundred and fifteen (58%) articles were published in CONSORT endorsing journals. A flow diagram was reported in 317 (58%) trials and reporting was more common in periodontology (73.1%). Overall, 56% of publications with a flow diagram reported a complete CONSORT flow diagram, while in 44% of flow diagrams, at least one point from the CONSORT reporting template was missing. Reasons for loss to follow-up (69.7%) and exclusions from the RCT analysis (86.4%) were poorly reported.

CONCLUSION

The reporting of flow diagrams in periodontology and implantology RCTs was sub-optimal. Greater awareness of the importance of fully completing the participant CONSORT flow diagram is required.

[Using the TRAPD method to translate the revised MISSCARE Survey from English into German: Revised MISSCARE-Austria]

Using the TRAPD method to translate the revised MISSCARE Survey from English into German: Revised MISSCARE-Austria Abstract. Background: Questionnaire translations in German-speaking nursing science rely on methods using first- and back-translation techniques despite increasing criticism. In contrast, the TRAPD method is recognized as best practice in intercultural social research. However, experience with the application of this method in German-speaking nursing science is lacking. Aim: To describe the utilization of the TRAPD method using the example of the translation of the revised MISSCARE Survey from English into German and to discuss necessary adaptations, advantages, and limitations of this approach. Methods: An adapted version of the team-based translation method TRAPD was implemented through the steps: preparation, translation, review, adjudication, pretest, and documentation, based on the GESIS guidelines for intercultural questionnaire translation. Results: The new revised MISSCARE Austria instrument consists of 85 items. For the majority of the items, equivalent terms or phrases were found that allowed for a straightforward translation. For some items an adaptation was necessary due to cultural, measurement- and construct-related aspects. Translation equivalence regarding challenging items was examined with the first author and promoted by multiple cognitive pretesting with nurses. Conclusions: Our study strengthens the argument that the TRAPD method is appropriate for translating measurement instruments in German-speaking nursing science. However, this example shows that further experience with this method is necessary for its further development for our discipline.

A methodological study of 2D shear wave elastography for noninvasive quantitative assessment of renal fibrosis in patients with chronic kidney disease

PURPOSE

To determine the optimal measurement method of 2D shear wave elastography (2D-SWE) for noninvasive quantitative assessment of renal fibrosis in chronic kidney disease (CKD) patients.

METHODS

A total of 190 CKD patients were enrolled for 2D-SWE of right kidney. The success rates, coefficients of variation (CV), and pathological correlation of different measurement sites, body positions, and depths were compared.

RESULTS

(1) Measurement sites: Success rate in the middle part (100%) was higher than that in the lower pole (97.3%, P > 0.05). CV in the middle part (10.2%) was lower than that in the lower pole (16.4%, P < 0.05). Pathological correlation of the middle part (r =  - 0.452, P < 0.05) was higher than that of the lower pole (r = 0.097, P > 0.05). (2) Body positions: Success rate in left lateral decubitus position (100%) was higher than that in supine (99.4%, P > 0.05) and prone position (99.4%, P > 0.05). CV was lowest (11.9%) and pathological correlation was highest (r = -0.256, P < 0.05) in prone position. (3) Measurement depths: Success rate at depth < 4 cm (100%) was higher than that at depth ≥ 4 cm (98.8%, P > 0.05). CV at depth < 4 cm (11.1%) was lower than that at depth ≥ 4 cm (14.4%, P < 0.05). Pathological correlation at depth < 4 cm (r =  - 0.303, P < 0.05) was higher than that at depth ≥ 4 cm (r =  - 0.156, P > 0.05).

CONCLUSION

The optimal measurement method of 2D-SWE for renal fibrosis assessment was prone position, renal middle part, and measurement depth < 4 cm.

Examining methodology to identify patterns of consulting in primary care for different groups of patients before a diagnosis of cancer: An exemplar applied to oesophagogastric cancer

BACKGROUND

Current methods for estimating the timeliness of cancer diagnosis are not robust because dates of key defining milestones, for example first presentation, are uncertain. This is exacerbated when patients have other conditions (multimorbidity), particularly those that share symptoms with cancer. Methods independent of this uncertainty are needed for accurate estimates of the timeliness of cancer diagnosis, and to understand how multimorbidity impacts the diagnostic process.

METHODS

Participants were diagnosed with oesophagogastric cancer between 2010 and 2019. Controls were matched on year of birth, sex, general practice and multimorbidity burden calculated using the Cambridge Multimorbidity Score. Primary care data (Clinical Practice Research Datalink) was used to explore population-level consultation rates for up to two years before diagnosis across different multimorbidity burdens. Five approaches were compared on the timing of the consultation frequency increase, the inflection point for different multimorbidity burdens, different aggregated time-periods and sample sizes.

RESULTS

We included 15,410 participants, of which 13,328 (86.5 %) had a measurable multimorbidity burden. Our new maximum likelihood estimation method found evidence that the inflection point in consultation frequency varied with multimorbidity burden, from 154 days (95 %CI 131.8-176.2) before diagnosis for patients with no multimorbidity, to 126 days (108.5-143.5) for patients with the greatest multimorbidity burden. Inflection points identified using alternative methods were closer to diagnosis for up to three burden groups. Sample size reduction and changing the aggregation period resulted in inflection points closer to diagnosis, with the smallest change for the maximum likelihood method.

DISCUSSION

Existing methods to identify changes in consultation rates can introduce substantial bias which depends on sample size and aggregation period. The direct maximum likelihood method was less prone to this bias than other methods and offers a robust, population-level alternative for estimating the timeliness of cancer diagnosis.

Psychometric testing of the Determinants of Salt-Restriction Behaviour Questionnaire in people of Chinese ancestry: a methodological study

PURPOSE

Nurses play a key role in educating people about a salt-reduced diet to prevent or manage hypertension or cardiac failure. Assessment tools such as the Chinese Determinants of Salt-Restriction Behaviour Questionnaire (DSRBQ) can provide essential evidence to inform education strategies. This study aimed to translate the DSRBQ into English and evaluate the psychometric properties of the Chinese and English versions for people of Chinese ethnicity in Australia.

METHODS

A two-phase cross-sectional descriptive study was conducted. Phase 1: The questionnaire was translated into English using the back-translation method. The translation equivalence and content relevance were evaluated by an expert panel. Three items were revised and eight items were removed. Phase 2: Internal consistency and stability of the questionnaires were evaluated by a group of Chinese Australians.

RESULTS

Both the English and Chinese versions had satisfactory psychometric properties. In phase 2, 146 participants completed the questionnaire (test), and 49 participants completed the retest. The Cronbach's alpha scores were 0.638 and 0.584 respectively, and the overall intra-class correlation coefficients were 0.820 and 0.688 respectively for the English and Chinese versions. The Item-Content Validity Index (CVI) ranged from 0.50 to 1.00. The Scale-CVI was 0.94.

CONCLUSION

The DSRBQ has been translated into English. Both English and Chinese versions have acceptable validity and reliability. The tools can be used in people from a Chinese cultural background living in Australia. Further validation testing may allow the tools to be adapted for use with other Chinese diaspora groups. The validated DSRBQ will support the development of evidence-based salt reduction nursing assessment tool and interventions for Chinese diasporas who reside in a country where Chinese cultural practices are employed by a minority.

Methodological assessment of systematic reviews of in-vitro dental studies

BACKGROUND

Systematic reviews of in-vitro studies, like any other study, can be of heterogeneous quality. The present study aimed to evaluate the methodological quality of systematic reviews of in-vitro dental studies.

METHODS

We searched for systematic reviews of in-vitro dental studies in PubMed, Web of Science, and Scopus databases published up to January 2022. We assessed the methodological quality of the systematic reviews using a modified "A MeaSurement Tool to Assess systematic Reviews" (AMSTAR-2) instrument. The 16 items, in the form of questions, were answered with yes, no, or py (partial yes). Univariable and multivariable linear regression models were used to examine the association between systematic review characteristics and AMSTAR-2 percent score. Overall confidence in the results of the systematic reviews was rated, based on weaknesses identified in critical and non-critical AMSTAR-2 items.

RESULTS

The search retrieved 908 potential documents, and after following the eligibility criteria, 185 systematic reviews were included. The most researched topics were ceramics and dental bonding. The overall rating for the confidence in the results was critically low in 126 (68%) systematic reviews. There was high variability in the response among the AMSTAR-2 items (0% to 75% positively answered). The univariable analyses indicated dental specialty (p = 0.03), number of authors (coef: 1.87, 95% CI: 0.26, 3.47, p = 0.02), and year of publication (coef: 2.64, 95% CI: 1.90, 3.38, p < 0.01) were significantly associated with the AMSTAR-2 percent score. Whereas, in the multivariable analysis only specialty (p = 0.01) and year of publication (coef: 2.60, 95% CI: 1.84, 3.35, p < 0.001) remained significant. Among specialties, endodontics achieved the highest AMSTAR-2 percent score.

CONCLUSIONS

The methods of systematic reviews of in vitro dental studies were suboptimal. Year of publication and dental specialty were associated with AMSTAR-2 scores. The overall rating of the confidence in the results was low and critically low for most systematic reviews.

Tools to Assess the Risk of Bias and Reporting Quality of Randomized Controlled Trials in Rehabilitation

OBJECTIVES

(1) To determine whether new tools and items have been developed to evaluate the risk of bias (RoB) and reporting of randomized controlled trials (RCTs) in rehabilitation; (2) to determine which items are included in the existing reporting guidelines, and to create a matrix of items to report and conduct trials in rehabilitation as the first step for a starting a rigorous validation process.

DATA SOURCES

Searches were conducted in MEDLINE, EMBASE, and Cumulative Index to Nursing and Allied Health databases.

STUDY SELECTION

Studies should describe a newly developed tool to evaluate the RoB or quality of reporting for RCTs in the area of rehabilitation.

DATA EXTRACTION

(1) First, we extracted items from new tools identified by the electronic search strategies and then (2) we looked at the items provided by the Consolidated Standards of Reporting Trials statement and its relevant extensions. We determined whether these items were already included in our matrix of items. Items were classified based on methodological domains they accomplish, biases they were able to target, and whether they guide reporting or conduct.

DATA SYNTHESIS

Among the 1596 citations found, 23 articles were potentially relevant. From these, only 3 new scales (National Institute for Complementary Medicine Acupuncture Network, Quality of reports on spa and balneotherapy [SPAC], Assessment of Study Quality and Reporting in Exercise) were found. In addition, the newly updated Cochrane RoB tool (RoB 2.0) was included. Our matrix contained 122 unique items for any rehabilitation area, 46 items (37.7%) were related to conduct, and 58 (47.5%) were related to the reporting; 18 (14.8%) were related to both. Overall, 76 new items were added among all domains.

CONCLUSIONS

Many individual and diverse items have been used to guide the reporting and conduct of rehabilitation trials. This indicates a great variability in number of items and an apparent lack of consensus on a core set of items to be used in rehabilitation. Future research should look into developing a core set of items for the rehabilitation field.

A classification of methods used to personalize participative interventions revealed inadequate reporting in trial protocols

OBJECTIVES

The objective of the study was to develop a classification of methods used to personalize participative interventions in randomized controlled trials (RCTs).

STUDY DESIGN AND SETTING

We conducted a systematic review including protocols of RCTs assessing participative interventions in PubMed and ClinicalTrials.gov between June 2018 and May 2019. Data extraction was performed by two independent reviewers. We developed a precise classification of methods used to personalize interventions. Then, protocols were reviewed to determine whether personalization was sufficiently described to enable replication.

RESULTS

We included 109 protocols. The classification used four components and 13 subcomponents accounting for decision points (when interventions were personalized), tailoring variables (on what interventions were personalized), decision rules (how and by whom interventions were personalized), and nature of the subsequent tailoring (what was personalized in the interventions). In 95% of protocols, at least one component or subcomponent of our classification was not adequately reported to enable the replication of the intervention. Components the least well described were tailoring variables (72% of protocols insufficiently described) and the nature of the subsequent tailoring (46% of protocols).

CONCLUSION

This study provides the first detailed classification of methods used to personalize interventions. This is required to transparently implement personalization and improve reporting in RCTs.

Qualitative research methods in medical dissertations: an observational methodological study on prevalence and reporting quality of dissertation abstracts in a German university

Background

Qualitative methods offer a unique contribution to health research. Academic dissertations in the medical field provide an opportunity to explore research practice. Our aim was to assess the use of qualitative methods in dissertations in the medical field.

Methods

By means of a methodological observational study, an analysis of all academic medical dissertations’ abstracts between 1998 and 2018 in a repository databank of a large medical university faculty in Germany was performed. This included MD dissertations (Dr. med. (dent.)) and medical science dissertations (Dr. sc. hum.). All abstracts including “qualitativ*” were screened for studies using qualitative research methods. Data were extracted from abstracts using a category grid considering a) general characteristics (year, language, degree type), b) discipline, c) study design (mixed methods/qualitative only, data conduction, data analysis), d) sample (size and participants) and e) technologies used (data analysis software and recording technology). Thereby reporting quality was assessed.

Results

In total, 103 abstracts of medical dissertations between 1998 and 2018 (1.4% of N = 7619) were included, 60 of MD dissertations and 43 of medical sciences dissertations. Half of the abstracts (n = 51) referred to dissertations submitted since 2014. Most abstracts related to public health/hygiene (n = 27) and general practice (n = 26), followed by medical psychology (n = 19). About half of the studies (n = 47) used qualitative research methods exclusively, the other half (n = 56) used mixed methods. For data collection, primarily individual interviews were used (n = 80), followed by group interviews (n = 33) and direct observation (n = 11). Patients (n = 36), physicians (n = 36) and healthcare professionals (n = 17) were the most frequent research participants. Incomplete reporting of participants and data analysis was common (n = 67). Nearly half of the abstracts (n = 46) lacked information on how data was analysed, most of the remaining (n = 43) used some form of content analysis. In summary, 36 abstracts provided all crucial data (participants, sample size,; data collection and analysis method).

Conclusion

A small number of academic dissertations used qualitative research methods. About a third of these reported all key aspects of the methods used in the abstracts. Further research on the quality of choice and reporting of methods for qualitative research in dissertations is recommended.

A tutorial on methodological studies: the what, when, how and why

BACKGROUND

Methodological studies - studies that evaluate the design, analysis or reporting of other research-related reports - play an important role in health research. They help to highlight issues in the conduct of research with the aim of improving health research methodology, and ultimately reducing research waste.

MAIN BODY

We provide an overview of some of the key aspects of methodological studies such as what they are, and when, how and why they are done. We adopt a "frequently asked questions" format to facilitate reading this paper and provide multiple examples to help guide researchers interested in conducting methodological studies. Some of the topics addressed include: is it necessary to publish a study protocol? How to select relevant research reports and databases for a methodological study? What approaches to data extraction and statistical analysis should be considered when conducting a methodological study? What are potential threats to validity and is there a way to appraise the quality of methodological studies?

CONCLUSION

Appropriate reflection and application of basic principles of epidemiology and biostatistics are required in the design and analysis of methodological studies. This paper provides an introduction for further discussion about the conduct of methodological studies.

Development of a food frequency questionnaire for dietary intake of preschool children

BACKGROUNDS/OBJECTIVES

To describe the data-based development of a food frequency questionnaire (FFQ) for dietary evaluation of Korean preschool children.

SUBJECTS/METHODS

Development of the FFQ was based on the data from 2,766 preschool children aged 1–5 years, who had completed 24-hour dietary recalls in the 2009–2013 Korea National Health and Nutrition Examination Survey. We selected the food list based on the results of nutritional contribution and between-person variability for energy and 13 nutrients. We selected 88 foods with over 80% of total contribution to each nutrient and with over 80% of accumulated r² for each nutrient. A dish containing any of the 88 foods in the recipe was listed, and a total of 903 dishes were extracted. Among the 903 dishes, we selected 438 dishes contributing more than 1% of total consumption.

RESULTS

FFQ included 116 dish items combined from 438 dishes based on nutrient profile and recipe. Quantities of dietary intake were assessed by nine categories of frequency and portion size option. In addition, when comparing the food portions of children with the reference portion size, subjects would be asked to select one of three response categories (less, similar, and more) and then to record the amount as a percentage for the reference portion. Percentages of coverage for energy, protein, fat, and carbohydrate were 89.2%, 88.4%, 88.2%, and 89.4%, respectively.

CONCLUSIONS

The dietary intake of Korean preschool children can be assessed by this new data-based FFQ. In addition, the new instrument can be used to identify nutritional needs of target groups for planning nutrition education and strategies to improve diet. Further studies are warranted to evaluate the performance of the instrument.

Investigating the plausibility of a PMF source apportionment solution derived using a small dataset: A case study from a receptor in a rural site in Apulia - South East Italy

Results of a methodological study on the use of Positive Matrix Factorization (PMF) with smaller datasets are being reported in this work. This study is based on 29 PM₁₀ and 33 PM_2.5 samples from a receptor in a rural setup in Apulia (Southern Italy). Running PMF on the two size fractions separately resulted in the model not functioning correctly. We therefore, augmented the size of the dataset by aggregating the PM₁₀ and PM_2.5 data. The 5-factor solution obtained for the aggregated data was fairly rotationally stable, and was further refined by the rotational tools included in USEPA PMF version 5. These refinements include the imposition of constraints on the solution, based on our knowledge of the chemical composition of the aerosol sources affecting the receptor. Additionally, the uncertainties associated with this solution were fully characterised using the improved error estimation techniques in this version of PMF. Five factors in all, were isolated by PMF: ammonium sulfate, marine aerosol, mixed carbonaceous aerosol, crustal/Saharan dust and total traffic. The results obtained by PMF were further tested inter alia, by comparing them to those obtained by two other receptor modelling techniques: Constrained Weighted Non-negative Matrix Factorization (CW - NMF) and Chemical Mass Balance (CMB). The results of these tests suggest that the solution obtained by PMF, is valid, indicating that for this particular airshed PMF managed to extract most of the information about the aerosol sources affecting the receptor - even from a dataset with a limited number of samples.

ADVANCE system testing: Benefit-risk analysis of a marketed vaccine using multi-criteria decision analysis and individual-level state transition modelling

BACKGROUND

The Accelerated Development of VAccine beNefit-risk Collaboration in Europe (ADVANCE) is a public-private collaboration aiming to develop and test a system for rapid benefit-risk (B/R) monitoring of vaccines using electronic health record (eHR) databases in Europe. Proof-of-concept studies were designed to assess the proposed processes and system for generating the required evidence to perform B/R assessment and near-real time monitoring of vaccines. We aimed to test B/R methodologies for vaccines, using the comparison of the B/R profiles of whole-cell (wP) and acellular pertussis (aP) vaccine formulations in children as an example.

METHODS

We used multi-criteria decision analysis (MCDA) to structure the B/R assessment combined with individual-level state transition modelling to build the B/R effects table. In the state transition model, we simulated the number of events in two hypothetical cohorts of 1 million children followed from first pertussis dose till pre-school-entry booster (or six years of age, whichever occurred first), with one cohort receiving wP, and the other aP. The benefits were reductions in pertussis incidence and complications. The risks were increased incidences of febrile convulsions, fever, hypotonic-hyporesponsive episodes, injection-site reactions and persistent crying. Most model parameters were informed by estimates (coverage, background incidences, relative risks) from eHR databases from Denmark (SSI), Spain (BIFAP and SIDIAP), Italy (Pedianet) and the UK (RCGP-RSC and THIN). Preferences were elicited from clinical and epidemiological experts.

RESULTS

Using state transition modelling to build the B/R effects table facilitated the comparison of different vaccine effects (e.g. immediate vaccine risks vs long-term vaccine benefits). Estimates from eHR databases could be used to inform the simulation model. The model results could be easily combined with preference weights to obtain B/R scores.

CONCLUSION

Existing B/R methodology, modelling and estimates from eHR databases can be successfully used for B/R assessment of vaccines.

Partnering with persons in long-term recovery from substance use disorder: experiences from a collaborative research project

Background

Traditional research about substance use disorder (SUD) treatment is considered, among an increasing number of service users, to be disempowering and poorly reflective of their priorities. Thus, this methodological article sought to examine the experiences of a peer research group (PRG), whose four members were in long-term SUD recovery, and a principal investigator (PI), when collaborating on a study of SUD recovery. This article has also aspired to discern the influence of peer researcher participation on the research process. The purpose of the qualitative research project that formed the basis of this methodological study was to examine the reasons provided and strategies employed for abstaining from problematic substance use among persons with SUDs.

Methods

The project took place from 2015 to 2018, during which time individual interviews were conducted with 18 persons in recovery from SUDs. The PRG contributed to all parts of the project and worked alongside the PI in preparing the study, during early stages of data analysis, and while writing up the findings. In total, ten group discussions were held over the course of 3 years.

Results

The study showed that the PRG offered important contributions with respect to developing the interview guide, preunderstanding among the PRG members, and discussing alternative forms of data collection. Key findings about how this collaborative research process was experienced relate to three matters: the group aspect of participation, the value of predictable routines and clear expectations, and the open sharing of private matters. The PI experienced the research process as having been enriched by alternative ways of asking questions and interpreting findings and as an interactive arena for reciprocal social and professional support.

Conclusions

When establishing a PRG while studying recovery processes, it can be advantageous to include several peer researchers with diverse lived experiences concerning substance use, treatment, and recovery. If possible, at least one peer researcher with formal training or qualitative research experience might be included. The PI should be trained in collaborating with peer researchers or should be part of a research environment in which it is possible to discuss methodological challenges with other researchers.

Development and psychometric evaluation of the diabetic Men's dietary behaviors inventory based on the theory of reasoned action

Background

Unhealthy dietary behaviors have progressively increased the prevalence of diabetes mellitus. Thus, assessing such behaviors and their associated beliefs by valid measurement tools seems essential. This study sought to develop and evaluate the psychometric properties of the Diabetic Men’s Dietary Behaviors Inventory based on the Theory of Reasoned Action.

Methods

Initially, a preliminary 78-item inventory on diabetic men’s dietary beliefs and behaviors was developed based on the six constructs of the Theory of Reasoned Action. Then, psychometric evaluation methods were employed to select the most appropriate items and also to validate the inventory. The validity of the inventory was assessed through face, content, and construct validity assessment. For construct validity assessment, a sample of 206 diabetic men was selected from two educational, research and healthcare settings located in Isfahan, Iran. The inventory was completed for all men through interviewing them. The reliability of the inventory was evaluated through internal consistency assessment.

Results

The preliminary inventory contained 78 items, 33 of which were excluded during the phases of psychometric evaluation. Exploratory factor analysis revealed a five-factor structure for the inventory; the factor loads ranged from 0.41 to 0.80. All items were significantly correlated with the inventory. Cronbach’s alpha values of all factors were greater than 0.6, denoting the high internal consistency of the inventory.

Conclusion

The Diabetic Men’s Dietary Behaviors Inventory is a valid and reliable instrument for evaluating diabetic men’s dietary perceptions and behaviors.

How is AMSTAR applied by authors - a call for better reporting

BACKGROUND

The assessment of multiple systematic reviews (AMSTAR) tool is widely used for investigating the methodological quality of systematic reviews (SR). Originally, AMSTAR was developed for SRs of randomized controlled trials (RCTs). Its applicability to SRs of other study designs remains unclear. Our objectives were to: 1) analyze how AMSTAR is applied by authors and (2) analyze whether the authors pay attention to the original purpose of AMSTAR and for what it has been validated.

METHODS

We searched MEDLINE (via PubMed) from inception through October 2016 to identify studies that applied AMSTAR. Full-text studies were sought for all retrieved hits and screened by one reviewer. A second reviewer verified the excluded studies (liberal acceleration). Data were extracted into structured tables by one reviewer and were checked by a second reviewer. Discrepancies at any stage were resolved by consensus or by consulting a third person. We analyzed the data descriptively as frequencies or medians and interquartile ranges (IQRs). Associations were quantified using the risk ratio (RR), with 95% confidence intervals.

RESULTS

We identified 247 studies. They included a median of 17 reviews (interquartile range (IQR): 8 to 47) per study. AMSTAR was modified in 23% (57/247) of studies. In most studies, an AMSTAR score was calculated (200/247; 81%). Methods for calculating an AMSTAR score varied, with summing up all yes answers (yes = 1) being the most frequent option (102/200; 51%). More than one third of the authors failed to report how the AMSTAR score was obtained (71/200; 36%). In a subgroup analysis, we compared overviews of reviews (n = 154) with the methodological publications (n = 93). The overviews of reviews were much less likely to mention both limitations with respect to study designs (if other studies other than RCTs were included in the reviews) (RR 0.27, 95% CI 0.09 to 0.75) and overall score (RR 0.08, 95% CI 0.02 to 0.35).

CONCLUSIONS

Authors, peer reviewers, and editors should pay more attention to the correct use and reporting of assessment tools in evidence synthesis. Authors of overviews of reviews should ensure to have a methodological expert in their review team.

How is AMSTAR applied by authors - a call for better reporting

Background

The assessment of multiple systematic reviews (AMSTAR) tool is widely used for investigating the methodological quality of systematic reviews (SR). Originally, AMSTAR was developed for SRs of randomized controlled trials (RCTs). Its applicability to SRs of other study designs remains unclear. Our objectives were to: 1) analyze how AMSTAR is applied by authors and (2) analyze whether the authors pay attention to the original purpose of AMSTAR and for what it has been validated.

Methods

We searched MEDLINE (via PubMed) from inception through October 2016 to identify studies that applied AMSTAR. Full-text studies were sought for all retrieved hits and screened by one reviewer. A second reviewer verified the excluded studies (liberal acceleration). Data were extracted into structured tables by one reviewer and were checked by a second reviewer. Discrepancies at any stage were resolved by consensus or by consulting a third person. We analyzed the data descriptively as frequencies or medians and interquartile ranges (IQRs). Associations were quantified using the risk ratio (RR), with 95% confidence intervals.

Results

We identified 247 studies. They included a median of 17 reviews (interquartile range (IQR): 8 to 47) per study. AMSTAR was modified in 23% (57/247) of studies. In most studies, an AMSTAR score was calculated (200/247; 81%). Methods for calculating an AMSTAR score varied, with summing up all yes answers (yes = 1) being the most frequent option (102/200; 51%). More than one third of the authors failed to report how the AMSTAR score was obtained (71/200; 36%). In a subgroup analysis, we compared overviews of reviews (n = 154) with the methodological publications (n = 93). The overviews of reviews were much less likely to mention both limitations with respect to study designs (if other studies other than RCTs were included in the reviews) (RR 0.27, 95% CI 0.09 to 0.75) and overall score (RR 0.08, 95% CI 0.02 to 0.35).

Conclusions

Authors, peer reviewers, and editors should pay more attention to the correct use and reporting of assessment tools in evidence synthesis. Authors of overviews of reviews should ensure to have a methodological expert in their review team.

Quantitative Magnetic Resonance Imaging Analysis of the Cervical Spine Extensor Muscles: Intrarater and Interrater Reliability of a Novice and an Experienced Rater

Study Design

Reliability study.

Purpose

To examine the reliability of novice and experienced raters for measurements of the size and composition of the cervical extensor muscles using a thresholding technique.

Overview of Literature

Although some authors have reported on the dependability of magnetic resonance imaging (MRI) measurements of the cervical muscles, there remains some variability regarding intrarater and interrater reliabilities, and few studies have examined the associated measurement error. Whether the rater's experience noticeably influences the reliability and precision of such measurements has also not been examined.

Methods

A sample of 10 patients with cervical pathologies was selected. Muscle cross-sectional area (CSA), functional cross-sectional area (FCSA), and signal intensity of the cervical extensor muscles were acquired from axial T2-weighted MRIs by a novice and an experienced rater. All measurements were obtained twice, at least 5 days apart, while the raters were blinded to all earlier measurements.

Results

Interrater reliability estimates (intraclass correlation coefficients) varied between 0.84 and 0.99 for the novice rater and between 0.94 and 0.99 for the experienced rater, indicating excellent reliability. The standard error of measurement for the novice rater was, however, noticeably higher for all cervical muscle measurements. Most of the interrater estimates showed excellent agreement with the exception of CSA measurement of the semispinalis cervicis at C4-C7 and FCSA measurement of the multifidus and semispinalis cervicis at C4-C7, which showed poor interrater reliability.

Conclusions

The proposed method of investigating cervical muscle measurements was highly reliable; however, novice raters should receive adequate training before using this method for diagnostic, research, and clinical purposes.

A survey of prevalence of narrative and systematic reviews in five major medical journals

Background

Systematic reviews may provide less biased evidence than narrative reviews because they observe a strict methodology, similarly to primary studies. Hence, for clinical research questions, systematic reviews should be the study design of choice. It would be important to evaluate the prevalence and characteristics of narrative and systematic reviews published in prominent medical journals. Researchers and clinicians give great value to articles published in such scientific journals. This study sought to evaluate the prevalence and characteristics of narrative and systematic reviews in the five highest-ranked general medical journals and investigate the associations among type of review, number of citations, and impact factor (IF).

Methods

We surveyed the five highest-ranked medical journals (The New England Journal of Medicine, The Lancet, The Journal of the American Medical Association, The BMJ, and Annals of Internal Medicine) for narrative and systematic reviews published between June 2015 and June 2016. We independently selected and extracted the data from the reviews by strictly following the pre-determined eligibility criteria (Systematic and narrative reviews that focused on the management of diseases). We conducted regression analyses to investigate the associations among review type, number of citations, and IF. We also descriptively reported narrative reviews containing some methodology that might be reproducible.

Results

Two hundred seventy-five reviews were included: 75 (27%) systematic; 126 (46%) narrative with some methodology reported, and 74 (27%) narrative reviews. In comparison to systematic reviews, narrative reviews were more frequently published in journals with higher IF (risk ratio [RR] = 1.114 (95% CI 1.080 to 1.149). Systematic reviews received more citations than narrative reviews (group formed by narrative and narrative with some methodology reported (RR = 0.985 95% CI 0.978 to 0.991).

Conclusions

Non-systematic evidence is the most prevalent type of evidence in reviews published in the five highest-ranked general medical journals. Narrative reviews were more frequently published in journals with higher IF. We recommend that journals limit their space for narrative information, and to address clinical research questions, these journals consider publishing systematic evidence exclusively.

Electronic supplementary material

The online version of this article (10.1186/s12874-017-0453-y) contains supplementary material, which is available to authorized users.

Intervention planning for a digital intervention for self-management of hypertension: a theory-, evidence- and person-based approach

Background

This paper describes the intervention planning process for the Home and Online Management and Evaluation of Blood Pressure (HOME BP), a digital intervention to promote hypertension self-management. It illustrates how a Person-Based Approach can be integrated with theory- and evidence-based approaches. The Person-Based Approach to intervention development emphasises the use of qualitative research to ensure that the intervention is acceptable, persuasive, engaging and easy to implement.

Methods

Our intervention planning process comprised two parallel, integrated work streams, which combined theory-, evidence- and person-based elements. The first work stream involved collating evidence from a mixed methods feasibility study, a systematic review and a synthesis of qualitative research. This evidence was analysed to identify likely barriers and facilitators to uptake and implementation as well as design features that should be incorporated in the HOME BP intervention. The second work stream used three complementary approaches to theoretical modelling: developing brief guiding principles for intervention design, causal modelling to map behaviour change techniques in the intervention onto the Behaviour Change Wheel and Normalisation Process Theory frameworks, and developing a logic model.

Results

The different elements of our integrated approach to intervention planning yielded important, complementary insights into how to design the intervention to maximise acceptability and ease of implementation by both patients and health professionals. From the primary and secondary evidence, we identified key barriers to overcome (such as patient and health professional concerns about side effects of escalating medication) and effective intervention ingredients (such as providing in-person support for making healthy behaviour changes). Our guiding principles highlighted unique design features that could address these issues (such as online reassurance and procedures for managing concerns). Causal modelling ensured that all relevant behavioural determinants had been addressed, and provided a complete description of the intervention. Our logic model linked the hypothesised mechanisms of action of our intervention to existing psychological theory.

Conclusion

Our integrated approach to intervention development, combining theory-, evidence- and person-based approaches, increased the clarity, comprehensiveness and confidence of our theoretical modelling and enabled us to ground our intervention in an in-depth understanding of the barriers and facilitators most relevant to this specific intervention and user population.

Electronic supplementary material

The online version of this article (doi:10.1186/s13012-017-0553-4) contains supplementary material, which is available to authorized users.

Feasibility of assessing quality of care at the end of life in two cluster trials using an after-death approach with multiple assessments

BACKGROUND

In 2009 two randomised cluster trials took place to assess the introduction of the Italian Version of the Liverpool Care Pathway in hospitals and hospices. Before and after data were gathered. The primary aim of this study is to evaluate the feasibility of using a combination of assessment methods aimed at different proxy respondents to create a means of measuring quality of care at the end of life. We also aim to explore whether there are differences in response to this approach between the hospice and hospital inpatient settings.

METHODS

A retrospective design was used. Eligible deaths were traced through death registries, and proxies were used to give information. Four procedures of assessment were used to measure different dimensions. Feasibility was assessed through compliance and adherence to the study instruments, and measured against standards derived from previous after-death studies. The proxy caregiver's rating of the study tools was also measured, to gauge feasibility and effectiveness. All consecutive cancer deaths that occurred in the study period were eligible. In both trials, deaths were excluded if the patient was a relative of hospital/hospice staff. 145 patients were recruited from the Hospital setting, and 127 from Hospice.

RESULTS

A high proportion of non-professional caregivers were interviewed - in both hospital (76.6%) and hospice (74.8%). There was no significant difference in the median number of days in each setting. 89.0% of hospital patients' GPs and 85.0% of hospice patients' GPs were interviewed. Care procedures were recorded in all hospice cases, and were missing in only 1 hospital case.52.7% of Hospital patients' relatives and 64.12% Hospice relatives were assessed to have been caused a low level of distress through the study.

CONCLUSIONS

The data shows high levels of compliance and adherence to the study instruments. This suggests that this approach to assessing quality of care is feasible, and this coupled with low levels of distress caused by the study instruments suggest effectiveness. There were no substantial differences between the hospice and hospital settings.

Choosing your health insurance package: a method for measuring the public's preferences for changes in the national health insurance plan

With rising healthcare expenditure and limited budgets available, countries are having to make choices about the content of health insurance plans. The views of the general population can help determine such priorities. In this article, we investigate whether preferences of the general population regarding the content of health insurance plans could be measured with the help of a stated preference method: the Basket Method (BM). In this method, people use an online tool to include or exclude healthcare interventions from their hypothetical insurance package; this then affects their monthly premium. The study was conducted in the Netherlands. In total, 1007 members of two panels managed by the NIVEL filled out an online questionnaire that included the BM. The suitability of the BM was tested with the help of five criteria, e.g. the BM's ability to distinguish between healthcare interventions. Our results suggest that the BM is suitable for measuring preferences of the general population regarding the content of the health insurance plan, as it performs well on most criteria. Policy makers can use these preferences when deciding the content of the health insurance plan. Its contents will then be more aligned to the population's needs and preferences.

Adapting Champion's Breast Cancer Fear Scale to colorectal cancer: psychometric testing in a sample of older Chinese adults

PURPOSE

Colorectal cancer (CRC) is the most common type of cancer in both men and women, and older adults are more susceptible to this disease. Previous studies suggest that cancer fear may be a key predictor of participation in cancer screening. Yet there is a lack of validated measuring tools of fear relating to CRC for the Chinese older adult population. This study aims to test the psychometric properties of the Chinese version of the Colorectal Cancer Fear Scale (CRCFS), adapting from the Champion's Breast Cancer Fear Scale.

METHODS

The CRCFS was developed by altering the wording 'breast cancer' to 'colorectal cancer'. Interviewer-administered surveys were carried out with a convenience sample of 250 community-dwelling adults aged at least 60 years old without a history of cancer. A subsample of 40 participants completed the scale again at one-month.

RESULTS

Confirmatory factor analysis revealed that the one-factor model provided excellent fits to the overall data, and two randomly split samples. Cronbach's alpha of the scale was 0.95 and test-retest reliability was 0.52. Positive and significant correlations of CRC Cancer Fear with CRC-related susceptibility, severity and barriers were observed. A non-linear relationship with benefits was found.

CONCLUSIONS

The findings provide support for the psychometric properties of a Chinese version of the Champion Cancer Fear with an adaption to CRC in a sample of community dwelling older Chinese adults. The scale provides a useful tool to assess CRC-related fear, which interventions should address in order to improve screening rates among older Chinese adults.

Quantifying lead-time bias in risk factor studies of cancer through simulation

PURPOSE

Lead-time is inherent in early detection and creates bias in observational studies of screening efficacy, but its potential to bias effect estimates in risk factor studies is not always recognized. We describe a form of this bias that conventional analyses cannot address and develop a model to quantify it.

METHODS

Surveillance Epidemiology and End Results (SEER) data form the basis for estimates of age-specific preclinical incidence, and log-normal distributions describe the preclinical duration distribution. Simulations assume a joint null hypothesis of no effect of either the risk factor or screening on the preclinical incidence of cancer, and then quantify the bias as the risk-factor odds ratio (OR) from this null study. This bias can be used as a factor to adjust observed OR in the actual study.

RESULTS

For this particular study design, as average preclinical duration increased, the bias in the total-physical activity OR monotonically increased from 1% to 22% above the null, but the smoking OR monotonically decreased from 1% above the null to 5% below the null.

CONCLUSIONS

The finding of nontrivial bias in fixed risk-factor effect estimates demonstrates the importance of quantitatively evaluating it in susceptible studies.