Meta-analysis in a digitalized world: A step-by-step primer

In recent years, much research and many data sources have become digital. Some advantages of digital or Internet-based research, compared to traditional lab research (e.g., comprehensive data collection and storage, availability of data) are ideal for an improved meta-analyses approach.In the meantime, in meta-analyses research, different types of meta-analyses have been developed to provide research syntheses with accurate quantitative estimations. Due to its rich and unique palette of corrections, we recommend to using the Schmidt and Hunter approach for meta-analyses in a digitalized world. Our primer shows in a step-by-step fashion how to conduct a high quality meta-analysis considering digital data and highlights the most obvious pitfalls (e.g., using only a bare-bones meta-analysis, no data comparison) not only in aggregation of the data, but also in the literature search and coding procedure which are essential steps in any meta-analysis. Thus, this primer of meta-analyses is especially suited for a situation where much of future research is headed to: digital research. To map Internet-based research and to reveal any research gap, we further synthesize meta-analyses on Internet-based research (15 articles containing 24 different meta-analyses, on 745 studies, with 1,601 effect sizes), resulting in the first mega meta-analysis of the field. We found a lack of individual participant data (e.g., age and nationality). Hence, we provide a primer for high-quality meta-analyses and mega meta-analyses that applies to much of coming research and also basic hands-on knowledge to conduct or judge the quality of a meta-analyses in a digitalized world.

Psychometric Evaluation of Single-Item Relationship Satisfaction, Love, Conflict, and Commitment Measures

Issues in applied survey research, including minimizing respondent burden and ensuring measures' brevity for smartphone administration, have intensified efforts to create short measures. We conducted two studies on the psychometric properties of single-item satisfaction, love, conflict, and commitment measures. Study 1 was longitudinal, surveying college-age dating couples at three monthly waves (n =121, 84, and 68 couples at the respective waves). Partners completed single- and multi-item measures of the four constructs, along with other variables, to examine test-retest reliability and convergent, concurrent, and predictive validity. Single-item measures of satisfaction, love, and commitment exhibited impressive psychometric qualities, but our single-item conflict measure performed somewhat less strongly. Study 2, a cross-sectional online survey (n = 280), showed strong convergent validity of the single-item measures, including that of conflict.

Deficiencies in monitoring practices of marine protected areas in southern European seas

Worldwide, states are gazetting new Marine Protected Areas (MPAs) to meet the international commitment of protecting 30% of the seas by 2030. Yet, protection benefits only come into effect when an MPA is implemented with activated regulations and actively managed through continuous monitoring and adaptive management. To assess if actively managed MPAs are the rule or the exception, we used the Mediterranean and Black Seas as a case study, and retrieved information on monitoring activities for 878 designated MPAs in ten European Union (EU) countries. We searched for scientific and grey literature that provides information on the following aspects of MPA assessment and monitoring: ecological (e.g., biomass of commercially exploited fish), social (e.g., perceptions of fishers in an MPA), economic (e.g., revenue of fishers) and governance (e.g., type of governance scheme). We also queried MPA authorities on their past and current monitoring activities using a web-based survey through which we collected 123 responses. Combining the literature review and survey results, we found that approximately 16% of the MPA designations (N = 878) have baseline and/or monitoring studies. Most monitoring programs evaluated MPAs based solely on biological/ecological variables and fewer included social, economic and/or governance variables, failing to capture and assess the social-ecological dimension of marine conservation. To increase the capacity of MPAs to design and implement effective social-ecological monitoring programs, we recommend strategies revolving around three pillars: funding, collaboration, and technology. Following the actionable recommendations presented herein, MPA authorities and EU Member States could improve the low level of MPA monitoring to more effectively reach the 30% protection target delivering benefits for biodiversity conservation.

Survey response rates in health sciences education research: A 10-year meta-analysis

Growth in the online survey market may be increasing response burden and possibly jeopardizing higher response rates. This meta-analysis evaluated survey trends over one decade (2011-2020) to determine: (1) changes in survey publication rates over time, (2) changes in response rates over time, (3) typical response rates within health sciences education research, (4) the factors influencing survey completion levels, and (5) common gaps in survey methods and outcomes reporting. Study I estimated survey publication trends between 2011 and 2020 using articles published in the top three health sciences education research journals. Study II searched the anatomical sciences education literature across six databases and extracted study/survey features and survey response rates. Time plots and a proportional meta-analysis were performed. Per 2926 research articles, the annual estimated proportion of studies with survey methodologies has remained constant, with no linear trend (p > 0.050) over time (Study I). Study II reported a pooled absolute response rate of 67% (95% CI = 63.9-69.0) across 360 studies (k), totaling 115,526 distributed surveys. Despite response rate oscillations over time, no significant linear trend (p = 0.995) was detected. Neither survey length, incentives, sponsorship, nor population type affected absolute response rates (p ≥ 0.070). Only 35% (120 of 339) of studies utilizing a Likert scale reported evidence of survey validity. Survey response rates and the prevalence of studies with survey methodologies have remained stable with no linear trends over time. We recommend researchers strive for a typical absolute response rate of 67% or higher and clearly document evidence of survey validity for empirical studies.

Orthodontic management of traumatic dental injuries in Norway and orthodontists' perceptions of referral routines: A quality assurance survey

BACKGROUND/AIM

Orthodontic treatment of patients with traumatic dental injuries is challenging, with limited evidence of routines and outcomes. The aims of this study were: (i) to describe how orthodontists perceive the information on traumatic dental injuries received by referral from the Public Dental Health Service before orthodontic treatment and (ii) to assess orthodontists' knowledge and working routines in managing traumatic dental injuries.

MATERIALS AND METHODS

Data were obtained through a survey of all practicing orthodontists registered as members of the Norwegian Association of Orthodontists (n = 203).

RESULTS

Eighty-three orthodontists were enrolled, most of whom had received their dental degree (73.0%) and specialist orthodontic training (88.5%) in Norway. They reported examining patients with a history of traumatic dental injury at weekly (34.2%) or monthly (38.0%) basis. In 85.5% of cases, they obtained a history of traumatic dental injury from patients. Half of the respondents (51.3%) favoured two-phase early orthodontic treatment for patients with an overjet ≥6 mm. The observation time and treatment strategy showed considerable discrepancies across traumatic dental injury diagnoses. Most (59.1%) orthodontists considered the information on previous traumatic dental injuries provided by the Public Dental Health Services referral 'inadequate', more commonly in cases of mild (83.5%) than severe (57.5%) traumatic dental injuries.

CONCLUSIONS

Orthodontic management of patients with traumatic dental injuries was characterised by lack of uniformity in both recommended observation time before orthodontic treatment and management strategy. The referral routines by the Public Dental Health Services for patients with traumatic dental injuries were perceived as 'inadequate' in terms of frequency and quality. The results indicate the requirement of standardisation of routines related to orthodontic management of traumatic dental injuries and referral routines by the Public Dental Health Services.

Prediction of postpartum depression with an online neurocognitive risk screening tool for pregnant women

Postpartum depression (PPD) is a severe mental illness affecting 10-15% of mothers. Emerging evidence indicates that negative neurocognitive bias in response to infant distress during pregnancy marks an increased risk of PPD. This proof-of-concept study aimed to investigate the association between negatively biased neurocognitive processing of infant distress during pregnancy and subsequent PPD and to explore the feasibility of an online risk screening tool. In the second or third trimester of pregnancy, 87 participants underwent two online tests of reactivity to and evaluation of infant distress and completed questionnaires regarding psychosocial risk factors. After birth, participants rated their depressive symptoms online and underwent a diagnostic telephone interview concerning PPD. Irrespective of depressive symptoms during pregnancy, negative reactivity to and evaluation of infant distress predicted PPD (reactivity: Exp(B)=1.33, p = 0.04) and depressive symptoms after birth (reactivity: B = 0.04, p = 0.048; evaluation: B = 0.10, p = 0.04). The negative reactivity toward infant distress showed high sensitivity and moderate specificity (89% and 77%, respectively), while the evaluation of infant distressed cries showed lower sensitivity and specificity (67% and 66%, respectively). The relatively small sample size prevented the inclusion of additional risk variables in the regression models. The replication of an association between negative neurocognitive bias during pregnancy with PPD risk is noteworthy and has clinical implications in terms of early prevention. However, the low response rate indicates that this tool is not feasible in its current form. Future larger-scale studies are needed to further investigate candidate risk factors in a brief online screening tool.

Awareness and Knowledge of Antimicrobial Resistance, Antimicrobial Stewardship and Barriers to Implementing Antimicrobial Susceptibility Testing among Medical Laboratory Scientists in Nigeria: A Cross-Sectional Study

Background: Antimicrobial resistance (AMR) is now considered one of the greatest global health threats. This is further compounded by a lack of new antibiotics in development. Antimicrobial stewardship programmes can improve and optimize the use of antibiotics, thereby increasing the cure rates of antibiotic treatment and decreasing the problem of AMR. In addition, diagnostic and antimicrobial stewardships in the pathology laboratories are useful tools to guide clinicians on patient treatment and to stop the inappropriate use of antibiotics in empirical treatment or narrow antibiotics. Medical Laboratory Scientists are at the forefront of performing antibiotics susceptibility testing in pathology laboratories, thereby helping clinicians to select the appropriate antibiotics for patients suffering from bacterial infections. Methods: This cross-sectional study surveyed personal antimicrobial usage, the knowledge and awareness on AMR, and antimicrobial stewardship, as well as barriers to antimicrobial susceptibility testing among medical laboratory scientists in Nigeria using pre-tested and validated questionnaires administered online. The raw data were summarized and exported in Microsoft Excel and further analyzed using IBM SPSS version 26. Results: Most of the respondents were males (72%) and 25-35 years old (60%). In addition, the BMLS degree was the highest education qualification most of the respondents (70%) achieved. Of the 59.2% of the respondents involved in antibiotics susceptibility testing, the disc diffusion method was the most commonly used (67.2%), followed by PCR/Genome-based detection (5.2%). Only a small percentage of respondents used the E-test (3.4%). The high cost of testing, inadequate laboratory infrastructure, and a lack of skilled personnel are the major barriers to performing antibiotics susceptibility testing. A higher proportion of a good AMR knowledge level was observed in male respondents (75%) than females (42.9%). The knowledge level was associated with the respondent's gender (p = 0.048), while respondents with a master's degree were more likely to possess a good knowledge level of AMR (OR: 1.69; 95% CI: 0.33, 8.61). Conclusion: The findings of this study indicate that Nigerian medical laboratory scientists had moderate awareness of AMR and antibiotic stewardship. It is necessary to increase investments in laboratory infrastructure and manpower training, as well as set up an antimicrobial stewardship programme to ensure widespread antibiotics susceptibility testing in hospitals, thereby decreasing empirical treatment and the misuse of antibiotics.

Developing, Implementing, and Evaluating an Artificial Intelligence-Guided Mental Health Resource Navigation Chatbot for Health Care Workers and Their Families During and Following the COVID-19 Pandemic: Protocol for a Cross-sectional Study

Background

Approximately 1 in 3 Canadians will experience an addiction or mental health challenge at some point in their lifetime. Unfortunately, there are multiple barriers to accessing mental health care, including system fragmentation, episodic care, long wait times, and insufficient support for health system navigation. In addition, stigma may further reduce an individual’s likelihood of seeking support. Digital technologies present new and exciting opportunities to bridge significant gaps in mental health care service provision, reduce barriers pertaining to stigma, and improve health outcomes for patients and mental health system integration and efficiency. Chatbots (ie, software systems that use artificial intelligence to carry out conversations with people) may be explored to support those in need of information or access to services and present the opportunity to address gaps in traditional, fragmented, or episodic mental health system structures on demand with personalized attention. The recent COVID-19 pandemic has exacerbated even further the need for mental health support among Canadians and called attention to the inefficiencies of our system. As health care workers and their families are at an even greater risk of mental illness and psychological distress during the COVID-19 pandemic, this technology will be first piloted with the goal of supporting this vulnerable group.

Objective

This pilot study seeks to evaluate the effectiveness of the Mental Health Intelligent Information Resource Assistant in supporting health care workers and their families in the Canadian provinces of Alberta and Nova Scotia with the provision of appropriate information on mental health issues, services, and programs based on personalized needs.

Methods

The effectiveness of the technology will be assessed via voluntary follow-up surveys and an analysis of client interactions and engagement with the chatbot. Client satisfaction with the chatbot will also be assessed.

Results

This project was initiated on April 1, 2021. Ethics approval was granted on August 12, 2021, by the University of Alberta Health Research Board (PRO00109148) and on April 21, 2022, by the Nova Scotia Health Authority Research Ethics Board (1027474). Data collection is anticipated to take place from May 2, 2022, to May 2, 2023. Publication of preliminary results will be sought in spring or summer 2022, with a more comprehensive evaluation completed by spring 2023 following the collection of a larger data set.

Conclusions

Our findings can be incorporated into public policy and planning around mental health system navigation by Canadian mental health care providers—from large public health authorities to small community-based, not-for-profit organizations. This may serve to support the development of an additional touch point, or point of entry, for individuals to access the appropriate services or care when they need them, wherever they are.

International Registered Report Identifier (IRRID)

PRR1-10.2196/33717

Individual differences in mental imagery in different modalities and levels of intentionality

Mental imagery is a highly common component of everyday cognitive functioning. While substantial progress is being made in clarifying this fundamental human function, much is still unclear or unknown. A more comprehensive account of mental imagery aspects would be gained by examining individual differences in age, sex, and background experience in an activity and their association with imagery in different modalities and intentionality levels. The current online study combined multiple imagery self-report measures in a sample (n = 279) with a substantial age range (18-65 years), aiming to identify whether age, sex, or background experience in sports, music, or video games were associated with aspects of imagery in the visual, auditory, or motor stimulus modality and voluntary or involuntary intentionality level. The findings show weak positive associations between age and increased vividness of voluntary auditory imagery and decreased involuntary musical imagery frequency, weak associations between being female and more vivid visual imagery, and relations of greater music and video game experience with higher involuntary musical imagery frequency. Moreover, all imagery stimulus modalities were associated with each other, for both intentionality levels, except involuntary musical imagery frequency, which was only related to higher voluntary auditory imagery vividness. These results replicate previous research but also contribute new insights, showing that individual differences in age, sex, and background experience are associated with various aspects of imagery such as modality, intentionality, vividness, and frequency. The study's findings can inform the growing domain of applications of mental imagery to clinical and pedagogical settings.

Development of Virtual Surveys for the COVID-19 Wave of the AGELESS Longitudinal Study in Malaysia

Background

Rapid population aging occurring in developing nations necessitates innovation to ensure we continue to gain ground on aging research despite pandemic threats. While developed nations have resorted to virtual communications, this is challenging in developing nations due to poor internet connectivity and digital literacy.

Objectives

The aim of this study was to determine the feasibility of virtual data collection for a longitudinal study of aging assessing cognitive frailty in a middle-income Southeast Asian country.

Methods

The Transforming Cognitive Frailty into Later-Life Self-Sufficiency (AGELESS) longitudinal study of aging involved community-dwelling participants aged 60 years and above. A semi-structured focus group discussion was conducted via videoconferencing with selected representatives from existing participants. The survey instrument was compiled during a hybrid meeting and refined using a virtual Delphi process involving 51 AGELESS investigators. The final draft survey and recruitment strategy were then piloted among selected participants.

Results

Twelve individuals participated in the virtual focus group interview. Smartphone, tablet computer, laptops, and desktop personal computers were used for information gathering, communication, banking, shopping, leisure, religion, and education, within this group. The survey instrument was redacted from 362 items in 18 sections to 141 items in 12 sections through 3 virtual Delphi rounds facilitated by email, social media messaging, and videoconferencing which attracted 213 comments. Of 45 participants selected for the pilot survey, 30 were successfully contacted after one attempt and 18 completed the survey. Cognitive frailty was present in 13%, cognitive impairment in 20%, frailty in 20%, and 47% were robust.

Conclusion

A virtual survey instrument was developed for the AGELESS longitudinal survey of aging which was vital for determining the effects of the COVID-19 pandemic on our older population as well as sustaining research into aging despite barriers posed by the pandemic.

Text4Support Mobile-Based Programming for Individuals Accessing Addictions and Mental Health Services-Retroactive Program Analysis at Baseline, 12 Weeks, and 6 Months

Objective: Where traditional approaches fall short, widely accessible and accepted, yet under leveraged, digital technologies such as text messaging present novel opportunities to solve a range of health care solutions. The following provides a preliminary analysis of the Text4Support program, a text-messaging intervention using the principles of cognitive behavioral therapy, which seeks to support the health and well-being of individuals seeking support for addiction or mental health concerns. The goal of this study was to assess whether the Text4Support program improved the perceived overall mental well-being of participants. Methods: The evaluation analyzes survey responses of individuals who were enrolled in the Text4Support program beginning in July 2019, who had completed the 6-months program by May 2020. Participants were asked to provide responses to three surveys during their time in the program-at baseline, 12-weeks and 6-months, which included questions documenting demographic information, general satisfaction with the program, and a participants' level of "global distress" through use of the Clinical Outcomes Routine Evaluation System (CORE-10)-a validated brief 10-item assessment and outcome measurement tool used to assess conditions including anxiety, depression, physical problems, and risk to self. Results and Conclusions: This data set did not include a large enough sample of participants to reach statistical significance. Nevertheless, the study provides some preliminary analysis, and identifies opportunities for the future analysis and research.

Hotspots in Psychology – 2020 Edition

Abstract. This editorial gives a brief introduction to the six articles included in the fourth “Hotspots in Psychology” of the Zeitschrift für Psychologie. The format is devoted to systematic reviews and meta-analyses in research-active fields that have generated a considerable number of primary studies. The common denominator is the research synthesis nature of the included articles, and not a specific psychological topic or theme that all articles have to address. Moreover, methodological advances in research synthesis methods relevant for any subfield of psychology are being addressed. Comprehensive supplemental material to the articles can be found in PsychArchives ( https://www.psycharchives.org ).