Survey research in neuropsychology: A systematic review

Systematic Review Assessing Quality of the Survey Literature in Surgery

INTRODUCTION

The use of survey methodology in surgical research has proliferated in recent years, but the quality of these surveys and of their reporting is understudied.

METHODS

We conducted a comprehensive review of surgical survey literature (January 2022-July 2023) via PubMed in July 2023. Articles which (1) reported data gleaned from a survey, (2) were published in an English language journal, (3) targeted survey respondents in the United States or Canada, and (4) pertained to general surgery specialties were included. We assessed quality of survey reports using the Checklist for Reporting Of Survey Studies (CROSS) guidelines. Articles were evaluated for concordance with CROSS using a dichotomous (yes or no) scale.

RESULTS

Initial literature search yielded 481 articles; 57 articles were included in analysis based on the inclusion criteria. The mean response rate was 37% (range 0.62%-98%). The majority of surveys were administered electronically (n = 50, 87.8%). No publications adhered to all 40 CROSS items; on average, publications met 61.2% of items applicable to that study. Articles were most likely to adhere to reporting criteria for title and abstract (mean adherence 99.1%), introduction (99.1%), and discussion (92.4%). Articles were least adherent to items related to methodology (42.6%) and moderately adherent to items related to results (76.6%). Only five articles cited CROSS guidelines or another standardized survey reporting tool (10.5%).

CONCLUSIONS

Our analysis demonstrates that CROSS reporting guidelines for survey research have not been adopted widely. Surveys reported in surgical literature may be of variable quality. Increased adherence to guidelines could improve development and dissemination of surveys done by surgeons.

Gender and ethnic/racial diversity in clinical neuropsychology: Updates from the AACN, NAN, SCN 2020 practice and "salary survey"

OBJECTIVE

Examination of gender and diversity issues within clinical neuropsychology, using data from the 2020 professional practice and "salary survey."

METHODS

Clinical neuropsychologists in the U.S. and Canada were invited to participate in an online survey. The final sample consisted of 1677 doctoral-level practitioners.

RESULTS

Approximately, 60% of responding neuropsychologists are women and 53.8% of those women identify as early career psychologists (ECPs). Conversely, a majority of men in the sample are advanced career psychologists (ACPs). Both genders work predominantly in institutions, but more men than women work in private practice. ACP men produce a greater number of peer-reviewed publications and conference presentations. Across all work settings, women earn significantly less than men, and are less satisfied with their incomes. Establishing and maintaining family life is the biggest obstacle to attaining greater income and job satisfaction for both genders. Ethnic/racial minority status was identified in 12.9% of respondents, with 59.2% being ECPs. Job satisfaction and hostility in the workplace vary across ethnic/racial minority groups. Hispanic/Latino(a) and White neuropsychologists report higher incomes, but there were no statistically significant differences between any of the groups.

CONCLUSIONS

Income and select practice differences persist between female and male neuropsychologists. There is a slow rate of increased ethnic/racial diversity over time, which is much more apparent among early career practitioners. Trajectories and demographics suggest that the gender income gap is unlikely to be improved by the next survey iteration in 2025, whereas it is very likely that ethnic/racial diversity will continue to increase gradually.

Survey of Spanish Language Neuropsychological Test Use in the Assessment of Hispanic Americans/Latino/as/x

OBJECTIVE

To identify the Spanish language neuropsychological tests most frequently used in the evaluation of Hispanic Americans/Latino/as/x across eight neuropsychological domains. To compare these with previously surveyed most frequently used English language tests in the US/Canada. To describe the norms used with Spanish language tests.

METHOD

An anonymous, uncompensated, 12-min survey was emailed to 169 members of the American Academy of Clinical Neuropsychology, Hispanic Neuropsychological Society, and National Academy of Neuropsychology who self-identified as providing neuropsychological evaluations in Spanish via organizational websites.

RESULTS

The response rate was 36%. Respondents were all licensed U.S. psychologists with the majority fluent in Spanish, conducting less than half their evaluations in Spanish. There was an overlap between the versions of the three most frequently used Spanish versus English neuropsychological tests, but it varied by domain with 3/3 similar for visual-spatial/visuoconstructional skills and sensory/motor functioning domains and 2/3 similar for all other domains except memory (0/3). English language norm use predominated within the mood/personality and sensory/motor functioning domains. In all other domains, Spanish language norms collected in the continental US were preferred to those from foreign Spanish-speaking countries. The most frequently used foreign norms were from Mexico.

CONCLUSION

Except for the memory domain, there was a sizeable overlap between the three most frequently used Spanish and English language neuropsychological tests in the US. Spanish language tests are primarily interpreted with Spanish norms collected in the continental US except within the mood/personality and sensory/motor functioning domains where English language norms predominate.

Neuropsychology trainee concerns during the COVID-19 pandemic: A 2021 follow-up survey

OBJECTIVE

As the COVID-19 pandemic continues, the impact on neuropsychology trainees continues to evolve. This paper describes the results of a survey of neuropsychology trainee (graduate student through postdoctoral resident) perspectives on the COVID-19 pandemic and compares them to a previous survey conducted in Spring 2020.

METHOD

The survey used several questions from the 2020 survey and added applicable new questions based on the results of the 2020 survey. The survey was distributed to listservs, training directors, and student organizations in neuropsychology with snowball sampling used.

RESULTS

Respondents were primarily female (82.4%) and white (63%). The majority of trainees (66%) reported loss of clinical hours. Interestingly, the average training time missed was approximately 3.36 weeks (SD = 9.27). Trainees continue to report that they have experienced increased anxiety, depression, and stress since the beginning of the pandemic; however, compared to a prior survey, rates of increased anxiety/stress remained stable, but more trainees reported increased depression. Approximately 31% of trainees reported that they were differentially impacted by the pandemic due to racial/ethnic background and female trainees were more likely to report increased personal stress, anxiety and depression than their male counterparts.

CONCLUSIONS

Results suggest continued wide-reaching pandemic related impacts on neuropsychology trainees. For example, trainees continue to be concerned about the impact of lost clinical hours on their professional futures. The most notable of the personal impacts included increased rates of mental health concerns and differential impacts on trainees from ethnoracial minority communities. Recommendations are provided to assist trainees in coping with pandemic-related disruptions.

Clinical neuropsychology in Canada: results from the 2020 AACN, NAN, SCN professional practice and "salary survey"

Objective: The current study summarizes the results of a 2020 survey that solicited information regarding backgrounds, beliefs, practices, and incomes of clinical neuropsychologists who practice in Canada. Methods: Clinical neuropsychologists who practice in Canada were invited to participate in an online survey that was available from 1/17/20 to 4/02/20. Available survey findings were obtained from 111 respondents, which reflects a response rate of 51.3% of the 216 doctoral-level Canadian neuropsychologists identified in at least one major North American or international professional organization membership list (AACN, INS, NAN, or SCN). Results: Most of the current respondents were White/Caucasian women who identified as adult providers and worked full-time in urban institutional settings. Four Canadian provinces (Alberta, British Columbia, Ontario, Quebec) accounted for more than 91% of the current respondent sample. Incomes and career satisfactions were largely encouraging, though some important variations were noted by province, work setting, and professional identity. Incomes were significantly associated with forensic practices and years of clinical experience. Most respondents made use of technician support in their practices, largely to increase productivity and patient volume. Only a small minority of respondents were board-certified and there was generally limited interest in future board certification. Conclusions: While important similarities were observed in the current Canadian sample relative to recent survey findings obtained in a U.S. sample, results also reveal a number of important differences that serve as important areas of future consideration.

Evaluación de la investigación con encuestas en artículos publicados en revistas del área de Biblioteconomía y Documentación

Introducción y objetivo: La investigación con encuestas es un método utilizado con frecuencia en el área de Biblioteconomía y Documentación. El objetivo principal de este estudio es evaluar si los estudios realizados en el ámbito de la Biblioteconomía que utilizan encuestas como método de investigación proporcionan información completa y detallada sobre su diseño y ejecución. Métodos: Se seleccionaron de la base de datos Web of Science los artículos publicados en 2019 en revistas del área de Library Science incluidas en el Journal Citation Reports que empleaban encuestas como método de investigación cuantitativa. Para valorar el grado de cobertura informativa se creó una herramienta formada por 32 elementos utilizados en diversas guías y recomendaciones. Resultados y conclusiones: La mayoría de los artículos basados en encuestas en el área de Biblioteconomía y Documentación presentan una grave deficiencia en la información proporcionada. Es necesario mejorar y completar información sobre el procedimiento de muestreo, desarrollo y administración del cuestionario, así como sobre el análisis de sus resultados. Esta información permitirá valorar los potenciales errores cometidos y, en consecuencia, la calidad y validez de las conclusiones del estudio.

Professional practices, beliefs, and incomes of U.S. neuropsychologists: The AACN, NAN, SCN 2020 practice and "salary survey"

OBJECTIVE

This portion of the 2020 survey updates practice information, beliefs, and income data of clinical neuropsychologists who practice within the United States. Methods: Doctoral-level neuropsychology practitioners were invited via numerous methods, with multiple reminders, to participate in a web-based survey from January 17 through April 2, 2020. The useable U.S. sample of 1677 doctoral-level practitioners was 6.2% larger than the comparable group in the prior 2015 practice survey. Results: Whereas women practitioners predominate, which continues a steeply increasing trend across time, increases in overall ethnic/racial diversity continue at a slow pace. Median age has remained very similar over the last 30 years, reflecting a continuous influx of young practitioners. A relatively small minority of neuropsychologists work part time. The proportion of board-certified neuropsychologists continues to show meaningful increase; interest in subspecialization certification is relatively high. Reliance on technicians remains popular, especially for neuropsychologists who work in institutions or are board certified. Although implementation of new CPT codes in 2019 and related payor policies appear to have had more negative than positive effects, psychology-related annual incomes of neuropsychologists have again increased compared to prior surveys. Variables such as specific work setting, state, region, years in practice, forensic practice hours, board certification, and basis for determining income (e.g. hours billed, revenue collected, relative value units) have an impact on income. More than half of practitioners engage in forensic neuropsychology, with the number of related practice hours per week again increasing. There is very high agreement regarding the use of response validity measures in clinical practice and forensic practice. Neurologists remain the number one referral source whether working in an institution, private practice, or a combination of both, and regardless of maintaining a pediatric, adult, or lifespan practice. Career satisfaction ratings for income, job, and work-life balance remain high, with the majority of ratings regarding the future of the specialty in the positive range. Additional data summaries related to a wide range of professional and practice topics are provided. Conclusions: Updating and comparing survey information at five-year intervals continues to provide insights and perspectives regarding relative stabilities and changes in practice activities, beliefs, and incomes of U.S. clinical neuropsychologists. Such information also provides guidance regarding the future of the specialty.

Neuropsychologists' practice adjustments: The impact of COVID-19

Objective: The field of neuropsychology's response to the COVID-19 pandemic was characterized by a rapid change in clinical practice secondary to physical distancing policies and orders. The current study aimed to further characterize the change in neuropsychologists' professional practice, specifically related to teleneuropsychology (TNP) service provision, and also provide novel data regarding the impact of the pandemic on providers' emotional health. Method: This study surveyed 142 neuropsychologists between 3/30/2020 and 4/10/2020, who worked within a variety of settings (e.g., academic medical centers, general hospitals, Veterans Affairs medical centers, rehabilitation hospitals) across all four U.S. geographic regions. Mixed-model analyses of variance (ANOVAs) were conducted to assess for differences in neuropsychological practice (i.e., total number of patients and proportion of TNP seen per week) across time points (i.e., late February and early April) by practice setting and region. Descriptive statistics were conducted to describe respondents' perceptions of TNP, emotional responses to the pandemic, and perceptions of institutional/employers'/practices' responses. Results: Nearly all respondents (∼98%) reported making practice alterations, with ∼73% providing at least some TNP. Neuropsychologists across all settings and regions reported performing a higher proportion of TNP evaluations by April 2020. On average, respondents reported a medium amount of distress/anxiety related to COVID-19, which had a "somewhat small impact" on their ability to practice overall. Conclusions: The current study further elucidated neuropsychologists' provision of TNP services and offered initial data related to their emotional response to the pandemic. Future research is needed to examine the viability and sustainability of TNP practice.

Professional Practices, Beliefs, and Incomes of Postdoctoral Trainees: The AACN, NAN, SCN 2020 Practice and ‘Salary Survey’

Objective

Within a portion of the 2020 professional practice and “salary survey,” to update key information regarding neuropsychology postdoctoral trainees.

Methods

Postdoctoral trainees were contacted via a variety of membership listings, including the listserv used by the program directors of the Association of Postdoctoral Programs in Clinical Neuropsychology (APPCN). Invitations sent in multiple waves to members of numerous neuropsychological organizations via e-messages and physical postcards included the request that postdoctoral trainees participate. The survey website was opened on January 17, 2020 and closed on April 2, 2020, during which time a total of 178 postdoctoral trainees in the USA and 3 in Canada participated.

Results

Response rate was estimated to be 56.4%, which adequately represents the target sample. The modal postdoctoral trainee is a woman whose internship was American Psychological Association (APA)-accredited and whose postdoctoral training is in an APPCN program that adheres to Houston Conference training guidelines. Extensive clinical experiences in neuropsychology in the form of externship practica and during internship were reported by the majority of trainees prior to postdoctoral training. There are few differences between APPCN and non-APPCN trainees and reported training experiences. Job satisfaction is high. Salaries appear to have increased substantially in recent years. There is universal interest in pursuing board certification. Support for the empirical foundations justifying assessment of response validity is high.

Conclusions

Surveys of postdoctoral trainees continue to provide valuable perspectives regarding training background, clinical experiences, practice beliefs, and incomes of individuals who will soon launch their careers in clinical neuropsychology.

2020 COVID-19 American Academy of Clinical Neuropsychology (AACN) Student Affairs Committee survey of neuropsychology trainees

Objective: To conduct an online survey in order to understand neuropsychology trainees' perspectives during the COVID-19 pandemic and identify pertinent concerns, training gaps, and recommendations.Method: A total of 874 neuropsychology trainees (81% female) completed the 69-item survey. Of the included trainees, 48% were doctoral students, 17% were interns, and 35% were postdoctoral residents (50% of resident respondents were in their first year).Results: The majority of neuropsychology trainees reported some impact of the pandemic on their professional and/or personal life. Overall, the impact did not differ by training level, geographic location, or demographic factors. Trainees' primary professional concerns included uncertainty about the impact of the pandemic on their professional future, loss of clinical hours, and desire for increased and ongoing communication from their leadership. A notable percentage of trainees reported increased personal mental health symptoms (i.e. anxiety/depression; 74%/54%), as well as a number of other personal stressors. Despite the transition to telehealth (mostly interviews/feedback sessions), few trainees have prior training or experience in providing neuropsychological services via phone or video platform. A limited proportion of trainees (approximately 10%) were still seeing patients face-to-face for neuropsychological evaluations during the COVID-19 pandemic as of 14 April 2020.Conclusions: The COVID-19 pandemic is impacting neuropsychological training and the well-being of trainees. This survey highlights the importance of communication with trainees during uncertain times. Based on the survey results, recommendations were developed to assist neuropsychology organizations in developing initiatives to support trainees during the current pandemic and in the future.

Subjective Cognitive Concerns and Attitudes toward Genetic Testing Are Associated with Depressive Symptoms and Quality of Life after Genetic Testing for the Cerebral Cavernous Malformation Common Hispanic Mutation (CCM1)

Purpose

This study aimed to characterize mood and quality of life and to examine the associations of these areas with subjective cognitive concerns and attitudes toward genetic testing for the Common Hispanic Mutation, a gene that has been associated with increased risk for CCM1.

Method

Fifty-four adults with previous genetic testing for the Common Hispanic Mutation completed a mail survey that included assessments of the above identified areas.

Results

Self-reported depressive symptoms and quality of life did not differ between those with positive and negative genetic test results. The negative group expressed a more favorable attitude toward genetic testing (p < 0.001). There was a trend toward more subjective cognitive concerns in the positive group (p = 0.06). Using generalized linear regression, more subjective cognitive concerns were associated with poorer quality of life and more depressive symptoms (p < 0.001). Poorer attitude toward genetic testing was also associated with poorer quality of life (p < 0.05).

Conclusions

Subjective cognitive concerns and negative attitudes toward genetic testing may influence emotional well-being after genetic testing for the Common Hispanic Mutation. Additional research is needed that uses objective neuropsychological measures to understand the associations of subjective cognitive concerns, emotional well-being, and cognitive test performance in individuals with CCM1. There is also a need for research that focuses on protective factors and resiliency following genetic testing for CCM1 and the development of mental health interventions to preempt psychosocial difficulties.