The Performance Diagnostic Checklist-Human Services: A brief review

Improving Human-Service Organizations through Process Mapping: A Tutorial for Practitioners

Developing and improving organizational processes is an important element for staff satisfaction, effective communication, and ultimately the success of an organization (Rummler & Brache, 2013). Human-service organizations are no exception and, in fact, could greatly benefit from process improvement. This article provides guided steps for using process maps as a means for improving processes in human-service organizations.

How to Administer the Performance Diagnostic Checklist-Human Services

The Performance Diagnostic Checklist-Human Services (PDC-HS) is a performance analysis tool used to identify barriers to performance in human-service settings. Multiple published studies have used the PDC-HS to determine effective interventions (Wilder et al. Journal of Applied Behavior Analysis 53(2), 1170-1176, 2020). However, in a recent discussion article proposing guidelines for administering the PDC-HS, Brand et al. Behavior Analysis in Practice, 1-7 (2022) noted that procedural descriptions provided for administering the PDC-HS are somewhat ambiguous in the published literature. The purpose of the current systematic review was to compare methods used to administer the PDC-HS. Fifteen articles met inclusion criteria and were coded to evaluate commonalities among PDC-HS components. Authors generally agreed on how the outcomes of the PDC-HS were depicted and discussed but varied in their descriptions of methods used to administer the PDC-HS. Results are discussed in terms of the importance of technological descriptions and directions for future research towards the development of a more standardized tool.

Supplementary Information

The online version contains supplementary material available at 10.1007/s40617-023-00848-3.

The Performance Diagnostic Checklist-Human Services (1.1): An initial assessment of validity and reliability

The Performance Diagnostic Checklist-Human Services (PDC-HS) is an assessment used to identify variables contributing to staff performance concerns in human-service settings. In the current study, we introduce and assess the test validity, interrater reliability, and test-retest reliability of the PDC-HS (1.1), a revised version of the assessment that included revised instructions, questions, and intervention planning references. We measured the psychometric properties of the revised assessment by analyzing answers obtained from watching video vignettes of simulated interviews between consultants and a supervisor. Twenty-one participants watched the vignettes and completed the PDC-HS (1.1) based on the answers provided during the interview. We also included an item analysis to identify questions on which participants made errors and an intervention selection task to assess whether participants selected an appropriate intervention to target the indicated domain. The results support the use of the PDC-HS (1.1) in human services settings.

Using Direct and Indirect Functional Assessments to Guide the Selection of Individualized Academic Interventions

When teachers work with students exhibiting academic failure, they may look to factors outside of instruction such as a student's home life or perceived disability as explanations. Placing the locus of control outside of the instructional context becomes a convenient way to escape culpability for unsatisfactory outcomes. A more functional approach to addressing academic deficits allows educators to determine environmental factors responsible for the lack of progress and then create interventions designed to address these functions of academic failure. Although experimental analyses serve as the gold standard for evaluating functional relations between behavior and environment, educators may not always have the ability to systematically test all behavior-environment relations. Indirect assessments provide one means to develop hypotheses about environment-behavior relations that can then be validated with experimental analyses. In this study, researchers developed an indirect tool (Academic Diagnostic Checklist - Beta; ADC-B) based on the function of academic performance deficits (Daly et al. in School Psychology Review 26:554, 1997) and validated the use of the ADC-B by comparing interventions that were suggested (indicated) and those non-suggested (contraindicated) by the ADC-B. Researchers used the ADC-B with four participants and found that for three of the four participants, the suggested intervention was the most efficacious at improving accuracy with the target skills. One limitation is that we did not evaluate the full technical adequacy of the ADC-B, which should be a focus of future research.

Supplementary Information

The online version contains supplementary material available at 10.1007/s10864-023-09511-x.

Psychotropic Medication Monitoring in a Human Services Organization for Children with Autism Spectrum Disorder: Description and Evaluation of Interdisciplinary Team Review

Children with autism spectrum disorder (ASD) are often prescribed psychotropic medications but pharmacotherapy is typically conducted and evaluated based on clinical judgement without reference to objective measurement of treatment effectiveness and combined efficacy of pharmacological-behavioral interventions. We describe an interdisciplinary review team (IRT) model at a human services organization for children with ASD that was designed to standardize a process of psychotropic medication monitoring through (1) coordinated involvement of medical, nursing, behavior analyst, and special education professionals, (2) parent-guardian participation, (3) data-driven decision making, and (4) high-level administrative support. Our description includes case illustrations of medication reduction-elimination trials with five students and social validity assessment of IRT clinicians, nurses, and parent-guardians. Key components of the IRT model are emphasized with associated practice and research recommendations.

Data recording of seizures in children with autism spectrum disorder: description and social validation of computer-assisted measurement

Some children with autism spectrum disorder (ASD) experience seizures and associated staring episodes, loss of consciousness, weakened muscle tone, and myoclonic jerking. Data recording of seizure frequency, duration, and co-occurring behavior is necessary to document the effects of anti-epileptic medications, identify contextual influences on seizure expression, and differentiate seizures from other movement disorders. We describe the design and operation of a computer-assisted system for recording seizures among children with ASD in a social validity study that revealed uniform approval and acceptance of the system from practitioners, clinicians, and nurse (N = 22), parents (N = 11), and neurologists (N = 7). The objectives and benefits of targeting the social validity of technology-based seizure tracking are discussed are discussed.

A Sociobehavioral Model of Racism against the Black Community and Avenues for Anti-Racism Research

Sociological researchers have made immense strides in understanding systemic racism, privilege, and bias against Black people. Relational frame theory provides a contemporary account of human language and cognition that intersects within complex external contingency systems that may provide a provisionally adequate model of racial bias and racism. We propose a reticulated model that includes nested relational frames and external contingency systems that operate at the level of the individual (implicit), communities (white privilege), and system policies (systemic racism). This approach is organized from within the framework of critical race theory as an area of sociological scholarship that captures racial disadvantages at multiple levels of organization. We extend this model by describing avenues for future research to inform anti-racism strategies to dismantle this complex and pervasive sociobehavioral phenomenon. At all levels, police violence against the Black community is provided as a case example of negative social impact of racism in our society.

The Performance Diagnostic Checklist - Human Services: Guidance for Assessment Administration

The Performance Diagnostic Checklist - Human Services (PDC-HS) is an assessment designed to assess the environmental variables contributing to employee performance concerns in human-service settings. Recent research has demonstrated that interventions indicated by the PDC-HS result in improved employee performance across several human-service settings and that the assessment has acceptable reliability and validity. Although PDC-HS-indicated interventions have been effective at increasing employee performance, there is a need for additional guidance when using the assessment given the limited nature of the original administration guidelines. Thus, the purpose of the current manuscript is to introduce additional guidance for use of the PDC-HS across a variety of situations.

Behavioral Training and Performance Management of Human Services Organization Care Providers During the COVID-19 Pandemic

Objectives

This report describes a model of training and performance management that was designed for and implemented with care providers at a residential school for children with neurodevelopmental and intellectual disabilities in response to the COVID-19 pandemic. The model focused on health and safety concerns, risk mitigation, and intervention integrity.

Methods

Procedures followed an applied behavior analysis (ABA) and organizational behavior management (OBM) framework. Action plans addressed (a) critical COVID-19 protocols, (b) behavior-specific implementation guidelines, (c) remote and in-person training formats, (d) in vivo supervision, and (e) knowledge and performance assessments.

Results

A competency evaluation (field study) revealed that participant care providers (N = 25) acquired and maintained COVID-19 protocols at near 100% proficiency immediately following and 1-month post-training. Supervisors had uniformly positive approval and acceptance ratings of school responsiveness to the COVID-19 pandemic.

Conclusions

Integrated and evidence-based care provider training and supervisory practices can promote risk mitigation and performance effectiveness during health crises such as the COVID-19 pandemic. More controlled research that includes multiple dependent measures is needed to replicate and extend our findings to similar human services settings.

Increasing adherence to a standardized rounding procedure in two hospital in-patient units

Standardized bedside rounds can improve communication and the quality of care for patients in hospitals. However, it can be challenging to change previously established provider practices to adhere to new procedures. This study evaluated 2 packaged interventions, derived from a modified Performance Diagnostic Checklist interview, to increase adherence to standardized rounding practices in 2 hospital units. Researchers observed physicians at a university hospital on rounds 2-3 times per week, and 2 phases of intervention were implemented to improve adherence. The interventions included task clarification, feedback, and weekly huddles. Compared to baseline, phases 1 and 2 of the intervention improved clinician adherence to the standardized bedside rounding checklist by 24.94% and 30.94% in unit 1 and 26.76% and 44.06% in unit 2, respectively. The standardized rounds did not require additional time following the intervention. These results indicate that physician adherence can be improved through behavioral interventions.

Reducing Response Effort to Improve Employee Preparedness in a Human Service Organization

We examined the effectiveness of reducing response effort and an e-mail prompt for increasing preparedness of 17 therapists for a social skills group in a human services organization. We evaluated whether participants knew the correct lession and sport and whether they felt prepared for the session via a paper survey. The Performance Diagnostic Checklist-Human Services indicated deficiencies in all four domains. The most significant barriers were prompts and access to materials. Results showed that the reduced response effort to access materials and email prompt increased employee preparedness compared to the no e-mail condition.