Worsening of quality of life after epilepsy surgery: Effect of seizures and memory decline

BACKGROUND

Surgery for intractable temporal lobe epilepsy usually controls seizures and improves health-related quality of life (HRQOL), but some patients experience continued seizures, memory decline, or both. The relative impact of these unfavorable outcomes on HRQOL has not been described.

METHODS

We studied seizure control, memory change, and HRQOL among 138 patients in the Multicenter Study of Epilepsy Surgery (MSES), an ongoing, prospective study of epilepsy surgery outcomes. Seizure remission at 2 years and 5 years was prospectively determined based upon regularly scheduled follow-up calls to study patients throughout the follow-up period. HRQOL was assessed annually using the Quality of Life in Epilepsy Inventory (QOLIE-89). Memory decline was determined by change in verbal delayed recall from baseline to the 2- or 5-year follow-up.

RESULTS

HRQOL improved in patients who were in remission at the 2-year or 5-year follow-up, regardless of memory outcome. Among those not in remission at both 2 and 5 years (25/138, 18%), HRQOL remained stable when memory did not decline (14/138, 10%), but HRQOL declined when memory did decline (11/138, 8%). These 11 patients had baseline characteristics predictive of poor seizure or memory outcome. Declines were most apparent on HRQOL subscales assessing memory, role limitations, and limitations in work, driving, and social activities.

CONCLUSIONS

After temporal resection, health-related quality of life (HRQOL) improves or remains stable in seizure-free patients despite memory decline, but HRQOL declines when persistent seizures are accompanied by memory decline. These results may be useful in presurgical counseling and identifying patients at risk for poor psychosocial outcome following surgery.

Referral of terminally ill patients for hospice: frequency and correlates

BACKGROUND

Despite the central role of hospice in end-of-life care, little is known about the proportion of terminally ill patients referred for hospice and the physician factors associated with hospice referral.

METHODS

Cross-sectional data from a self-administered survey of 231 physicians were used to estimate the proportion of terminally ill patients who were referred for hospice and to assess the independent effects of physician factors on hospice referral.

RESULTS

On average, physicians reported referring about 55% of their terminally ill patients for hospice; 26.7% of the physicians referred less than one quarter of their terminally ill patients. Physician specialty, board certification, and physicians' knowledge level about hospice were independently associated with the proportions of terminally ill patients referred for hospice.

CONCLUSION

Many terminally ill patients are not referred for hospice care and physician factors influence the use of hospice significantly. The study suggests effective factors and groups to target with interventions to enhance the appropriate use of hospice.

Validation of the Comprehensive Assessment of Defense Style (CADS): mothers' and children's responses to the stresses of missile attacks

This study furthers the validation of the Comprehensive Assessment of Defense Style (CADS) as a measure of children's defensive behavior. Participants were 81 mothers who assessed the defense style (CADS) of their 8- to 10-year-old children, as well as their own defense style and level of object relations. Five years earlier, the mothers had rated their children's symptom level and personality after the missile attacks during the Gulf War. The original factor structure of the CADS was replicated for the most part. Self-oriented and other-oriented defenses were related to the children's early personality and symptomatic reaction, as well as to their mother's defense style and level of object relations. The CADS factors correlated with the defenses of the Defense Mechanisms Manual. The results provide further validation of the CADS and suggest possible areas of implementation, such as longitudinal examination of defenses, psychopathology screening, and therapeutic improvement.

Assessment of reliability in the clinical evaluation of depressive symptoms among multiple investigators in a multicenter clinical trial

The objective of this work was to determine the severity of depressive symptoms when multiple clinical examiners evaluate a single subject, as preparatory to their participation as evaluators in a clinical trial. Using the 17-item Hamilton Depression Rating Scale (HDRS), 37 psychiatrists independently assessed the videotape of a patient with symptoms of depression. A new measure for the detection of multiple examiners not in consensus (DOMENIC) was used to identify scale items with low reliability and raters with low inter-rater reliability, from among the remaining raters. Overall inter-rater agreement on the full HDRS was 'excellent' (97%). All raters but one showed adequate agreement both on individual items and on total scores. Two of the 17 HDRS symptomatology items had unacceptable levels of inter-rater scoring variability (<70% agreement). The use of DOMENIC allows for the detection of items of low inter-rater reliability and identification of raters that deviate from the group's ratings prior to the beginning of a clinical trial.

The comprehensive assessment of defense style: measuring defense mechanisms in children and adolescents

This study introduces the Comprehensive Assessment of Defense Style (CADS), a new method to assess descriptively the defensive behavior of children and adolescents. Parents of 124 children and adolescents referred to a mental health clinic, of 104 nontreated children, and of 15 children whose fathers were treated for posttraumatic stress disorder completed the CADS. Factor analysis of 28 defenses yielded one mature factor, one immature factor of defenses expressed in relations with the environment (other-oriented), and one of defenses expressed in relations with the self (self-oriented). The CADS significantly discriminated between patients and nonpatients. Psychiatric patients used more immature and fewer mature defenses than control subjects, and adolescents used more mature and fewer other-oriented defenses than children. Girls used more mature and fewer other-oriented defenses than boys. The reliability and validity data of the CADS are encouraging. The three defense factors may be implemented for diagnostic and clinical purposes as well as for screening for psychopathology risk in untreated populations.

Nurses' use of palliative care practices in the acute care setting

This study examines the reported use of palliative care practices by nurses caring for terminally ill patients in the acute care setting. Randomly selected nurses (n = 180) from six randomly selected hospitals in Connecticut completed a self-administered questionnaire. Factors associated with use of palliative care practices were examined by using bivariate and multivariate analyses. Most nurses surveyed (88.5%) reported using palliative care practices when caring for their terminally ill patients. Factors associated with greater use included greater knowledge about hospice, having practiced nursing for less than 10 years, and having had hospice training in the past 5 years. A substantial proportion of nurses reported that they never discuss hospice (51.7 per cent of nurses) and prognosis (26.6 per cent of nurses) with their terminally ill patients. Educational preparation (bachelor's degree versus less education) was not associated with greater use of palliative care practices. Palliative care practices are commonly used by nurses in the acute care setting. However, many report having limited training and substantial gaps in knowledge about hospice among this group of nurses, suggesting greater attention to palliative care and hospice may be warranted in nursing educational programs.

Attitudes about care at the end of life among clinicians: a quick, reliable, and valid assessment instrument

Several initiatives to improve care at the end of life involve educational programs to influence clinicians' attitudes about care for patients with terminal illnesses. The objective of this research was to develop and test a short and easily administered instrument for measuring physicians' and nurses' attitudes towards care at the end of life. The instrument was tested using a cross-sectional study of 50 clinicians (25 physicians and 25 nurses) from general medicine, cardiology, oncology, and geriatric medicine. Both reliability and validity were assessed, and the instrument was found to have acceptable test-retest reliability and construct validity. Such an assessment instrument may be useful in evaluating the impact of initiatives to modify attitudes towards terminal care and in improving the quality of care at the end of life.

A normed study of face recognition in autism and related disorders

Although the interpretation of studies of face recognition in older children, adolescents, and adults with autism is complicated by the fact that participating samples and adopted methodologies vary significantly, there is nevertheless strong evidence indicating processing peculiarities even when task performance is not deficient. Much less is known about face recognition abilities in younger children with autism. This study employed a well-normed task of face recognition to measure this ability in 102 young children with autism, pervasive developmental disorder not otherwise specified (PDDNOS), and non-PDD disorders (mental retardation and language disorders) matched on chronological age and nonverbal mental age, and in a subsample of 51 children divided equally in the same three groups matched on chronological age and verbal mental age. There were pronounced deficits of face recognition in the autistic group relative to the other nonverbally matched and verbally matched groups. Performance on two comparison tasks did not reveal significant differences when verbal ability was adequately controlled. We concluded that young children with autism have face recognition deficits that cannot be attributed to overall cognitive abilities or task demands. In contrast to controls, there was a lower correlation between performance on face recognition and nonverbal intelligence, suggesting that in autism face recognition is less correlated with general cognitive capacity. Contrary to our expectation, children with PDDNOS did not show face recognition deficits.

Season of birth in autism: a fiction revisited

Variations of season of birth among autistic individuals were studied. The replicability of previously reported increases in birth rates in the months of March and August were examined in groups of individuals with autism or mental retardation (the comparison group). The sample was obtained from the Yale Child Study Center Developmental Disabilities Clinic and from the DSM-IV Autism/PDD field trial. Data were analyzed by applying the Jonckheere test of ordinal trend and the chi-square test, with Yates correction factor. With respect to March and August births, and with calculations based on the beginning and middle of the month, no significant seasonal effect was observed. Samples were subcategorized into verbal and mute groups, and again results failed to support the seasonality hypothesis.

Interrater reliability levels of multiple clinical examiners in the evaluation of a schizophrenic patient: quality of life, level of functioning, and neuropsychological symptomatology

Sir Ronald Fisher used a single-subject design to derive the concepts of appropriate research design, randomization, sensitivity, and tests of statistical significance. The seminal work of Broca demonstrated that valid and generalizable findings can and have emerged from studies of a single patient in neuropsychology. In order to assess the reliability and/or validity of any clinical phenomena that derive from single subject research, it becomes necessary to apply appropriate biostatistical methodology. The authors develop just such an approach and apply it successfully to the evaluation of the functioning, quality of life, and neuropsychological symptomatology of a single schizophrenic patient.

Elementary school-age children's developmental understanding of the causes of cancer

This study examines children's conceptual understanding and factual knowledge of the causes of cancer. Using a standardized, developmentally based, semistructured interview (ASK [AIDS (acquired immunodeficiency syndrome) Survey for Kids]), 784 children (43% black, 38% white, and 18% Hispanic; 48% female) in kindergarten through sixth grade attending six public elementary/middle schools in New Haven, Connecticut, were asked open-ended questions about the causes of cancer and, for comparison, the causes of colds and AIDS. Responses were scored for level of conceptual understanding and coded for factual content and factual accuracy. The level of conceptual understanding for causality of cancer increased consistently as grade level increased. When comparisons were made among the illnesses, children's level of conceptual understanding was significantly lower for the causes of cancer than for the causes of colds (p < .0001), but not significantly different from that of AIDS. Although the single most frequent cause of cancer mentioned was cigarettes/smoking (24%), more than one in five students stated that casual contact or contagion was a cause of cancer. More children cited causal contact/contagion than cited the following factually accurate or logically contributory causes combined: poor diet, air/water pollution or overexposure to sun, alcohol, and old age. Slightly more than one half of students in kindergarten through sixth grade worried about getting cancer, and the vast majority (80%) knew that cancer could be fatal. Children have a less sophisticated conceptual understanding of cancer than of colds and a very limited factual knowledge base for cancer, and thus they have the capacity to increase both their understanding and knowledge. These results have implications for the creation of developmentally appropriate cancer prevention curricula for elementary school-age children.

Development of a supplement to the HOME Scale for children living in impoverished urban environments

A Supplement to the HOME (Home Observation for Measurement of the Environment Scale) for impoverished Families (SHIF) was developed for use with young children living in impoverished urban environments. After interviews with clinicians and pilot studies with families, we developed 20 items and added them to the HOME. The supplement was field tested in a sample of 73 high-risk families to evaluate its psychometric properties and ease of use. During the home visit, the Nursing Child Assessment Feeding Scale and the Nursing Child Assessment Teaching Scale were also administered to examine construct validity. Results indicated that the SHIF provided new clinical data, was easy to administer, and, when added to the HOME, had good psychometric properties, e.g., high inter-rater reliability, internal consistency, item-total reliability, and intact construct validity. The SHIF offers a reliable and valid addition to the HOME for use with young children living in impoverished urban environments.

The Yale Preoperative Anxiety Scale: how does it compare with a "gold standard"?

Evaluating the effectiveness of interventions directed toward the treatment of preoperative anxiety in children has been hindered by the absence of a statistically valid measurement tool. In a previous investigation, we developed an instrument (Yale Preoperative Anxiety Scale [YPAS]) that can be used to assess anxiety in children undergoing induction of anesthesia. The purpose of the present investigation was to modify and expand the applicability of the instrument to the preoperative holding area and to validate the modified instrument (m-YPAS) against a recognized "gold standard" (State-Trait Anxiety Inventory for Childrens [STAIC]). Videotapes of children in a preoperative holding area were analyzed by the investigators. The existing five categories of the YPAS were found to reflect most of the behaviors observed. Several items, however, were modified to describe new behaviors observed. Reliability analysis using weighted kappa statistics revealed that inter-observer agreement ranged from 0.68 to 0.86, whereas intraobserver weighted kappa ranged from 0.63 to 0.90. Concurrent validity between the YPAS and the STAIC was acceptable (P = 0.01, r = 0.79). Construct validity was high as assessed by increased m-YPAS scores from the preoperative holding area (28 +/- 8) to entering the operating room (35 +/- 12), to introduction of the anesthesia mask (43 +/- 15;F [1,36] = 0.6, P = 0.001]. Showing good to excellent observer reliability and high concurrent and construct validity, the m-YPAS proved to be an appropriate tool for assessing children's anxiety during the perioperative period.

IMPLICATIONS

The absence of a statistically valid measurement tool that can be applied easily in perioperative settings hinders the evaluation of interventions directed toward treatment of preoperative anxiety in children. The authors describe the development of such a tool, the modified Yale Preoperative Anxiety Scale.

A computer program for assessing interexaminer agreement when multiple ratings are made on a single subject

This report describes a computer program for applying a new statistical method for determining levels of agreement, or reliability, when multiple examiners evaluate a single subject. The statistics that are performed include the following: an overall level of agreement, expressed as a percentage, that takes into account all possible levels of partial agreement; the same statistical approach for deriving a separate level of agreement of every examiner with every other examiner; and tests of the extent to which a giver examiner's rating (say a symptom score of three on a five-category ordinal rating scale) deviates from the group or overall average rating. These deviation scores are interpreted as standard Z statistics. Finally, both statistical and clinical criteria are provided to evaluate levels of interexaminer agreement.

A new method for assessing interexaminer agreement when multiple ratings are made on a single subject: applications to the assessment of neuropsychiatric symtomatology

A new method is introduced for assessing levels of interexaminer agreement when multiple ratings are made on a single subject, with an application in psychiatric research. It is designed to provide an overall level of interexaminer agreement and separate indices of agreement for each examiner. These indices are based on biostatistical and clinical criteria to determine whether the ratings of any given examiner are appreciably higher or lower than the group average, or a consensus diagnosis. A number of examples, from ongoing psychiatric research, are provided to illustrate conditions favoring the application of the new methodology. Finally, the necessary software for performing the analyses is available to clinical investigators with interest in this area of assessment.

Preoperative anxiety in children. Predictors and outcomes

OBJECTIVE

To determine predictors and behavioral outcomes of preoperative anxiety in children undergoing surgery.

DESIGN

A prospective, longitudinal study.

SETTING

A university children's hospital.

PARTICIPANTS

One hundred sixty-three children, 2 to 10 years of age (and their parents), who underwent general anesthesia and elective surgery.

MAIN OUTCOME MEASURES

In the preoperative holding area, anxiety level of the child and parents was determined using self-reported and independent observational measures. At separation to the operating room, the anxiety level of the child and parents was rated again. Postoperative behavioral responses were evaluated 3 times (at 2 weeks, 6 months, and 1 year).

RESULTS

A multiple regression model (R2 = 0.58, F = 6.4, P = .007) revealed that older children and children of anxious parents, who received low Emotionality, Activity, Sociability, and Impulsivity (EASI) ratings for activity, and with a history of poor-quality medical encounters demonstrated higher levels of anxiety in the preoperative holding area. A similar model (R2 = 0.42, F = 8.6, P = .001) revealed that children who received low EASI ratings for activity, with a previous hospitalization, who were not enrolled in day care, and who did not undergo premedication were more anxious at separation to the operating room. Overall, 54% of children exhibited some negative behavioral responses at the 2-week follow-up. Twenty percent of the children continued to demonstrate negative behavior changes at 6-month follow-up, and, in 7.3% of the children, these behaviors persisted at 1-year follow-up. Nightmares, separation anxiety, eating problems, and increased fear of physicians were the most common problems at 2-week follow-up. Multivariate analysis demonstrated that child's age, number of siblings, and immediate preoperative anxiety of the child and mother predicted later behavioral problems.

CONCLUSIONS

Variables such as situational anxiety of the mother, temperament of the child, age of the child, and quality of previous medical encounters predict a child's preoperative anxiety. Although immediate negative behavioral responses develop in a relatively large number of young children following surgery, the magnitude of these changes is limited, and long-term maladaptive behavioral responses develop in only a small minority.

Children's understanding of the symptoms of AIDS

Symptoms are the outward manifestations that allow children to identify and recognize illness; children's understanding of the symptoms of an illness may be directly related to their understanding of its cause or means of transmission. This study is the first empirical investigation of children's conceptual understanding and factual knowledge of the symptoms of AIDS. Children (N = 361; grades K to 6; 57% black, 24% Hispanic, 19% white; 52% female) attending four public schools in New Haven, Connecticut, were interviewed using a standardized semistructured interview (ASK, AIDS Survey for Kids) that included open-ended questions about the symptoms of AIDS and, for comparison, cancer and colds. Responses were scored for level of conceptual understanding and coded for factual content. For each illness, grade level was the variable most strongly correlated with symptomatology concept score (R = .42-.48, p < .0001) and contributed significantly (p < .0001) to the variance observed in concept score even after controlling for race, gender, verbal fluency, and socioeconomic status. The mean concept score was lower (p < .01) for symptomatology of AIDS (2.8 of possible 5) than for cancer (3.1) or colds (3.9). In addition, far more symptoms were named for colds than for either cancer or AIDS. Children who believed that HIV is spread via each of five potential means of transmission by casual contact were more likely (p < 01) to cite cold symptoms as symptoms of AIDS. We conclude that there exists a developmental progression in children's understanding of the symptomatology of AIDS. Children have a less sophisticated conceptual understanding and narrower factual knowledge base for AIDS than for colds and therefore have the capability to increase their understanding and knowledge about AIDS. Furthermore, improving children's understanding of the symptoms of AIDS may diminish misconceptions about transmission of HIV via casual contact.

Improving participation and interrater agreement in scoring Ambulatory Pediatric Association abstracts. How well have we succeeded?

OBJECTIVE

To determine whether increasing the number and types of raters affected interrater agreement in scoring abstracts submitted to the Ambulatory Pediatric Association.

METHODS

In 1990, all abstracts were rated by each of the 11 members of the board of directors of the Ambulatory Pediatric Association. In 1995, abstracts were reviewed by four to five raters, including eight members of the board of directors, two chairpersons of special interest groups, and 10 regional chairpersons, for a total of 20 potential reviewers. Submissions were divided into the following three categories for review: emergency medicine, behavioral pediatrics, and general pediatrics. Weighted percentage agreement and weighted kappa scores were computed for 1990 and 1995 abstract scores.

RESULTS

Between 1990 and 1995, the number of abstracts submitted to the Ambulatory Pediatric Association increased from 246 to 407, the number of reviewers increased from 11 to 20, the weighted percentage agreement between raters remained approximately 79%, and weighted kappa scores remained less than 0.25. Agreement was not significantly better for the emergency medicine and behavioral pediatrics abstracts than for general pediatrics, nor was it better for the raters who reviewed fewer abstracts than those who reviewed many.

CONCLUSIONS

The number and expertise of those rating abstracts increased from 1990 to 1995. However, interrater agreement did not change and remained low. Further efforts are needed to improve the interrater agreement.

Test-retest reliability for false-belief tasks

Despite notable variations in children's rate of success on theory of mind tasks and the presumed theoretical implications drawn from a child's success or failure on such tasks, there have been no studies of the test-retest reliability of children's performance on these tasks. Twenty-three children (mean age 49.6 months, SD 8.6) watched three videotaped stories illustrating a false-belief situation: the standard experimenter narrated false-belief task, a minor variant replacing the narration of the story with a dialogue among the characters, and a third version involving a humorous situation. The time elapsed between test and retest was 2-3 weeks and the order of presentation was counterbalanced. Results corroborated previous findings of a developmental trend in the understanding of false-belief questions but, despite a general improvement in children's comprehension of the stories, the test-retest reliability for the false belief questions was poor. Although changes recorded between test-retest sessions frequently occurred in the direction of children answering correctly questions they had previously failed, a subset of children incorrectly answered questions they had initially passed. These findings underscore the need for validation assessments of techniques for studying children's developing theories of mind.

Validity and neuropsychological characterization of Asperger syndrome: convergence with nonverbal learning disabilities syndrome

The authors investigated the validity of Asperger Syndrome (AS) by comparing the neuropsychological profiles in this condition and Higher-Functioning Autism (HFA). Diagnostic assignment followed a stringent procedure based on ICD-10 research criteria for the two disorders. The groups had comparable age and Full Scale IQ distributions. The groups differed significantly in 11 neuropsychological areas. The profile obtained for individuals with AS coincided closely with a cluster of neuropsychological assets and deficits captured by the term nonverbal learning disabilities, suggesting an empirical distinction from HFA.

Screening for lead poisoning by fingerstick in suburban pediatric practices

OBJECTIVE

To assess the false-positive rate of blood lead determinations on samples obtained by fingerstick from children screened in private suburban and rural practices.

METHODS

Screening capillary lead samples were obtained by fingerstick; children with capillary lead levels of 0.7 mumol/L (15 micrograms/dL) or greater were recalled for a confirmatory venous lead test that served as the criterion standard. Parents completed a five-question risk assessment questionnaire at the time of initial screening.

SETTING

Four private suburban to rural practices that serve predominantly white, middle-class populations.

PARTICIPANTS

Children seen for routine care between August 1992 and February 1993 (N = 1085; 98% between 6 months and 6 years of age).

RESULTS

Capillary lead level was 0.7 mumol/L (15 micrograms/dL) or greater in 35 children (3% of total sample); venous lead samples were obtained in 30 patients. Nine of the elevated capillary lead results were true-positives (venous lead = 0.7, 0.8, 0.8, 0.9, 0.9, 0.9, 1.1, 1.1, and 1.7 mumol/L [15, 17, 17, 18, 18, 18, 22, 22, and 35 micrograms/dL]); parents of only two of these children answered yes to any question on the risk assessment questionnaire. Although the false-positive rate of the capillary lead screening test was 70% (21/30) in this setting, only 2% of the total sample had a false-positive screening test (an average of fewer than one false-positive per month per practice). Screening by fingerstick allowed phlebotomy to be avoided for 97% of the children.

CONCLUSION

Fingerstick screening for lead poisoning is a reasonable alternative to direct venous testing within private suburban and rural practices, provided that care is taken to avoid specimen contamination, that appropriate caution is used in the interpretation of screening test results, and that medical and environmental interventions are based on the results of confirmatory venous testing.

The accuracy of children's reports with anatomically correct dolls

The accuracy of children's reports of alleged sexual abuse during interviews with anatomically correct dolls is the focus of considerable controversy. This study used an analog experience to measure empirically the accuracy of reports in a relevant, but controlled setting: the forensic medical examination for suspected sexual abuse. Twenty-one 3- to 7-year-old children were interviewed about what occurred during previous examinations with open-ended questions, open-ended questions with anatomically correct dolls, and direct questions with the dolls. Children provided significantly more accurate reports and fewer omissions with direct questions using the dolls compared with either of the two open-ended sections, but there was no significant difference in the number of false reports across the three sections of the interview. These results suggest that anatomically correct dolls may bolster the recall of children's memory in the setting of direct questions without prompting false reports.

A randomized, controlled trial of a school-based, multi-faceted AIDS education program in the elementary grades: the impact on comprehension, knowledge and fears

OBJECTIVE

Several educational theorists have suggested that young children are unlikely to benefit from detailed instruction regarding AIDS prevention because of inherent developmental cognitive limitations. This study aims to determine whether AIDS education in the elementary grades can advance young children's understanding of this illness.

METHODS

A randomized, controlled trial was used to measure the impact of a 3-week, multifaceted AIDS education program on conceptual understanding, factual knowledge, and fears about AIDS in 189 students in grades kindergarten through 6th. The ASK (AIDS Survey for Kids), a standardized, semistructured interview that measures conceptual understanding, factual information, and fears about AIDS, was administered before and after the intervention.

RESULTS

Children in the intervention group, as compared to those in the control group, showed significant (P < .0001) gains in their level of understanding of the concepts of causality and prevention of AIDS. These results were unaffected by controlling for grade, gender, race, socioeconomic status, and verbal fluency. The gains in children's understanding of causality of AIDS represented at least 2 years' growth in the level of conceptual sophistication and persisted at a follow-up evaluation several months later. After the intervention, more children (P < .001) in the intervention group than in the control group accurately identified causes of AIDS in response to open-ended questions: germ/germ theory (41% vs 13%), mother-to-infant transmission (54% vs 15%), blood transmission (83% vs 40%), and sexual transmission (56% vs 30%). Fewer than half as many children in the intervention group responded incorrectly to each of five direct questions about transmission of HIV through casual contact. The intervention did not increase children's fears about the illness.

CONCLUSIONS

A short, developmentally based, multifaceted AIDS education program in the elementary grades can advance children's conceptual understanding and factual knowledge about AIDS and decrease their misconceptions about casual contact as a means of acquiring the illness, without increasing their fears. Significant advances in conceptual understanding about AIDS can be achieved through direct educational interventions.

Field trial for autistic disorder in DSM-IV

OBJECTIVE

This project focused on the development of the definition of autism for DSM-IV.

METHOD

Multiple sites were involved in obtaining information regarding 977 patients with the following clinician-assigned diagnoses: autism (N = 454), other pervasive developmental disorders (N = 240), and other disorders (N = 283). A standard coding system was used, and the raters (N = 125) had a range of experience in the diagnosis of autism. Patterns of agreement among existing diagnostic systems were examined, as was the rationale for inclusion of other disorders within the class of pervasive developmental disorders.

RESULTS

The DSM-III-R definition of autism was found to be overly broad. The proposed ICD-10 definition most closely approximated the clinicians' diagnoses. Inclusion of other disorders within pervasive developmental disorders appeared justified. Partly on the basis of these data, modifications in the ICD-10 definition were made; this and the DSM-IV definition are conceptually identical.

CONCLUSIONS

The resulting convergence of the DSM-IV and ICD-10 systems should facilitate both research and clinical service.

Screening for lead poisoning in an urban pediatric clinic using samples obtained by fingerstick

OBJECTIVE

To assess the false positive rate of blood lead (BPb) determinations on samples obtained by fingerstick from children screened in an urban clinic.

METHOD

From a single fingerstick (N = 1573), blood was collected in a capillary tube for determining lead concentration (CPb) by graphite furnace and an additional sample was absorbed onto a filter paper for determining lead concentration (FPb) by atomic absorption spectrophotometry with Delves cup. Zinc protoporphyrin (ZPP) was measured immediately and a confirmatory venous lead (VPb) specimen was obtained at the same visit if the ZPP was > or = 35 micrograms/dL (0.6 mumol/L); children with either a CPb or FPb > or = 15 micrograms/dL (0.7 mumol/L) were later recalled for determining VPb.

RESULTS

For the 172 children who had a VPb on the same day as the screening tests, the false positive rates (95% confidence intervals) at a lead threshold of 15 micrograms/dL (0.7 mumol/L) were: CPb, 13.5% (6.7-20.3); FPb, 19.1% (11.8-26.4). Analyses using all 679 screens with a paired venous specimen (mean delay between screen and venous testing = 30 days) yielded much higher false positive rates (CPb, 31.3%; FPb, 46.0%).

CONCLUSIONS

Screening for lead poisoning is feasible within an urban pediatric clinic by direct measurement of lead concentration in blood samples obtained by fingerstick. The false positive rate that can be obtained is acceptable given the precision of measuring BPb concentration. Practitioners using a staged screening protocol may incorrectly attribute a higher false positive rate to the screening tests, when much of the error may be due to the temporal variability of BPb resulting from both biologic variability in BPb concentration and intermittent exposures.

Re-examining threats to the reliability and validity of putative brain-behavior relationships: new guidelines for assessing the effect of patients lost to follow-up

It often happens in behavioral and biomedical research that subjects in prospective, multiple assessment investigations, including clinical trials, are lost to follow-up evaluations. The purpose of this report is to outline a model that will enable the investigators to determine the extent to which results based upon the maintained cohort can be generalized to the attrited cohort, or those subjects lost to follow-up. While our proposed model derives from a specific application pertaining to changes in personality and affect behaviors following left and right hemisphere stroke, it should apply, with appropriate study-specific modifications, to a wide range of follow-up research designs in neuropsychology, behavioral science more generally, and other areas of biomedical research.

Multiple comparison methods: establishing guidelines for their valid application in neuropsychological research

This comment serves to provide a rationale for research clinical neuropsychologists to decide: (1) under what conditions multiple comparison methods are required; and (2) what specific guidelines can be used to distinguish conditions favoring a given multiple comparison technique over its competitors. The topic is discussed both for the parametric and nonparametric case, as well as for post hoc tests following both statistically significant main effects and interactions.

Understanding of acquired immunodeficiency syndrome by elementary school children--a developmental survey

OBJECTIVES

The developmental process by which young children acquire an understanding of the concepts of causality, treatment, and prevention of illness as related to acquired immunodeficiency syndrome (AIDS) is poorly understood. Previous studies have focused on adolescent populations and have measured the facts that children seem to know rather than their understanding of relevant concepts. Such approaches are likely to overestimate the child's true level of understanding and obscure significant misconceptions. The aims of this project are to measure directly the level of understanding of the concepts of causality, treatment, and prevention of AIDS in healthy, elementary school children and to assess the sociodemographic variables associated with their conceptual understanding.

METHODS

Using a new, developmentally based, semistructured interview protocol (ASK, AIDS Survey for Kids), 361 children (57% black, 24% Hispanic, 19% white) in kindergarten through sixth grade at four public schools in New Haven, CT were interviewed. Responses to questions about causality, treatment, and prevention were scored for each of three illnesses (AIDS, and for comparison, colds and cancer) based on the level of conceptual sophistication of the response, irrespective of its factual accuracy.

RESULTS

Scores for each of the concepts were highly intercorrelated and were correlated most strongly with grade level (R = .31 to .50, P < .0001 for each of these correlations, with the exception of the treatment of AIDS). Gender, race, and socioeconomic status did not contribute significantly to the variance observed for any of the concept scores in a linear regression model. Over-all, children's level of understanding of causality was significantly less sophisticated for AIDS than for colds (P < .0001); their level of conceptual understanding for the causality of AIDS was not significantly different from that of cancer (P = .9).

CONCLUSIONS

Children's understanding of causality, treatment, and prevention of AIDS, as measured by the ASK, follows the same developmental sequence reported for children's understanding of general physical illness. Sociodemographic variables, such as race, gender, and socioeconomic status do not affect children's level of sophistication of these developmental concepts. These results have implications for the creation of developmentally appropriate and effective AIDS education curricula for primary and elementary grades. They also offer guidance to health care providers in their efforts to educate parents and young children about this important topic.

Quantifying social development in autism

OBJECTIVE

This study was concerned with the development of quantitative measures of social development in autism.

METHOD

Multiple regression equations predicting social, communicative, and daily living skills on the Vineland Adaptive Behavior Scales were derived from a large, normative sample and applied to groups of autistic and nonautistic, developmentally disordered children. Predictive models included either mental or chronological age and other relevant variables.

RESULTS

Social skills in the autistic group were more than two standard deviations below those predicted by their mental age; an index derived from the ratio of actual to predicted social skills correctly classified 94% of the autistic and 92% of the nonautistic, developmentally disordered cases.

CONCLUSIONS

The findings are consistent with the idea that social disturbance is central in the definition of autism. The approach used in this study has potential advantages for providing more precise measures of social development in autism.

Three diagnostic systems for autism: DSM-III, DSM-III-R, and ICD-10

ICD-10 draft research criteria for childhood autism were applied to a previously published data set comparing DSM-III and DSM-III-R to clinicians' diagnoses of autism. The ICD-10 approach paralleled clinicians' patterns of diagnosis and, to a lesser extent, the DSM-III system. Relative to either clinicians, DSM-III, or ICD-10 the DSM-III-R system overdiagnosed the presence of autism. Implications for research and for future revision of diagnostic criteria are discussed.

Assessing the reliability of clinical scales when the data have both nominal and ordinal features: proposed guidelines for neuropsychological assessments

The purpose of this article is to present, for the first time, a comprehensive methodology for assessing the reliability of a clinical scale that is frequently utilized in neuropsychological research and in biomedical studies, more generally. The dichotomous-ordinal scale is characterized by a single category of "absence" and two or more ordinalized categories of "presence" of a symptom trait, state, or behavior, and it also has special properties that need to be understood in order for its reliability to be appropriately assessed. Using the Brief Psychiatric Rating Scale (BPRS) as a clinical example, we cover the principles of expressing scale reliability in terms of a dichotomy ("absence" - "presence" of a given BPRS symptom); as a trichotomy ("none"; "mild to moderate" symptomatology; and "severe" symptomatology); and as the full 7-category dichotomous-ordinal scale: "none," "very mild," "mild," "moderate," "moderately severe," "severe," and "extremely severe." Criteria are presented that can be used to evaluate which of these three formats produces the most reliable results. Finally, we address, with a second sample, the important issue of replication, or whether the original reliability findings generalize to other independent populations.

The outpatient treatment of depression. Implications of outcome research for clinical practice

Multiple studies have demonstrated that individual psychotherapy, pharmacotherapy, and the two in combination are all effective treatments for depressed outpatients. However, the implications of these data for clinical practice have been incompletely considered, and the often drawn mistaken conclusion is that they support routine treatment with psychotherapy and pharmacotherapy together. Analyses of treatment success rates, treatment failure rates, and treatment dropout rates indicate that combined treatment offers no advantage over treatment with psychotherapy alone and only modest advantage over treatment with pharmacotherapy alone. Routine use of combined treatment, therefore, exposes patients to unnecessary costs and side effects. The data suggest that psychotherapy alone should usually be the initial treatment.

Demographic, clinical, and psychosocial predictors of the reliability of mothers' clinical judgments

The purpose of this study was to investigate to what extent selected adverse demographic, clinical, and psychosocial data measured at the 2-week well child visit could predict poorer reliability of mothers' judgments during acute illness episodes over the next 32 months. The study was a randomized trial of the Acute Illness Observation Scales (AIOS); 369 mothers participated, 183 in the intervention group using the Acute Illness Observation Scales and 186 in the control group using a three-point global assessment scale. There were 704 acute illnesses judged simultaneously and independently by mothers and pediatricians. Standard Pearson r correlations were performed between the independent variables, taken singly and in all possible combinations, and the dependent variable, reliability of mothers' judgments as measured by weighted kappa (kappa W). Group assignment was entered as an independent variable. Analyses were performed separately for all first, second, and third acute illness visits to control for any "practice effect" (analysis 1). To control for consistency of observers, the first, second, and third visits of mothers with three visits were also analyzed (analysis 2). Depending on the visit number, adverse demographic, clinical, and psychosocial characteristics did correlate with poorer reliability independent of group assignment. The correlations ranged from small (analysis 1, first visit, multiple variable r2 = 4%) to large (analysis 2, second visit, multiple variable r2 = 29%). Controlling for both visit number and consistency of observers vs visit number alone (analysis 2 vs analysis 1) increased multivariate correlations to kappa W. The results support the untoward impact that adverse demographic, clinical, and psychosocial factors have on mothers' clinical judgment. These data may assist pediatricians in identifying parents who might benefit from more intensive teaching and support about acute illness episodes in their children.

Establishing the reliability and validity of neuropsychological disorders with low base rates: some recommended guidelines

The issues of low prevalence in the context of the diagnosis of neuropsychological disorders in the larger community is discussed. Guidelines are proposed for producing reliability and validity estimates which are clinically, as well as statistically meaningful.

Observer variability in echo-Doppler measurements of portal flow in cirrhotic patients and normal volunteers

The intraobserver and interobserver variability in measuring the portal vein flow by the echo-Doppler technique was evaluated in a blind controlled study. A total of 22 cirrhotic patients and 14 normal volunteers were examined by two skilled operators using duplex Doppler within a period of 1-3 mo (6 cirrhotics and 7 normal volunteers by both observers). Area, mean velocity, and flow were measured (4 measurements: A, B on day 1; C, D on day 2). The intraclass correlation coefficient was used to assess both the statistical and clinical significance of intraobserver and interobserver agreement for the measurements of these three parameters. The level of intraobserver agreement for each parameter on normal subjects and cirrhotics was obtained from the two measurements on the same day and from the two measurements at the same time on consecutive days. Overall agreement between the four measurements was also calculated. Levels of interobserver agreement were obtained by calculating separately the intraclass correlation coefficient from each of the four pairs by measurements made on the same subject by the two observers over the same period of 2 days. The coefficient of variation was also used to compare the variability in these measurements. Overall, intraobserver agreement on normal subjects varied from good to excellent for observer 1, and from fair to good for observer 2. On cirrhotic patients, observer 1 was excellent at all times for all parameters. Observer 2 had lower intraclass correlation coefficient values, especially for velocity on consecutive days. For the best of the two observers on the portal flow, the coefficient of variation in cirrhotic patients ranged from 2%-30% with a mean +/- SEM of 12% +/- 4%. No acceptable interobserver agreement was found between the two observers in either of the two samples of subjects. These results support the use of this technique mainly for the determination of rapid and large changes in portal hemodynamics within a short period of time. The technique seems to have low precision in monitoring chronic changes in portal hemodynamics.

Mothers' clinical judgment: a randomized trial of the Acute Illness Observation Scales

The purpose of this study was to investigate whether the reliability, sensitivity, and specificity of mothers' judgments about acute illnesses in their children could be improved by using the Acute Illness Observation Scales (AIOS). At the 2-week well child care visit in a primary care center and a private practice, 369 mothers were divided at random into an intervention group (n = 183) and a control group (n = 186). A teaching film and booklet were used to educate mothers in the intervention group about the AIOS; control group mothers were taught a 3-point global scoring system for evaluating the chance of serious illness. In the 32 months of follow-up, 704 acute illnesses were evaluated in tandem and independently by mothers and pediatricians before the history and physical examination; 20 of these illnesses were serious. The judgments of the intervention group were more reliable than those of the control group (weighted kappa = 0.50 vs 0.26, respectively), as was the specificity of their judgments (85% vs 52%, respectively; p less than 0.0001). No difference was noted in the sensitivity of intervention group and control group mothers' judgments (80% vs 90%, respectively). Teaching parents to assess specific clinical information, as represented in the AIOS, has its greatest effect on the reliability and specificity, not the sensitivity, of their judgments. Such teaching could lead to fewer unnecessary office visits during acute illnesses.

High agreement but low kappa: I. The problems of two paradoxes

In a fourfold table showing binary agreement of two observers, the observed proportion of agreement, p0, can be paradoxically altered by the chance-corrected ratio that creates kappa as an index of concordance. In one paradox, a high value of p0 can be drastically lowered by a substantial imbalance in the table's marginal totals either vertically or horizontally. In the second pardox, kappa will be higher with an asymmetrical rather than symmetrical imbalanced in marginal totals, and with imperfect rather than perfect symmetry in the imbalance. An adjustment that substitutes kappa max for kappa does not repair either problem, and seems to make the second one worse.

The Structured Clinical Interview for DSM-III-R Dissociative Disorders: preliminary report on a new diagnostic instrument

The authors describe the Structured Clinical Interview for DSM-III-R Dissociative Disorders (SCID-D), which investigates five groups of dissociative symptoms (amnesia, depersonalization, derealization, identity confusion, and identity alteration) and systematically rates both the severity of individual symptoms and the evaluation of overall diagnosis of dissociative disorder. Preliminary findings from a study of 48 subjects with and without psychiatric diagnoses indicate good to excellent reliability and discriminant validity for the SCID-D as a diagnostic instrument for the five dissociative disorders and as a tool for the evaluation of dissociative symptoms encountered within nondissociative syndromes.

High agreement but low kappa: II. Resolving the paradoxes

An omnibus index offers a single summary expression for a fourfold table of binary concordance among two observers. Among the available other omnibus indexes, none offers a satisfactory solution for the paradoxes that occur with p0 and kappa. The problem can be avoided only by using ppos and pneg as two separate indexes of proportionate agreement in the observers' positive and negative decisions. These two indexes, which are analogous to sensitivity and specificity for concordance in a diagnostic marker test, create the paradoxes formed when the chance correction in kappa is calculated as a product of the increment in the two indexes and the increment in marginal totals. If only a single omnibus index is used to compared different performances in observer variability, the paradoxes of kappa are desirable since they appropriately "penalize" inequalities in ppos and pneg. For better understanding of results and for planning improvements in the observers' performance, however, the omnibus value of kappa should always be accompanied by separate individual values of ppos and pneg.

Blood cultures in private pediatric practice: an eleven-year experience

We describe an 11-year experience with bacteremia in a two-physician suburban private pediatric practice. Patients studied were ages 3 to 24 months with a body temperature of greater than or equal to 39.4 degrees C and nonfocal illness. During these 11 years, 23 such babies had bacteremia, 21 with Streptococcus pneumoniae. Three risk factors for bacteremia were identified: absolute neutrophil counts greater than or equal to 10,500/microliters; cool season (November to April), and Yale observation score greater than 10. The positive predictive values for bacteremia were 33, 41 and 57%, respectively, when (1) absolute neutrophil count was greater than or equal to 10,500, (2) absolute neutrophil count was greater than or equal to 10,500 and it was the cool season, and (3) all 3 risk factors existed. Of 158 babies at low risk for bacteremia by these criteria, none was treated and none developed serious complications of bacteremia. Eight of the 23 bacteremic infants received no expectant antibiotic therapy and 15 received presumptive amoxicillin treatment in dosages ranging from 20 to 174 mg/kg/day. Twelve bacteremic infants either were not treated or received dosages of 100 mg/kg/day or less; complications developed in 5 of the 12 (persistent bacteremia, 2; facial cellulitis, 3). The remaining 11 bacteremic babies received approximately 150 mg/kg/day (range, 136 to 174) and none had complications (P = 0.03 by Fisher's exact test). The costs of identifying and treating infants suspected of having possible occult bacteremia were examined.

DSM-III and DSM-III-R diagnoses of autism

The authors examined the reliability, sensitivity, and specificity of DSM-III and DSM-III-R criteria for autism in relation to each other and to clinical diagnoses in 114 children and adults (52 diagnosed by clinicians' best judgment as autistic and 62 as nonautistic but developmentally disordered). They used a standard, structured coding scheme to evaluate each patient. The reliability of specific criteria was generally high. Although DSM-III criteria were highly specific, they were less sensitive; the reverse was true for DSM-III-R. The authors conclude that the diagnostic concept of autism in DSM-III-R appears to have been substantially broadened.