1
|
Nascimento FA, Jing J, Traner C, Kong WY, Olandoski M, Kapur S, Duhaime E, Strowd R, Moeller J, Westover MB. A randomized controlled educational pilot trial of interictal epileptiform discharge identification for neurology residents. Epileptic Disord 2024; 26:444-459. [PMID: 38669007 PMCID: PMC11329359 DOI: 10.1002/epd2.20229] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2023] [Revised: 03/30/2024] [Accepted: 04/10/2024] [Indexed: 05/19/2024]
Abstract
OBJECTIVE To assess the effectiveness of an educational program leveraging technology-enhanced learning and retrieval practice to teach trainees how to correctly identify interictal epileptiform discharges (IEDs). METHODS This was a bi-institutional prospective randomized controlled educational trial involving junior neurology residents. The intervention consisted of three video tutorials focused on the six IFCN criteria for IED identification and rating 500 candidate IEDs with instant feedback either on a web browser (intervention 1) or an iOS app (intervention 2). The control group underwent no educational intervention ("inactive control"). All residents completed a survey and a test at the onset and offset of the study. Performance metrics were calculated for each participant. RESULTS Twenty-one residents completed the study: control (n = 8); intervention 1 (n = 6); intervention 2 (n = 7). All but two had no prior EEG experience. Intervention 1 residents improved from baseline (mean) in multiple metrics including AUC (.74; .85; p < .05), sensitivity (.53; .75; p < .05), and level of confidence (LOC) in identifying IEDs/committing patients to therapy (1.33; 2.33; p < .05). Intervention 2 residents improved in multiple metrics including AUC (.81; .86; p < .05) and LOC in identifying IEDs (2.00; 3.14; p < .05) and spike-wave discharges (2.00; 3.14; p < .05). Controls had no significant improvements in any measure. SIGNIFICANCE This program led to significant subjective and objective improvements in IED identification. Rating candidate IEDs with instant feedback on a web browser (intervention 1) generated greater objective improvement in comparison to rating candidate IEDs on an iOS app (intervention 2). This program can complement trainee education concerning IED identification.
Collapse
Affiliation(s)
- Fábio A. Nascimento
- Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
- Department of Neurology, Washington University School of Medicine, St. Louis, MO, USA
| | - Jin Jing
- Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
- Department of Neurology, Beth Israel Deaconess Medical Center, Boston, MA, USA
| | | | - Wan Yee Kong
- Department of Neurology, Beth Israel Deaconess Medical Center, Boston, MA, USA
| | - Marcia Olandoski
- School of Medicine, Pontifícia Universidade Católica do Paraná, Curitiba, PR, Brazil
| | | | | | - Roy Strowd
- Department of Neurology, Wake Forest University School of Medicine, Winston-Salem, NC, USA
| | - Jeremy Moeller
- Department of Neurology, Yale School of Medicine, New Haven, CT, USA
| | - M. Brandon Westover
- Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
- Department of Neurology, Beth Israel Deaconess Medical Center, Boston, MA, USA
| |
Collapse
|
2
|
Greenblatt AS, Beniczky S, Nascimento FA. Pitfalls in scalp EEG: Current obstacles and future directions. Epilepsy Behav 2023; 149:109500. [PMID: 37931388 DOI: 10.1016/j.yebeh.2023.109500] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/02/2023] [Revised: 10/15/2023] [Accepted: 10/17/2023] [Indexed: 11/08/2023]
Abstract
Although electroencephalography (EEG) serves a critical role in the evaluation and management of seizure disorders, it is commonly misinterpreted, resulting in avoidable medical, social, and financial burdens to patients and health care systems. Overinterpretation of sharply contoured transient waveforms as being representative of interictal epileptiform abnormalities lies at the core of this problem. However, the magnitude of these errors is amplified by the high prevalence of paroxysmal events exhibited in clinical practice that compel investigation with EEG. Neurology training programs, which vary considerably both in the degree of exposure to EEG and the composition of EEG didactics, have not effectively addressed this widespread issue. Implementation of competency-based curricula in lieu of traditional educational approaches may enhance proficiency in EEG interpretation amongst general neurologists in the absence of formal subspecialty training. Efforts in this regard have led to the development of a systematic, high-fidelity approach to the interpretation of epileptiform discharges that is readily employable across medical centers. Additionally, machine learning techniques hold promise for accelerating accurate and reliable EEG interpretation, particularly in settings where subspecialty interpretive EEG services are not readily available. This review highlights common diagnostic errors in EEG interpretation, limitations in current educational paradigms, and initiatives aimed at resolving these challenges.
Collapse
Affiliation(s)
- Adam S Greenblatt
- Department of Neurology, Washington University School of Medicine, St. Louis, MO, USA
| | - Sándor Beniczky
- Department of Clinical Neurophysiology, Danish Epilepsy Center, Dianalund and Aarhus University Hospital, Department of Clinical Medicine, Aarhus University, Aarhus, Denmark
| | - Fábio A Nascimento
- Department of Neurology, Washington University School of Medicine, St. Louis, MO, USA.
| |
Collapse
|
3
|
Aanestad E, Gilhus NE, Olberg HK, Kural MA, Beniczky S, Brogger J. Spike count and morphology in the classification of epileptiform discharges. Front Neurol 2023; 14:1165592. [PMID: 37288067 PMCID: PMC10242725 DOI: 10.3389/fneur.2023.1165592] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2023] [Accepted: 04/24/2023] [Indexed: 06/09/2023] Open
Abstract
Purpose The purpose of this study is to investigate the impact of Bergen Epileptiform Morphology Score (BEMS) and interictal epileptiform discharge (IED) candidate count in EEG classification. Methods We included 400 consecutive patients from a clinical SCORE EEG database during 2013-2017 who had focal sharp discharges in their EEG, but no previous diagnosis of epilepsy. Three blinded EEG readers marked all IED candidates. BEMS and IED candidate counts were combined to classify EEGs as epileptiform or non-epileptiform. Diagnostic performance was assessed and then validated in an external dataset. Results Interictal epileptiform discharge (IED) candidate count and BEMS were moderately correlated. The optimal criteria to classify an EEG as epileptiform were either one spike at BEMS > = 58, two at > = 47, or seven at > = 36. These criteria had almost perfect inter-rater reliability (Gwet's AC1 0.96), reasonable sensitivity of 56-64%, and high specificity of 98-99%. The sensitivity was 27-37%, and the specificity was 93-97% for a follow-up diagnosis of epilepsy. In the external dataset, the sensitivity for an epileptiform EEG was 60-70%, and the specificity was 90-93%. Conclusion Quantified EEG spike morphology (BEMS) and IED candidate count can be combined to classify an EEG as epileptiform with high reliability but with lower sensitivity than regular visual EEG review.
Collapse
Affiliation(s)
- Eivind Aanestad
- Department of Clinical Neurophysiology, Haukeland University Hospital, Bergen, Norway
- Department of Clinical Medicine, University of Bergen, Bergen, Norway
| | - Nils Erik Gilhus
- Department of Clinical Medicine, University of Bergen, Bergen, Norway
- Department of Neurology, Haukeland University Hospital, Bergen, Norway
| | - Henning Kristian Olberg
- Department of Clinical Neurophysiology, Haukeland University Hospital, Bergen, Norway
- Department of Clinical Medicine, University of Bergen, Bergen, Norway
| | - Mustafa Aykut Kural
- Department of Clinical Neurophysiology, Danish Epilepsy Centre Filadelfia, Dianalund, Denmark
- Department of Clinical Neurophysiology, Aarhus University Hospital, Aarhus, Denmark
- Department of Clinical Medicine, Aarhus University, Aarhus, Denmark
| | - Sándor Beniczky
- Department of Clinical Neurophysiology, Danish Epilepsy Centre Filadelfia, Dianalund, Denmark
- Department of Clinical Neurophysiology, Aarhus University Hospital, Aarhus, Denmark
- Department of Clinical Medicine, Aarhus University, Aarhus, Denmark
| | - Jan Brogger
- Department of Clinical Neurophysiology, Haukeland University Hospital, Bergen, Norway
| |
Collapse
|
4
|
Mattioli P, Cleeren E, Hadady L, Cossu A, Cloppenborg T, Arnaldi D, Beniczky S. Electric Source Imaging in Presurgical Evaluation of Epilepsy: An Inter-Analyser Agreement Study. Diagnostics (Basel) 2022; 12:diagnostics12102303. [PMID: 36291992 PMCID: PMC9601236 DOI: 10.3390/diagnostics12102303] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2022] [Revised: 09/13/2022] [Accepted: 09/21/2022] [Indexed: 11/16/2022] Open
Abstract
Electric source imaging (ESI) estimates the cortical generator of the electroencephalography (EEG) signals recorded with scalp electrodes. ESI has gained increasing interest for the presurgical evaluation of patients with drug-resistant focal epilepsy. In spite of a standardised analysis pipeline, several aspects tailored to the individual patient involve subjective decisions of the expert performing the analysis, such as the selection of the analysed signals (interictal epileptiform discharges and seizures, identification of the onset epoch and time-point of the analysis). Our goal was to investigate the inter-analyser agreement of ESI in presurgical evaluations of epilepsy, using the same software and analysis pipeline. Six experts, of whom five had no previous experience in ESI, independently performed interictal and ictal ESI of 25 consecutive patients (17 temporal, 8 extratemporal) who underwent presurgical evaluation. The overall agreement among experts for the ESI methods was substantial (AC1 = 0.65; 95% CI: 0.59–0.71), and there was no significant difference between the methods. Our results suggest that using a standardised analysis pipeline, newly trained experts reach similar ESI solutions, calling for more standardisation in this emerging clinical application in neuroimaging.
Collapse
Affiliation(s)
- Pietro Mattioli
- Department of Neuroscience (DINOGMI), University of Genoa, 16132 Genoa, Italy
- Danish Epilepsy Center, 4293 Dianalund, Denmark
| | - Evy Cleeren
- Danish Epilepsy Center, 4293 Dianalund, Denmark
- Department of Neurology, University Hospital Leuven, 3000 Leuven, Belgium
| | - Levente Hadady
- Danish Epilepsy Center, 4293 Dianalund, Denmark
- Department of Neurology, Albert Szent-Györgyi Medical School, University of Szeged, 6720 Szeged, Hungary
| | - Alberto Cossu
- Danish Epilepsy Center, 4293 Dianalund, Denmark
- Child Neuropsychiatry, Department of Surgical Sciences, Dentistry, Gynecology and Pediatrics, University of Verona, 37126 Verona, Italy
| | - Thomas Cloppenborg
- Department of Epileptology, Krankenhaus Mara, Medical School, Bielefeld University, 33615 Bielefeld, Germany
| | - Dario Arnaldi
- Department of Neuroscience (DINOGMI), University of Genoa, 16132 Genoa, Italy
- IRCCS San Martino Hospital, 16132 Genoa, Italy
| | - Sándor Beniczky
- Danish Epilepsy Center, 4293 Dianalund, Denmark
- Department of Neurology, Albert Szent-Györgyi Medical School, University of Szeged, 6720 Szeged, Hungary
- Department of Clinical Neurophysiology, Aarhus University Hospital, 8200 Aarhus, Denmark
- Department of Clinical Medicine, Aarhus University, 8000 Aarhus, Denmark
- Correspondence: ; Tel.: +45-26-981536
| |
Collapse
|
5
|
McLaren JR, Jing J, Westover MB, Nascimento FA. Journal Club: Criteria for Defining Interictal Epileptiform Discharges in EEG. Neurology 2022; 99:430-432. [PMID: 35853743 PMCID: PMC9519249 DOI: 10.1212/wnl.0000000000200991] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2022] [Accepted: 06/03/2022] [Indexed: 11/15/2022] Open
Affiliation(s)
- John R McLaren
- From the Department of Neurology (J.R.M., J.J., M.B.W., F.A.N.), Massachusetts General Hospital, Harvard Medical School, Boston, and Department of Neurology (F.A.B.), Washington University School of Medicine, St. Louis, MO.
| | - Jin Jing
- From the Department of Neurology (J.R.M., J.J., M.B.W., F.A.N.), Massachusetts General Hospital, Harvard Medical School, Boston, and Department of Neurology (F.A.B.), Washington University School of Medicine, St. Louis, MO
| | - M Brandon Westover
- From the Department of Neurology (J.R.M., J.J., M.B.W., F.A.N.), Massachusetts General Hospital, Harvard Medical School, Boston, and Department of Neurology (F.A.B.), Washington University School of Medicine, St. Louis, MO
| | - Fábio A Nascimento
- From the Department of Neurology (J.R.M., J.J., M.B.W., F.A.N.), Massachusetts General Hospital, Harvard Medical School, Boston, and Department of Neurology (F.A.B.), Washington University School of Medicine, St. Louis, MO
| |
Collapse
|
6
|
EEG normal variants: A prospective study using the SCORE system. Clin Neurophysiol Pract 2022; 7:183-200. [PMID: 35865124 PMCID: PMC9294211 DOI: 10.1016/j.cnp.2022.06.001] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2022] [Revised: 05/21/2022] [Accepted: 06/22/2022] [Indexed: 11/23/2022] Open
Abstract
We analyzed the number of normal variants in a SCORE database of 3050 EEG recordings. The most common normal variant was sharp transients. We present typical examples and detailed characterization of the normal variants.
Objective To determine the prevalence and characteristics of normal variants in EEG recordings in a large cohort, and provide readers with typical examples of all normal variants for educational purposes. Methods Using the SCORE EEG system (Standardized Computer-Based Organized Reporting of EEG), we prospectively extracted EEG features in consecutive patients. In this dataset, we analyzed 3050 recordings from 2319 patients (mean age 38.5 years; range: 1–89 years). Results The distribution of the normal variants was as follows: sharp transients 19.21% (including wicket spikes), rhythmic temporal theta of drowsiness 6.03%, temporal slowing of the old 2.89%, slow fused transients 2.59%, 14-and 6-Hz bursts 1.83%, breach rhythm 1.25%, small sharp spikes 1.05%, 6-Hz spike and slow wave 0.69% and SREDA 0.03%. Conclusions The most prevalent normal variants are the sharp transients, which must not be over-read as epileptiform discharges. Significance EEG readers must be familiar with the normal variants to avoid misdiagnosis and misclassification of patients referred to clinical EEG recordings.
Collapse
|