1
|
Spring AM, Pittman DJ, Aghakhani Y, Jirsch J, Pillay N, Bello-Espinosa LE, Josephson C, Federico P. Generalizability of High Frequency Oscillation Evaluations in the Ripple Band. Front Neurol 2018; 9:510. [PMID: 30002645 PMCID: PMC6031752 DOI: 10.3389/fneur.2018.00510] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/03/2017] [Accepted: 06/11/2018] [Indexed: 11/29/2022] Open
Abstract
Objective: We examined the interrater reliability and generalizability of high-frequency oscillation (HFO) visual evaluations in the ripple (80–250 Hz) band, and established a framework for the transition of HFO analysis to routine clinical care. We were interested in the interrater reliability or epoch generalizability to describe how similar the evaluations were between reviewers, and in the reviewer generalizability to represent the consistency of the internal threshold each individual reviewer. Methods: We studied 41 adult epilepsy patients (mean age: 35.6 years) who underwent intracranial electroencephalography. A morphology detector was designed and used to detect candidate HFO events, lower-threshold events, and distractor events. These events were subsequently presented to six expert reviewers, who visually evaluated events for the presence of HFOs. Generalizability theory was used to characterize the epoch generalizability (interrater reliability) and reviewer generalizability (internal threshold consistency) of visual evaluations, as well as to project the numbers of epochs, reviewers, and datasets required to achieve strong generalizability (threshold of 0.8). Results: The reviewer generalizability was almost perfect (0.983), indicating there were sufficient evaluations to determine the internal threshold of each reviewer. However, the interrater reliability for 6 reviewers (0.588) and pairwise interrater reliability (0.322) were both poor, indicating that the agreement of 6 reviewers is insufficient to reliably establish the presence or absence of individual HFOs. Strong interrater reliability (≥0.8) was projected as requiring a minimum of 17 reviewers, while strong reviewer generalizability could be achieved with <30 epoch evaluations per reviewer. Significance: This study reaffirms the poor reliability of using small numbers of reviewers to identify HFOs, and projects the number of reviewers required to overcome this limitation. It also provides a set of tools which may be used for training reviewers, tracking changes to interrater reliability, and for constructing a benchmark set of epochs that can serve as a generalizable gold standard, against which other HFO detection algorithms may be compared. This study represents an important step toward the reconciliation of important but discordant findings from HFO studies undertaken with different sets of HFOs, and ultimately toward transitioning HFO analysis into a meaningful part of the clinical epilepsy workup.
Collapse
Affiliation(s)
- Aaron M Spring
- Department of Clinical Neurosciences, University of Calgary, Calgary, AB, Canada.,Hotchkiss Brain Institute, University of Calgary, Calgary, AB, Canada.,Seaman Family MR Research Centre, Foothills Medical Centre, Calgary, AB, Canada
| | - Daniel J Pittman
- Hotchkiss Brain Institute, University of Calgary, Calgary, AB, Canada.,Seaman Family MR Research Centre, Foothills Medical Centre, Calgary, AB, Canada
| | - Yahya Aghakhani
- Department of Clinical Neurosciences, University of Calgary, Calgary, AB, Canada
| | - Jeffrey Jirsch
- Department of Medicine, University of Alberta, Edmonton, AB, Canada
| | - Neelan Pillay
- Department of Clinical Neurosciences, University of Calgary, Calgary, AB, Canada
| | - Luis E Bello-Espinosa
- Department of Clinical Neurosciences, University of Calgary, Calgary, AB, Canada.,Department of Paediatrics, University of Calgary, Calgary, AB, Canada
| | - Colin Josephson
- Department of Clinical Neurosciences, University of Calgary, Calgary, AB, Canada
| | - Paolo Federico
- Department of Clinical Neurosciences, University of Calgary, Calgary, AB, Canada.,Hotchkiss Brain Institute, University of Calgary, Calgary, AB, Canada.,Seaman Family MR Research Centre, Foothills Medical Centre, Calgary, AB, Canada.,Department of Radiology, University of Calgary, Calgary, AB, Canada
| |
Collapse
|
3
|
Teixeira P, Zabel JP, Baumann C, Albizzati S, Coudane H, Winninger D, Blum A. Can paper replace laser film to communicate the results of wrist radiographs in trauma cases? A reproducibility study of the reading of wrist trauma case radiographs on a PACS workstation, laser film, and paper. J Digit Imaging 2013; 26:1013-9. [PMID: 23779150 DOI: 10.1007/s10278-013-9613-8] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022] Open
Abstract
The main goal of this study was to determine the reproducibility of the reading of wrist trauma case radiographs using three different media: laser film, a picture archiving and communication systems (PACS) workstation, and paper with an optimized layout. The study was conducted retrospectively in 200 consecutive patients consulting at the emergency department for wrist trauma and who underwent wrist X-ray investigation using a computed radiography system. There were 82 men and 118 women. The mean age was 48.3 years (16-95 years). Our institutional review board does not require patient approval or informed consent for retrospective review of case records. The readings were made by two independent readers who analyzed the 200 patient radiographs consecutively in one session for each type of media: paper, laser film, and on a PACS dual-screen workstation. The inter-reader agreements were substantial or almost perfect, with kappa values of 0.83 (0.76-0.90) for the PACS, 0.83 (0.76-0.90) for film, and 0.80 (0.72-0.87) for paper. The inter-technique agreement was almost perfect in all cases. There is a high interobserver agreement between PACS, laser film, and paper readings for wrist trauma cases. With a layout of one radiograph on each sheet, paper could replace laser films to communicate the results of wrist radiographs in trauma cases for outpatients.
Collapse
Affiliation(s)
- Pedro Teixeira
- Service d'Imagerie Guilloz, Hôpital Central, CHU de Nancy, 29 Avenue du Maréchal de Lattre de Tassigny, 54035, Nancy, France,
| | | | | | | | | | | | | |
Collapse
|
4
|
Maratt JD, Srinivasan RC, Dahl WJ, Schilling PL, Urquhart AG. Cloud-based preoperative planning for total hip arthroplasty: a study of accuracy, efficiency, and compliance. Orthopedics 2012; 35:682-6. [PMID: 22868590 DOI: 10.3928/01477447-20120725-05] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/03/2023]
Abstract
As digital radiography becomes more prevalent, several systems for digital preoperative planning have become available. The purpose of this study was to evaluate the accuracy and efficiency of an inexpensive, cloud-based digital templating system, which is comparable with acetate templating. However, cloud-based templating is substantially faster and more convenient than acetate templating or locally installed software. Although this is a practical solution for this particular medical application, regulatory changes are necessary before the tremendous advantages of cloud-based storage and computing can be realized in medical research and clinical practice.
Collapse
Affiliation(s)
- Joseph D Maratt
- Department of Orthopaedic Surgery, University of Michigan, Ann Arbor, MI 48109, USA
| | | | | | | | | |
Collapse
|
5
|
Comparison of PACS and hard-copy 51-inch radiographs for measuring leg length and deformity. Clin Orthop Relat Res 2011; 469:244-50. [PMID: 20625949 PMCID: PMC3008877 DOI: 10.1007/s11999-010-1460-z] [Citation(s) in RCA: 31] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/08/2009] [Accepted: 06/24/2010] [Indexed: 02/06/2023]
Abstract
BACKGROUND The picture archiving and communication system (PACS) eventually will replace the use of standard hard-copy radiographs. It is unknown whether measurements of limb length discrepancy (LLD) and deformity on PACS compare in accuracy and reproducibility with those from hard-copy radiographs. QUESTIONS/PURPOSES We compared the reproducibility and reliability of LLD and deformity measurements for each of these two media. METHODS We retrospectively reviewed 51-inch standing lower extremity images obtained for LLD or deformity analysis from 40 patients to compare the measurements and their reliability on hard-copy film with those performed on soft-copy PACS. Two observers independently performed measurements twice using each system at 1-week intervals to minimize interobserver or intraobserver bias. Intraclass correlation coefficients (ICCs) were determined to test intraobserver and interrater reliability of Rater 1 and Rater 2. RESULTS Interrater reliability of measurements made on hard copy ranged from 0.69 to 0.99 and PACS-derived measurements ranged from 0.66 to 0.98. Intraobserver reliability for Rater 1 for measurements made on hard copy ranged from 0.853 to 0.999 and PACS-derived measurements ranged from 0.80 to 0.996. Intraobserver reliability for Rater 2 for measurements made on hard copy ranged from 0.931 to 0.999 and PACS-derived measurements ranged from 0.962 to 0.999. CONCLUSIONS Each system yielded comparable reliability for measurements, therefore, transition to PACS to perform measurements in patients with LLD or deformity can be made with confidence. LEVEL OF EVIDENCE Level III, diagnostic study. See the Guidelines for Authors for a complete description of levels of evidence.
Collapse
|
6
|
Rytter S, Jensen LK, Bonde JP, Jurik AG, Egund N. Occupational kneeling and meniscal tears: a magnetic resonance imaging study in floor layers. J Rheumatol 2009; 36:1512-9. [PMID: 19411395 DOI: 10.3899/jrheum.081150] [Citation(s) in RCA: 34] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
Abstract
OBJECTIVE To evaluate the association between occupational kneeling and degenerative meniscal tears. METHODS Magnetic resonance imaging (MRI) of both knees was conducted in 92 male floor layers and 49 male graphic designers (referents), with a mean age of 55.6 years (range 42-70 yrs). The presence of grade 3 MRI signal intensities indicating degenerative tears of the anterior, middle, and posterior one-third of the lateral and medial menisci was assessed on 1.5-Tesla MRI scans. The odds ratio (OR) of meniscal tears was determined among floor layers compared to graphic designers. Using logistic regression, models were adjusted for age, body mass index, and knee-straining sports. RESULTS Degenerative tears were significantly more prevalent in the medial meniscus among floor layers than among graphic designers [OR 2.28, 95% confidence interval (CI) 1.10-4.98] and significantly more floor layers had medial tears in both knees (OR 3.46, 95% CI 1.41-8.48). Tears extending to the tibial aspect and localized in the middle and posterior one-third of the medial meniscus were most prevalent. Lateral meniscal tears were predominantly unilateral and the prevalence of lateral tears did not differ between the 2 study groups. Knee complaints occurred in about 50% of all floor layers, irrespective of the presence of meniscal tears. CONCLUSION Occupational kneeling increases the risk of degenerative tears in the medial but not the lateral menisci in both knees.
Collapse
Affiliation(s)
- Søren Rytter
- Department of Orthopaedics, Regional Hospital Viborg, DK-8800 Viborg, Denmark.
| | | | | | | | | |
Collapse
|