1
|
Rauschecker AM, Gleason TJ, Nedelec P, Duong MT, Weiss DA, Calabrese E, Colby JB, Sugrue LP, Rudie JD, Hess CP. Interinstitutional Portability of a Deep Learning Brain MRI Lesion Segmentation Algorithm. Radiol Artif Intell 2022; 4:e200152. [PMID: 35146430 DOI: 10.1148/ryai.2021200152] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2020] [Revised: 09/28/2021] [Accepted: 10/22/2021] [Indexed: 11/11/2022]
Abstract
PURPOSE To assess how well a brain MRI lesion segmentation algorithm trained at one institution performed at another institution, and to assess the effect of multi-institutional training datasets for mitigating performance loss. MATERIALS AND METHODS In this retrospective study, a three-dimensional U-Net for brain MRI abnormality segmentation was trained on data from 293 patients from one institution (IN1) (median age, 54 years; 165 women; patients treated between 2008 and 2018) and tested on data from 51 patients from a second institution (IN2) (median age, 46 years; 27 women; patients treated between 2003 and 2019). The model was then trained on additional data from various sources: (a) 285 multi-institution brain tumor segmentations, (b) 198 IN2 brain tumor segmentations, and (c) 34 IN2 lesion segmentations from various brain pathologic conditions. All trained models were tested on IN1 and external IN2 test datasets, assessing segmentation performance using Dice coefficients. RESULTS The U-Net accurately segmented brain MRI lesions across various pathologic conditions. Performance was lower when tested at an external institution (median Dice score, 0.70 [IN2] vs 0.76 [IN1]). Addition of 483 training cases of a single pathologic condition, including from IN2, did not raise performance (median Dice score, 0.72; P = .10). Addition of IN2 training data with heterogeneous pathologic features, representing only 10% (34 of 329) of total training data, increased performance to baseline (Dice score, 0.77; P < .001). This final model produced total lesion volumes with a high correlation to the reference standard (Spearman r = 0.98). CONCLUSION For brain MRI lesion segmentation, adding a modest amount of relevant training data from an external institution to a previously trained model supported successful application of the model to this external institution.Keywords: Neural Networks, Brain/Brain Stem, Segmentation Supplemental material is available for this article. © RSNA, 2021.
Collapse
Affiliation(s)
- Andreas M Rauschecker
- Department of Radiology & Biomedical Imaging, University of California, San Francisco, 513 Parnassus Ave, Room S-261, Box 0628, San Francisco, CA 94143-0628 (A.M.R., T.J.G., P.N., D.A.W., E.C., J.B.C., L.P.S., J.D.R., C.P.H.); and Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pa (M.T.D., D.W.)
| | - Tyler J Gleason
- Department of Radiology & Biomedical Imaging, University of California, San Francisco, 513 Parnassus Ave, Room S-261, Box 0628, San Francisco, CA 94143-0628 (A.M.R., T.J.G., P.N., D.A.W., E.C., J.B.C., L.P.S., J.D.R., C.P.H.); and Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pa (M.T.D., D.W.)
| | - Pierre Nedelec
- Department of Radiology & Biomedical Imaging, University of California, San Francisco, 513 Parnassus Ave, Room S-261, Box 0628, San Francisco, CA 94143-0628 (A.M.R., T.J.G., P.N., D.A.W., E.C., J.B.C., L.P.S., J.D.R., C.P.H.); and Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pa (M.T.D., D.W.)
| | - Michael Tran Duong
- Department of Radiology & Biomedical Imaging, University of California, San Francisco, 513 Parnassus Ave, Room S-261, Box 0628, San Francisco, CA 94143-0628 (A.M.R., T.J.G., P.N., D.A.W., E.C., J.B.C., L.P.S., J.D.R., C.P.H.); and Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pa (M.T.D., D.W.)
| | - David A Weiss
- Department of Radiology & Biomedical Imaging, University of California, San Francisco, 513 Parnassus Ave, Room S-261, Box 0628, San Francisco, CA 94143-0628 (A.M.R., T.J.G., P.N., D.A.W., E.C., J.B.C., L.P.S., J.D.R., C.P.H.); and Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pa (M.T.D., D.W.)
| | - Evan Calabrese
- Department of Radiology & Biomedical Imaging, University of California, San Francisco, 513 Parnassus Ave, Room S-261, Box 0628, San Francisco, CA 94143-0628 (A.M.R., T.J.G., P.N., D.A.W., E.C., J.B.C., L.P.S., J.D.R., C.P.H.); and Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pa (M.T.D., D.W.)
| | - John B Colby
- Department of Radiology & Biomedical Imaging, University of California, San Francisco, 513 Parnassus Ave, Room S-261, Box 0628, San Francisco, CA 94143-0628 (A.M.R., T.J.G., P.N., D.A.W., E.C., J.B.C., L.P.S., J.D.R., C.P.H.); and Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pa (M.T.D., D.W.)
| | - Leo P Sugrue
- Department of Radiology & Biomedical Imaging, University of California, San Francisco, 513 Parnassus Ave, Room S-261, Box 0628, San Francisco, CA 94143-0628 (A.M.R., T.J.G., P.N., D.A.W., E.C., J.B.C., L.P.S., J.D.R., C.P.H.); and Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pa (M.T.D., D.W.)
| | - Jeffrey D Rudie
- Department of Radiology & Biomedical Imaging, University of California, San Francisco, 513 Parnassus Ave, Room S-261, Box 0628, San Francisco, CA 94143-0628 (A.M.R., T.J.G., P.N., D.A.W., E.C., J.B.C., L.P.S., J.D.R., C.P.H.); and Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pa (M.T.D., D.W.)
| | - Christopher P Hess
- Department of Radiology & Biomedical Imaging, University of California, San Francisco, 513 Parnassus Ave, Room S-261, Box 0628, San Francisco, CA 94143-0628 (A.M.R., T.J.G., P.N., D.A.W., E.C., J.B.C., L.P.S., J.D.R., C.P.H.); and Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pa (M.T.D., D.W.)
| |
Collapse
|
2
|
Ryan EL, Lynch ME, Taddeo E, Gleason TJ, Epstein MP, Fridovich-Keil JL. Cryptic residual GALT activity is a potential modifier of scholastic outcome in school age children with classic galactosemia. J Inherit Metab Dis 2013; 36:1049-61. [PMID: 23319291 PMCID: PMC3657299 DOI: 10.1007/s10545-012-9575-x] [Citation(s) in RCA: 22] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/05/2012] [Revised: 11/26/2012] [Accepted: 12/04/2012] [Indexed: 11/28/2022]
Abstract
Classic galactosemia is a potentially lethal disorder that results from profound deficiency of galactose-1-phosphate uridylyltransferase (GALT), the second enzyme in the Leloir pathway of galactose metabolism. Although early diagnosis and rigorous dietary restriction of galactose prevent or resolve the potentially lethal acute symptoms, patients are at markedly increased risk of long-term complications including significant cognitive, speech, and behavioral difficulties, among other problems. The mechanisms that underlie these long-term complications remain unclear, as do the factors that modify their severity. Here we explored the scholastic and behavioral outcomes experienced by a cohort of 54 school age children with classic galactosemia. Data collected included survey responses from parents and teachers, school records including standardized test scores, and GALT genotype data used to estimate predicted residual GALT activity based on a yeast expression system. As expected, many but not all of the children in our study demonstrated speech, scholastic, and behavioral difficulties. Perhaps most striking, we found that predicted cryptic residual GALT activity, often below the threshold of detection of clinical assays, appeared to modify scholastic outcome. These data raise the intriguing possibility that cryptic GALT activity might also influence the severity of other long-term complications in classic galactosemia.
Collapse
Affiliation(s)
- Emily L. Ryan
- Graduate Program in Biochemistry, Cell, and Developmental Biology, Emory University, Atlanta, GA, USA
| | | | - Elles Taddeo
- Department of Psychiatry, Emory University School of Medicine
| | - Tyler J. Gleason
- Department of Human Genetics, Emory University School of Medicine
| | | | - Judith L. Fridovich-Keil
- Department of Human Genetics, Emory University School of Medicine
- Correspondence to: Judith L. Fridovich-Keil, Department of Human Genetics, Emory University School of Medicine, Rm. 325.2 Whitehead Bldg., 615 Michael St, Atlanta, GA 30322 TEL 404-727-3924, FAX 404-727-3949,
| |
Collapse
|
5
|
Liu Y, Xia B, Gleason TJ, Castañeda U, He M, Berry GT, Fridovich-Keil JL. N- and O-linked glycosylation of total plasma glycoproteins in galactosemia. Mol Genet Metab 2012; 106:442-54. [PMID: 22743281 PMCID: PMC3426456 DOI: 10.1016/j.ymgme.2012.05.025] [Citation(s) in RCA: 33] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/31/2012] [Accepted: 05/31/2012] [Indexed: 11/18/2022]
Abstract
Classic galactosemia is a potentially lethal metabolic disorder that results from profound impairment of the enzyme galactose-1-phosphate uridylyltransferase (GALT); despite decades of research, the underlying mechanism of pathophysiology remains unclear. Previous studies of plasma and tissue samples from patients with classic galactosemia have revealed defects of protein and lipid glycosylation, however, the underlying bases for these defects and their clinical significance, if any, has remained unclear. As a step toward addressing these questions we characterized both the N- and O-linked glycomes of plasma proteins from neonates, infants, children, and adults with galactosemia using mass spectrometry and asked (1) whether similar or disparate defects exist for N-linked and O-linked modifications, (2) what factors correlate with the severity of these defects in different patients, and perhaps most important, (3) whether there is any apparent relationship between chronic glycosylation defects and long-term outcome in patients. We found that some but not all of the galactosemic neonates tested exhibited abnormal N- and O-linked glycosylation of plasma proteins. The types of abnormalities seen were similar between N- and O-linked moieties, but the extent of the defects varied between patients. Age, gender, GALT genotype, and predicted residual GALT activity all failed to explain the extent of the glycosylation defect in the samples studied. Dietary galactose restriction markedly normalized both the N- and O-linked glycosylation patterns for all infants tested; however, any remaining glycosylation defects evident in the plasma of older children or adults on galactose-restricted diets showed no correlation with clinical outcome. These data cannot rule out the possibility that subtle or localized glycosylation defects, not detectable by our methods or not reflected in plasma, may contribute to acute or long-term outcome severity.
Collapse
Affiliation(s)
- Ying Liu
- Department of Human Genetics, Emory University School of Medicine, Room 325.2 Whitehead Building, 615 Michael Street, Atlanta, GA 30322, USA
| | - Baoyun Xia
- Division of Medical Genetics, Dept of Human Genetics, Emory University School of Medicine, Atlanta, GA 30322, USA
| | - Tyler J. Gleason
- Department of Human Genetics, Emory University School of Medicine, Room 325.2 Whitehead Building, 615 Michael Street, Atlanta, GA 30322, USA
| | - Uriel Castañeda
- Department of Human Genetics, Emory University School of Medicine, Room 325.2 Whitehead Building, 615 Michael Street, Atlanta, GA 30322, USA
| | - Miao He
- Division of Medical Genetics, Dept of Human Genetics, Emory University School of Medicine, Atlanta, GA 30322, USA
| | - Gerard T. Berry
- Division of Genetics, Children’s Hospital Boston, Center for Life Sciences Building, Boston, MA 02115, USA
| | - Judith L. Fridovich-Keil
- Department of Human Genetics, Emory University School of Medicine, Room 325.2 Whitehead Building, 615 Michael Street, Atlanta, GA 30322, USA
- Corresponding author at: Department of Human Genetics, Emory University School of Medicine, Room 325.2 Whitehead Building, 615 Michael Street, Atlanta, GA 30322, USA. Fax: +1 404 727 3949. (J.L. Fridovich-Keil)
| |
Collapse
|