1
|
Amgad M, Atteya LA, Hussein H, Mohammed KH, Hafiz E, Elsebaie MAT, Alhusseiny AM, AlMoslemany MA, Elmatboly AM, Pappalardo PA, Sakr RA, Mobadersany P, Rachid A, Saad AM, Alkashash AM, Ruhban IA, Alrefai A, Elgazar NM, Abdulkarim A, Farag AA, Etman A, Elsaeed AG, Alagha Y, Amer YA, Raslan AM, Nadim MK, Elsebaie MAT, Ayad A, Hanna LE, Gadallah A, Elkady M, Drumheller B, Jaye D, Manthey D, Gutman DA, Elfandy H, Cooper LAD. NuCLS: A scalable crowdsourcing approach and dataset for nucleus classification and segmentation in breast cancer. Gigascience 2022; 11:6586817. [PMID: 35579553 PMCID: PMC9112766 DOI: 10.1093/gigascience/giac037] [Citation(s) in RCA: 16] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2021] [Revised: 12/24/2021] [Accepted: 03/18/2022] [Indexed: 01/20/2023] Open
Abstract
Background Deep learning enables accurate high-resolution mapping of cells and tissue structures that can serve as the foundation of interpretable machine-learning models for computational pathology. However, generating adequate labels for these structures is a critical barrier, given the time and effort required from pathologists. Results This article describes a novel collaborative framework for engaging crowds of medical students and pathologists to produce quality labels for cell nuclei. We used this approach to produce the NuCLS dataset, containing >220,000 annotations of cell nuclei in breast cancers. This builds on prior work labeling tissue regions to produce an integrated tissue region- and cell-level annotation dataset for training that is the largest such resource for multi-scale analysis of breast cancer histology. This article presents data and analysis results for single and multi-rater annotations from both non-experts and pathologists. We present a novel workflow that uses algorithmic suggestions to collect accurate segmentation data without the need for laborious manual tracing of nuclei. Our results indicate that even noisy algorithmic suggestions do not adversely affect pathologist accuracy and can help non-experts improve annotation quality. We also present a new approach for inferring truth from multiple raters and show that non-experts can produce accurate annotations for visually distinctive classes. Conclusions This study is the most extensive systematic exploration of the large-scale use of wisdom-of-the-crowd approaches to generate data for computational pathology applications.
Collapse
Affiliation(s)
- Mohamed Amgad
- Department of Pathology, Northwestern University, 750 N Lake Shore Dr., Chicago, IL 60611, USA
| | - Lamees A Atteya
- Cairo Health Care Administration, Egyptian Ministry of Health, 3 Magles El Shaab Street, Cairo, Postal code 222, Egypt
| | - Hagar Hussein
- Department of Pathology, Nasser institute for research and treatment, 3 Magles El Shaab Street, Cairo, Postal code 222, Egypt
| | - Kareem Hosny Mohammed
- Department of Pathology and Laboratory Medicine, University of Pennsylvania, 3620 Hamilton Walk M163, Philadelphia, PA 19104, USA
| | - Ehab Hafiz
- Department of Clinical Laboratory Research, Theodor Bilharz Research Institute, 1 El-Nile Street, Imbaba Warrak El-Hadar, Giza, Postal code 12411, Egypt
| | - Maha A T Elsebaie
- Department of Medicine, Cook County Hospital, 1969 W Ogden Ave, Chicago, IL 60612, USA
| | - Ahmed M Alhusseiny
- Department of Pathology, Baystate Medical Center, University of Massachusetts, 759 Chestnut St, Springfield, MA 01199, USA
| | - Mohamed Atef AlMoslemany
- Faculty of Medicine, Menoufia University, Gamal Abd El-Nasir, Qism Shebeen El-Kom, Shibin el Kom, Menofia Governorate, Postal code: 32511, Egypt
| | - Abdelmagid M Elmatboly
- Faculty of Medicine, Al-Azhar University, 15 Mohammed Abdou, El-Darb El-Ahmar, Cairo Governorate, Postal code 11651, Egypt
| | - Philip A Pappalardo
- Consultant for The Center for Applied Proteomics and Molecular Medicine (CAPMM), George Mason University, 10920 George Mason Circle Institute for Advanced Biomedical Research Room 2008, MS1A9 Manassas, Virginia 20110, USA
| | - Rokia Adel Sakr
- Department of Pathology, National Liver Institute, Gamal Abd El-Nasir, Qism Shebeen El-Kom, Shibin el Kom, Menofia Governorate, Postal code: 32511, Egypt
| | - Pooya Mobadersany
- Department of Pathology, Northwestern University, 750 N Lake Shore Dr., Chicago, IL 60611, USA
| | - Ahmad Rachid
- Faculty of Medicine, Ain Shams University, 38 Abbassia, Next to the Al-Nour Mosque, Cairo, Postal code: 1181, Egypt
| | - Anas M Saad
- Cleveland Clinic Foundation, 9500 Euclid Ave. Cleveland, Ohio 44195, USA
| | - Ahmad M Alkashash
- Department of Pathology, Indiana University, 635 Barnhill Drive Medical Science Building A-128 Indianapolis, IN 46202, USA
| | - Inas A Ruhban
- Faculty of Medicine, Damascus University, Damascus, Damaskus, PO Box 30621, Syria
| | - Anas Alrefai
- Faculty of Medicine, Ain Shams University, 38 Abbassia, Next to the Al-Nour Mosque, Cairo, Postal code: 1181, Egypt
| | - Nada M Elgazar
- Faculty of Medicine, Mansoura University, 1 El Gomhouria St, Dakahlia Governorate 35516, Egypt
| | - Ali Abdulkarim
- Faculty of Medicine, Cairo University, Kasr Al Ainy Hospitals, Kasr Al Ainy St., Cairo, Postal code: 11562, Egypt
| | - Abo-Alela Farag
- Faculty of Medicine, Ain Shams University, 38 Abbassia, Next to the Al-Nour Mosque, Cairo, Postal code: 1181, Egypt
| | - Amira Etman
- Faculty of Medicine, Menoufia University, Gamal Abd El-Nasir, Qism Shebeen El-Kom, Shibin el Kom, Menofia Governorate, Postal code: 32511, Egypt
| | - Ahmed G Elsaeed
- Faculty of Medicine, Mansoura University, 1 El Gomhouria St, Dakahlia Governorate 35516, Egypt
| | - Yahya Alagha
- Faculty of Medicine, Cairo University, Kasr Al Ainy Hospitals, Kasr Al Ainy St., Cairo, Postal code: 11562, Egypt
| | - Yomna A Amer
- Faculty of Medicine, Menoufia University, Gamal Abd El-Nasir, Qism Shebeen El-Kom, Shibin el Kom, Menofia Governorate, Postal code: 32511, Egypt
| | - Ahmed M Raslan
- Department of Anaesthesia and Critical Care, Menoufia University Hospital, Gamal Abd El-Nasir, Qism Shebeen El-Kom, Shibin el Kom, Menofia Governorate, Postal code: 32511, Egypt
| | - Menatalla K Nadim
- Department of Clinical Pathology, Ain Shams University, 38 Abbassia, Next to the Al-Nour Mosque, Cairo, Postal code: 1181, Egypt
| | - Mai A T Elsebaie
- Faculty of Medicine, Ain Shams University, 38 Abbassia, Next to the Al-Nour Mosque, Cairo, Postal code: 1181, Egypt
| | - Ahmed Ayad
- Research Department, Oncology Consultants, 2130 W. Holcombe Blvd, 10th Floor, Houston, Texas 77030, USA
| | - Liza E Hanna
- Department of Pathology, Nasser institute for research and treatment, 3 Magles El Shaab Street, Cairo, Postal code 222, Egypt
| | - Ahmed Gadallah
- Faculty of Medicine, Ain Shams University, 38 Abbassia, Next to the Al-Nour Mosque, Cairo, Postal code: 1181, Egypt
| | - Mohamed Elkady
- Siparadigm Diagnostic Informatics, 25 Riverside Dr no. 2, Pine Brook, NJ 07058, USA
| | - Bradley Drumheller
- Department of Pathology and Laboratory Medicine, Emory University School of Medicine, 201 Dowman Dr, Atlanta, GA 30322, USA
| | - David Jaye
- Department of Pathology and Laboratory Medicine, Emory University School of Medicine, 201 Dowman Dr, Atlanta, GA 30322, USA
| | - David Manthey
- Kitware Inc., 1712 Route 9. Suite 300. Clifton Park, New York 12065, USA
| | - David A Gutman
- Department of Neurology, Emory University School of Medicine, 201 Dowman Dr, Atlanta, GA 30322, USA
| | - Habiba Elfandy
- Department of Pathology, National Cancer Institute, Kasr Al Eini Street, Fom El Khalig, Cairo, Postal code: 11562, Egypt.,Department of Pathology, Children's Cancer Hospital Egypt (CCHE 57357), 1 Seket Al-Emam Street, El-Madbah El-Kadeem Yard, El-Saida Zenab, Cairo, Postal code: 11562, Egypt
| | - Lee A D Cooper
- Department of Pathology, Northwestern University, 750 N Lake Shore Dr., Chicago, IL 60611, USA.,Lurie Cancer Center, Northwestern University, 675 N St Clair St Fl 21 Ste 100, Chicago, IL 60611, USA.,Center for Computational Imaging and Signal Analytics, Northwestern University Feinberg School of Medicine, 750 N Lake Shore Dr., Chicago, IL 60611, USA
| |
Collapse
|
2
|
El-Beheidy R, Domouky AM, Zidan H, Amer YA. Serum KL-6 as predictive and prognostic marker of interstitial lung disease in childhood connective tissue diseases: a pilot study. Reumatismo 2021; 73. [PMID: 34814656 DOI: 10.4081/reumatismo.2021.1399] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2021] [Accepted: 06/27/2021] [Indexed: 11/23/2022] Open
Abstract
This study was aimed to evaluate serum KL-6 levels to determine if this marker can be used for diagnosing and assessing severity of interstitial lung disease (ILD) in children with connective tissue disorders. In total, 40 patients [18 patients with juvenile systemic lupus erythematosus (JSLE), 10 patients with juvenile idiopathic arthritis (JIA), 8 patients with juvenile mixed connective tissue disease (JMCTD), 3 patients with juvenile systemic sclerosis (JSSc), and 1 patient with juvenile dermatomyositis (JDM)] and 20 healthy controls were included in this study. Age, sex, and duration of CTD and ILD (if any) were recorded. Blood samples from all the patients and controls were examined by ELISA. 20 of the 40 patients with CTD (50%) had ILD, 12 were mild and 8 were severe as assessed by spirometry. The median serum KL-6 level was 102.7 U/mL (76.1-180.8) in the CTD with severe ILD group, 72.2 U/mL (58.4- 100.5) in the CTD with mild ILD group, 56.7 U/mL (35.8-68.5) in the CTD without ILD group, and 52.3 U/mL (32.8-62.4) in the control group. KL-6 levels were significantly higher in the CTD with ILD (p<0.05), at a cutoff of 63.4 U/ml identified by ROC curve, serum KL-6 showed a sensitivity of 95.2% and specificity of 89.7%. KL-6 is a valuable biomarker for diagnostic purposes and to detect severity in ILD in childhood CTD.
Collapse
Affiliation(s)
- R El-Beheidy
- Pulmonology, Immunology and Allergy Unit, Pediatrics Department, Faculty of Medicine, Zagazig University.
| | - A M Domouky
- Pulmonology, Immunology and Allergy Unit, Pediatrics Department, Faculty of Medicine, Zagazig University, Egypt; Human Anatomy and Embryology Department, Faculty of Medicine, Zagazig University.
| | - H Zidan
- Medical Biochemistry and Molecular Biology, Faculty of Medicine, Zagazig University.
| | - Y A Amer
- Rheumatology and Rehabilitation Department, Faculty of Medicine, Zagazig University.
| |
Collapse
|