Telecytology value and validation: Developing a validation and competency tool for telecytology

Development of Automatic Portable Pathology Scanner and Its Evaluation for Clinical Practice

Digital pathological scanners transform traditional glass slides into whole slide images (WSIs), which significantly improve the efficiency of pathological diagnosis and promote the development of digital pathology. However, the huge economic burden limits the spread and application of general WSI scanners in relatively remote and backward regions. In this paper, we develop an automatic portable cytopathology scanner based on mobile internet, Landing-Smart, to avert the above problems. Landing-Smart is a tiny device with a size of 208 mm × 107 mm × 104 mm and a weight of 1.8 kg, which integrates four main components including a smartphone, a glass slide carrier, an electric controller, and an optical imaging unit. By leveraging a simple optical imaging unit to substitute the sophisticated but complex conventional light microscope, the cost of Landing-Smart is less than $3000, much cheaper than general WSI scanners. On the one hand, Landing-Smart utilizes the built-in camera of the smartphone to acquire field of views (FoVs) in the section one by one. On the other hand, it uploads the images to the cloud server in real time via mobile internet, where the image processing and stitching method is implemented to generate the WSI of the cytological sample. The practical assessment of 209 cervical cytological specimens has demonstrated that Landing-Smart is comparable to general digital scanners in cytopathology diagnosis. Landing-Smart provides an effective tool for preliminary cytological screening in underdeveloped areas.

Telecytology validation: is there a recipe for everybody?

INTRODUCTION

Telecytology offers a suitable solution to the cost and time efficiency questions on rapid onsite evaluation (ROSE). An increasing number of institutions are adopting new telecytology systems to meet the increasing ROSE requests, although there is no agreement on the details of how a telecytology validation study needs to be conducted. We propose a standardized approach for telecytology validation studies that could be done in a variety of practices.

MATERIALS AND METHODS

Consecutive cases from 6 months prior were chosen to reflect a case mix comparable to real life. A fellow assessed the slides at the ROSE site while 6 cytopathology faculty convened in a conference room with a television screen, and noted the adequacy, diagnostic category, and specific diagnoses. All participants were blinded to the original adequacy assessment and final diagnoses. For each case, evaluation time and the slides counts were noted.

RESULTS

Fine-needle aspiration specimens from 52 patients were included in the study. Of these, 13 cases were used in the first "test" session. The adequacy concordance rates ranged between 92.3% and 100%, with an overall concordance rate of 94.8%. The diagnostic category concordance rates ranged between 90.3% and 95.5%, with an overall concordance rate of 91.9%. The specific diagnosis concordance rates ranged between 84.6% and 92.9%, with an overall concordance rate of 88.1%.

CONCLUSIONS

Validation of telecytology requires a standardized approach just like any other new technology. In this study, we propose an efficient and accurate method for cytopathology departments of various case volumes to conduct telecytology validation studies.

The current practice of telecytology for rapid on-site evaluation (ROSE): Practical considerations and limitations

Advances in digital imaging technology and development of high-speed internet has brought a change in ROSE practice from the traditional in-person to remote evaluation. The rapid expansion of image-guided procedures to obtain tissues for diagnosis and ancillary testing has put a huge demand on cytopathologists' time to perform on-site adequacy assessment. The technology of transmitting digital slide images in real-time via the internet from procedure site that can be viewed remotely and provide preliminary diagnosis, has had a huge impact on the practice of ROSE. Telecytology (TC) has increased the efficiency of cytopathologists, by cutting down on travel time to procedure sites and eliminate the long wait time between procedures/needle passes. It also provides the cytopathologist with the flexibility of covering ROSE procedures occurring at several locations simultaneously. The options and design of TC systems are driven by clinical needs, availability of resources and case volume. A buy-in from stakeholders early in the process, infrastructure planning and information technology (IT) support are critical for the successful implementation of TC. Training of staff, validation study and compliance training should be performed according to established guidelines. There are different TC platforms commercially available in the market today, these include static image sharing, real-time video streaming, robotic microscopy and whole slide imaging (WSI). Additionally, low-cost TC system can be built and designed using equipment that are available off-the-shelf. The intent of this review is to highlight the current practices of TC, the pros and cons of each system are discussed.

Selective deployment of dynamic telecytology for rapid evaluation of cytology smears: assessment of workflow processes and role of cytopathology fellows as on-site operators

INTRODUCTION

The deployment of telecytology (TC) requires a substantial investment of financial and human resources. To offset the high demand for rapid on-site evaluation, we performed a limited deployment of dynamic TC and have detailed the workflow processes and the role of trainees.

MATERIALS AND METHODS

TC systems were installed in radiology suites with a high volume of cases. Validation was performed using retrospective and prospective cases. Cytotechnologists and cytopathology fellows were the operators of the instrument. TC malignant and benign diagnoses were correlated with the final sign-out diagnoses.

RESULTS

Of the 120 cases, 50 (41.6%) were fine needle aspirations and 70 (58.3%) were touch imprint smears of core biopsy specimens. The cytotechnologists were the operators for 34 cases (28.3%) and cytology fellows for 86 cases (71.6%). Adequacy concordance with the final diagnosis was 100% and 98.5% in the retrospective and prospective cases, respectively. In the prospective cases, concordance of TC with the final diagnosis of malignancy was 42 of 45 (93.3%), with 2 of 45 (4.4%) discordant and a downgrade rate of 2.7%. For the benign diagnoses, the concordance was 90%. For the malignant diagnoses, the sensitivity of TC was 97.67% (95% confidence interval [CI], 87.71 to 99.94%; specificity, 81.82%; 95% CI, 48.22% to 97.72%). The positive predictive value was 95.45% (95% CI, 85.69% to 98.66%), the negative predictive value was 90.00% (95% CI, 55.98% to 98.45%), and the accuracy was 94.44% (95% CI, 84.61% to 98.84%).

CONCLUSIONS

TC can be deployed in a limited fashion as an option for cytopathologists to offset the high demand for rapid on-site evaluations. Trainee participation in TC service is important for building confidence and honing their cytology skills.

Telecytology implementation: Deployment of telecytology for rapid on-site evaluations at an Academic Medical Center

INTRODUCTION

There are limited publications that address technical and practical informatics considerations when implementing telecytology for rapid on-site evaluation (ROSE). Our aim was to share the experience of deploying telecytology for ROSE at our institution.

MATERIALS AND METHODS

Key informatics issues relevant to adopting telecytology for ROSE at our institution were appraised including workflow, information technology (IT), validation, training, and quality assurance (QA).

RESULTS

A dynamic telemicroscopy solution was selected that required trained cytotechnologists to attend on-site procedures for ROSE. For validation 60 cases were reviewed using the first camera at each facility, but only 20 cases to validate subsequent cameras. A concordance rate of >90% between ROSE interpretation performed digitally to original interpretations was required for clinical validation. After reviewing 440 cases from two comparable time periods before and after implementation, employing telecytology was shown to decrease cytopathologists' work time per ROSE case from an average of 20.95 min per case to 2.91 min per case (86% time savings). The non-diagnostic rate for traditional ROSE was 7.7% compared with 4.1% after the implementation of telecytology, and the deferral rate went from 43.6% for traditional ROSE to 44.1% with telecytology. Traditional ROSE diagnoses correlated with final diagnoses in 91.8% cases, compared to 95.5% with telecytology.

CONCLUSIONS

Challenges when implementing telecytology for ROSE included technical issues, workflow concerns, and incorporating trainees into daily practice. The end result of our implementation was the adoption of an innovative way to deliver a ROSE service that maximised efficiency for cytopathologists without compromising diagnostic performance.

Psychological Aspects of Utilizing Telecytology for Rapid On-Site Adequacy Assessments

Rapid On-Site Evaluation (ROSE) has been well documented in its ability to improve the diagnostic yield and accuracy of fine needle aspirations across many sites, resulting in better quality of patient management and a simultaneous reduction in treatment costs. Telecytology makes it possible for cytology laboratories to offer ROSE in a cost effective manner, whilst employing only a small number of trained cytopathologists to cover many sites from a single connected location. However, the adoption of telecytology for ROSE has been lackluster. We believe that this reluctance is not only due to barriers such as technology limitations and financial obstacles, but also due to overlooked psychological factors. This article discusses the unaddressed psychological considerations of telecytology for ROSE.

Development of Whole Slide Imaging on Smartphones and Evaluation With ThinPrep Cytology Test Samples: Follow-Up Study

Background

The smartphone-based whole slide imaging (WSI) system represents a low-cost and effective alternative to automatic scanners for telepathology. In a previous study, the development of one such solution, named scalable whole slide imaging (sWSI), was presented and analyzed. A clinical evaluation of its iOS version with 100 frozen section samples verified the diagnosis-readiness of the produced virtual slides.

Objective

The first aim of this study was to delve into the quantifying issues encountered in the development of an Android version. It should also provide insights into future high-resolution real-time feedback medical imaging apps on Android and invoke the awareness of smartphone manufacturers for collaboration. The second aim of this study was to further verify the clinical value of sWSI with cytology samples. This type is different from the frozen section samples in that they require finer detail on the cellular level.

Methods

During sWSI development on Android, it was discovered that many models do not support uncompressed camera pixel data with sufficient resolution and full field of view. The proportion of models supporting the optimal format was estimated in a test on 200 mainstream Android models. Other factors, including slower processing speed and camera preview freezing, also led to inferior performance of sWSI on Android compared with the iOS version. The processing speed was mostly determined by the central processing unit frequency in theory, and the relationship was investigated in the 200-model simulation experiment with physical devices. The camera preview freezing was caused by the lag between triggering photo capture and resuming preview. In the clinical evaluation, 100 ThinPrep cytology test samples covering 6 diseases were scanned with sWSI and compared against the ground truth of optical microscopy.

Results

Among the tested Android models, only 3.0% (6/200) provided an optimal data format, meeting all criteria of quality and efficiency. The image-processing speed demonstrated a positive relationship with the central processing unit frequency but to a smaller degree than expected and was highly model-dependent. The virtual slides produced by sWSI on Android and iOS of ThinPrep cytology test samples achieved similar high quality. Using optical microscopy as the ground truth, pathologists made a correct diagnosis on 87.5% (175/200) of the cases with sWSI virtual slides. Depending on the sWSI version and the pathologist in charge, the kappa value varied between .70 and .82. All participating pathologists considered the quality of the sWSI virtual slides in the experiment to be adequate for routine usage.

Conclusions

Limited by hardware and operating system support, the performance of sWSI on mainstream Android smartphones did not fully match the iOS version. However, in practice, this difference was not significant, and both were adequate for digitizing most of the sample types for telepathology consultation.

Laboratory management curriculum for cytopathology subspecialty training

Laboratory management should be an integral part of training in pathology residency and fellowships. Herein, we have outlined some basic laboratory management topics a graduating cytopathology fellow should be familiar with. An overview of regulatory agencies that have oversight over laboratory testing, cytopathology laboratory accreditation, pre-analytic, analytic and post-analytic quality assurance, billing/coding, basic statistics, verification/validation of testing, physician credentialing, board certification/maintenance of certification, and malpractice in cytopathology are addressed. This review is by no means all inclusive, but rather a guide to the basic management related topics to be covered during cytopathology subspecialty training.

Efficacy of telecytopathology for preliminary assessment of fine-needle aspirations performed at a remote facility

INTRODUCTION

The need for real time anatomic pathology services has grown as healthcare systems, traditionally found at large medical centers, expand into smaller communities. The placement of a pathologist is not cost-, time-, or resource-efficient. Telecytopathology can provide rapid offsite evaluation of cytology tissues. This study evaluated the accuracy rate of rendered preliminary assessments for telecytopathology of ultrasound (US)-guided fine-needle aspirations (FNAs) for an offsite facility by comparing preliminary assessment results with the final diagnosis.

MATERIALS AND METHODS

The pathology database was searched for telecytopathology US-guided FNAs with rapid offsite evaluation performed at a regional care center from August 2014 to June 2016. A total of 674 consecutive US-guided FNAs from 444 patients were obtained. FNA sites included lymph node (345 cases), breast (178 cases), thyroid gland (71 cases), and others (80 cases).

RESULTS

Preliminary assessments of the 674 FNAs were adequate/benign in 275 (41%) cases, adequate/malignant in 182 (27%) cases, adequate/further review needed in 162 (24%) cases, indeterminate/borderline cellularity in 37 (5%) cases, and nondiagnostic in 18 (3%) cases. Final FNA diagnoses rendered included 391 (58%) negative for malignancy, 205 (30%) malignant, 34 (5%) atypical/suspicious for malignancy, 26 (4%) indeterminate cellularity-favor benign, and 18 (3%) nondiagnostic specimens. Concurrent core biopsy was performed in 42 cases and 83 cases were triaged for ancillary studies. The majority (99%) of US-guided FNAs demonstrated concordant preliminary assessments with the final diagnoses. A major discrepancy occurred in 1 case; 5 cases had minor discrepancies.

CONCLUSIONS

Remote facility telecytopathology can be utilized as an accurate modality in guiding appropriate tissue acquisition and final diagnosis.

Digital Applications in Cytopathology: Problems, Rationalizations, and Alternative Approaches

OBJECTIVE

The aim of this work was to raise awareness of problems using digital applications for examining, teaching, and applying telecytology at King Abdulaziz Medical City (KAMC), Riyadh, Saudi Arabia; University of Nebraska Medical Center (UNMC), Omaha, NE, USA; and University of Pittsburgh Medical Center (UPMC), Pittsburgh, PA, USA. The objective was to rationalize problems and propose alternative digital approaches.

STUDY DESIGN

We sought to identify solutions to improve the following: (a) interpretive examination scores at KAMC for complex cytological templates (i.e., high-grade squamous intraepithelial lesions [HSIL]) when using static digital images (SDI) of cells in regions of interest (ROI); (b) visualization of cells in 3D clusters when teaching at UNMC using 2D and 3D whole-slide imaging (WSI); and (c) visualization of cells through streaming telecytology at UPMC.

RESULTS

Composite SDI (CSDI) improved test scores for complex interpretations (i.e., HSIL) by converging diagnostic criteria from multiple ROI. Multiplane focusing through z-stacked WSI facilitated the teaching of cytological entities characterized by 3D cell clusters and consultative telecytology through robotic cell analysis.

CONCLUSIONS

Adequately visualized cytomorphology and multiplane focusing are essential for virtual cytopathology examinations, teaching, or consultative telecytology. Visualization of diagnostic criteria through 2D or 3D imaging is critical. Panoptiq panoramic WSI with integrated z-stacked video clips enables optimal applied telecytology.

Successful Secure High-definition Streaming Telecytology for Remote Cytologic Evaluation

BACKGROUND

The use of minimally invasive procedures to obtain material for diagnostic purposes has become more prevalent in recent years. As such, there is increased demand for immediate cytologic adequacy assessment of minimally invasive procedures. The array of different locations in which rapid on-site evaluation (ROSE) is expected requires an ever-increasing number of cytology personnel to provide support for adequacy assessment. In our study, we describe the implementation process of a telecytology (TC) system in a high case volume setting and evaluate the performance of this activity.

METHODS

We performed retrospectively an analysis of all consecutive remote TC ROSE evaluations obtained for 15 months. The specimens were evaluated using a TC system. The ROSE adequacy assessment obtained at the time of the procedure was compared to the final cytopathologist-rendered adequacy assessment when all the material was available for review, including the alcohol-fixed preparations.

RESULTS

A total of 8106 distinct cases were analyzed. TC-assisted preliminary adequacy assessment was highly concordant with the final cytopathologist-rendered adequacy assessment. Perfect concordance or accuracy was at 93.1% (7547/8106). The adequacy upgrade rate (inadequate specimen became adequate) was 6.8% (551/8106), and the initial adequacy downgrade (adequate specimen became inadequate) was <0.1% (8/8106).

CONCLUSIONS

The TC outcome demonstrates high concordance between the initial adequacy assessment and final cytopathologist-rendered adequacy assessment. Adequacy upgrades were minor but, more importantly, our results demonstrate a minimal adequacy downgrade. The process implemented effectively eliminated the need for an attending pathologist to be physically present onsite during a biopsy procedure.

Robotic Telecytology for Remote Cytologic Evaluation without an On-site Cytotechnologist or Cytopathologist: An Active Quality Assessment and Experience of Over 400 Cases

BACKGROUND

The first satellite center to offer interventional radiology procedures at Memorial Sloan Kettering Cancer Center opened in October 2014. Two of the procedures offered, fine needle aspirations and core biopsies, required a rapid on-site cytologic evaluation of smears and biopsy touch imprints for cellular content and adequacy. The volume and frequency of such evaluations did not justify hiring on-site cytotechnologists, and therefore, a dynamic robotic telecytology (TC) solution was created. In this article, we provide data on our experience with this active implementation. Sakura VisionTek was selected as our robotic TC solution.

METHODS

A retrospective analysis of all TC evaluations from this satellite site was performed. Information was collected on demographics, lesion location, imaging modality; a comparison of TC-assisted adequacy with final adequacy was also conducted.

RESULTS

An analysis of 439 cases was performed over a period of 23 months with perfect correlation in 92.7% (407/439) of the cases. An adequacy upgrade (inadequate specimen becomes adequate) in 6.6% (29/439) of the cases. An adequacy downgrade (adequate specimen becomes inadequate), is near zero at 0.7% (3/439) of the cases.

CONCLUSIONS

Dynamic robotic TC is effective for immediate evaluations performed without on-site cytotechnology staff. The overall intent of this article is to present data and concordance rates as outcome metrics. Thus far, such outcome metrics have exceeded our expectations. Our TC implementation shows high, perfect concordance. Adequacy upgrades are minor but more relevant and impressive is a near zero adequacy downgrade. Our full implementation has been so successful that plans are in place for configurations at future satellite sites.

Current practice patterns in nongynecologic and fine-needle aspiration cytology

INTRODUCTION

The American Society of Cytopathology Clinical Practice Committee in collaboration with the American Society of Cytotechnology surveyed cytology practitioners to better understand current practices related to nongynecologic (NGYN) cytology. While work practices in gynecologic (GYN) cytology are highly regulated with limited variation among specimens and processing techniques, practice patterns for NGYN cytology are less standardized among laboratories.

MATERIALS AND METHODS

An NGYN cytology survey was created that consisted of 40 questions focusing on 6 main topic areas: (1) practice settings and demographic data; (2) NGYN non-fine-needle aspiration cytology; (3) fine-needle aspiration (FNA) cytology; (4) rapid on-site evaluation practices; (5) workload recording practices; and (6) expanding roles of the cytotechnologist (CT). The survey was sent to all American Society of Cytopathology and American Society of Cytotechnology members and remained available for 40 days.

RESULTS

There were 368 survey participants (14% response rate) with nearly equal participation among CTs, cytology general managers and/or supervisors, and pathologists representing a variety of practice types. Most laboratories (87%) are providing a rapid on-site evaluation service for FNA specimens. The role of CTs is expanding with the majority of respondents stating that CTs assist with both clinician-performed and pathologist-performed FNA acquisition (77% and 50%, respectively), telecytology (16%), and screening of ancillary studies, including special stains (64%), immunohistochemistry (23%), and fluorescence in situ hybridization (16%).

CONCLUSIONS

Knowledge of NGYN cytology practice patterns among laboratories may contribute information to better define the future of cytotechnology, support reimbursement initiatives, and enhance quality and efficiencies in the cytology laboratory.