Robotic telepathology: efficacy and usability in pulmonary pathology

Integrating digital pathology into clinical practice

The field of anatomic pathology has been evolving in the last few decades and the advancements have been largely fostered by innovative technology. Immunohistochemistry enabled a paradigm shift in discovery and diagnostic evaluation, followed by booming genomic advancements which allowed for submicroscopic pathologic characterization, and now the field of digital pathology coupled with machine learning and big data acquisition is paving the way to revolutionize the pathology medical domain. Whole slide imaging (WSI) is a disruptive technology where glass slides are digitized to produce on-screen whole slide images. Specifically, in the past decade, there have been significant advances in digital pathology systems that have allowed this technology to promote integration into clinical practice. Whole slide images (WSI), or digital slides, can be viewed and navigated comparable to glass slides on a microscope, as digital files. Whole slide imaging has increased in adoption among pathologists, pathology departments, and scientists for clinical, educational, and research initiatives. Integration of digital pathology systems requires a coordinated effort with numerous stakeholders, not only within the pathology department, but across the entire enterprise. Each pathology department has distinct needs, use cases and blueprints, however the framework components and variables for successful clinical integration can be generalized across any organization seeking to undergo a digital transformation at any scale. This article will review those components and considerations for integrating digital pathology systems into clinical practice.

Robotic Telecytology for Remote Cytologic Evaluation without an On-site Cytotechnologist or Cytopathologist: An Active Quality Assessment and Experience of Over 400 Cases

BACKGROUND

The first satellite center to offer interventional radiology procedures at Memorial Sloan Kettering Cancer Center opened in October 2014. Two of the procedures offered, fine needle aspirations and core biopsies, required a rapid on-site cytologic evaluation of smears and biopsy touch imprints for cellular content and adequacy. The volume and frequency of such evaluations did not justify hiring on-site cytotechnologists, and therefore, a dynamic robotic telecytology (TC) solution was created. In this article, we provide data on our experience with this active implementation. Sakura VisionTek was selected as our robotic TC solution.

METHODS

A retrospective analysis of all TC evaluations from this satellite site was performed. Information was collected on demographics, lesion location, imaging modality; a comparison of TC-assisted adequacy with final adequacy was also conducted.

RESULTS

An analysis of 439 cases was performed over a period of 23 months with perfect correlation in 92.7% (407/439) of the cases. An adequacy upgrade (inadequate specimen becomes adequate) in 6.6% (29/439) of the cases. An adequacy downgrade (adequate specimen becomes inadequate), is near zero at 0.7% (3/439) of the cases.

CONCLUSIONS

Dynamic robotic TC is effective for immediate evaluations performed without on-site cytotechnology staff. The overall intent of this article is to present data and concordance rates as outcome metrics. Thus far, such outcome metrics have exceeded our expectations. Our TC implementation shows high, perfect concordance. Adequacy upgrades are minor but more relevant and impressive is a near zero adequacy downgrade. Our full implementation has been so successful that plans are in place for configurations at future satellite sites.

Validation of digital pathology imaging for primary histopathological diagnosis

AIMS

Digital pathology (DP) offers advantages over glass slide microscopy (GS), but data demonstrating a statistically valid equivalent (i.e. non-inferior) performance of DP against GS are required to permit its use in diagnosis. The aim of this study is to provide evidence of non-inferiority.

METHODS AND RESULTS

Seventeen pathologists re-reported 3017 cases by DP. Of these, 1009 were re-reported by the same pathologist, and 2008 by a different pathologist. Re-examination of 10 138 scanned slides (2.22 terabytes) produced 72 variances between GS and DP reports, including 21 clinically significant variances. Ground truth lay with GS in 12 cases and with DP in nine cases. These results are within the 95% confidence interval for existing intraobserver and interobserver variability, proving that DP is non-inferior to GS. In three cases, the digital platform was deemed to be responsible for the variance, including a gastric biopsy, where Helicobacter pylori only became visible on slides scanned at the ×60 setting, and a bronchial biopsy and penile biopsy, where dysplasia was reported on DP but was not present on GS.

CONCLUSIONS

This is one of the largest studies proving that DP is equivalent to GS for the diagnosis of histopathology specimens. Error rates are similar in both platforms, although some problems e.g. detection of bacteria, are predictable.

Validation of a novel robotic telepathology platform for neuropathology intraoperative touch preparations

Background:

Robotic telepathology (RT) allows a remote pathologist to control and view a glass slide over the internet. This technology has been demonstrated to be effective on several platforms, but we present the first report on the validation of RT using the iScan Coreo Au whole slide imaging scanner.

Methods:

One intraoperative touch preparation slide from each of 100 cases were examined twice (200 total cases) using glass slides and RT, with a 3 week washout period between viewings, on two different scanners at two remote sites. This included 75 consecutive neuropathology cases and 25 consecutive general surgical pathology cases. Interpretations were compared using intraobserver variability.

Results:

Of the 200 total cases, one failed on RT. There were 47 total interpretive variances. Most of these were the result of less specific interpretations or an inability to identify scant diagnostic material on RT. Nine interpretive variances had potentially significant clinical implications (4.5%). Using the final diagnosis as a basis for comparison to evaluate these nine cases, three RT interpretations and three glass slide interpretations were considered to be discrepant. In the other three cases, both modalities were discrepant. This distribution of discrepancies indicates that underlying case difficulty, not the RT technology, probably accounts for these major variances. For the subset of 68 neoplastic neuropathology cases, the unweighted kappa of agreement between glass slides and RT was 0.68 (good agreement). RT took 225 s on average versus only 71 s per glass slide.

Conclusions:

This validation demonstrates that RT using the iScan Coreo Au system is a reasonable method for supplying remote neuropathology expertise for the intraoperative interpretation of touch preparations, but is limited by the slowness of the robotics, crude focusing, and the challenge of determining where to examine the slide using small thumbnail images.

The history of pathology informatics: A global perspective

Pathology informatics has evolved to varying levels around the world. The history of pathology informatics in different countries is a tale with many dimensions. At first glance, it is the familiar story of individuals solving problems that arise in their clinical practice to enhance efficiency, better manage (e.g., digitize) laboratory information, as well as exploit emerging information technologies. Under the surface, however, lie powerful resource, regulatory, and societal forces that helped shape our discipline into what it is today. In this monograph, for the first time in the history of our discipline, we collectively perform a global review of the field of pathology informatics. In doing so, we illustrate how general far-reaching trends such as the advent of computers, the Internet and digital imaging have affected pathology informatics in the world at large. Major drivers in the field included the need for pathologists to comply with national standards for health information technology and telepathology applications to meet the scarcity of pathology services and trained people in certain countries. Following trials by a multitude of investigators, not all of them successful, it is apparent that innovation alone did not assure the success of many informatics tools and solutions. Common, ongoing barriers to the widespread adoption of informatics devices include poor information technology infrastructure in undeveloped areas, the cost of technology, and regulatory issues. This review offers a deeper understanding of how pathology informatics historically developed and provides insights into what the promising future might hold.

A static-image telepathology system for dermatopathology consultation in East Africa: the Massachusetts General Hospital Experience

BACKGROUND

The histologic diagnosis of skin lesions in the developing world is complicated by the shortage of pathologists with subspecialty training in dermatopathology, limited access to ancillary diagnostic testing, and costly referrals for expert glass slide consultation in challenging cases.

OBJECTIVE

In this study we evaluate the feasibility of a static-image telepathology platform in Africa for performing accurate dermatopathology consultations.

METHODS

A static-image telepathology platform using the iPath server was utilized by referring pathologists in 4 African hospitals. Diagnostic interpretations were provided by Massachusetts General Hospital dermatopathologists at no cost. The diagnostic accuracy and interobserver correlation was evaluated.

RESULTS

The static histopathologic images were diagnostic in 22 of 29 (76%) cases. Diagnostic accuracy between static image and glass slide diagnosis in 22 cases was 91%, ranging from 86% to 95% according to years of dermatopathology subspecialty expertise. Comparison with the glass slides showed that the telepathology diagnosis was limited by inappropriate field selection in only one case. Interobserver concordance between two pathologists was high (K = 0.86) suggesting that this platform is easy to use with minimal training of both referring and consulting pathologists.

LIMITATIONS

Concordance between conventional microscopy and static image telepathology was performed in 22 of 29 cases for which glass slides were received. Interobserver concordance was performed for two pathologists.

CONCLUSION

Static-image telepathology is a feasible means of rendering diagnoses on dermatopathology cases and is a cost-effective technology for obtaining much-needed second opinions in resource-poor settings.

Feasibility and diagnostic accuracy of Internet-based dynamic telepathology between Uganda and Germany

We assessed the feasibility and diagnostic accuracy of Internet-based telepathology compared with conventional microscopic examination. A total of 96 cases from the routine workload of the Department of Pathology at the Mulago Hospital in Uganda were examined by robotic telemicroscopy via the Internet at the Fuerth Hospital in Germany. The telepathology diagnoses were compared with those of conventional microscopy. Email and Skype telephony were used to exchange clinical and diagnostic information. The reference diagnosis (gold standard) was established by consensus between two or more experienced pathologists using both conventional microscopy and telemicroscopy; immunohistochemistry was used whenever it was necessary. It took approximately 30 min for a pathologist to learn to use the telepathology system and 4–25 min to read a case remotely. Internet speed was the main limiting factor. The images were of good quality and the pathologist at the remote site was able to navigate through the slide and change the magnification as necessary. In 92 of the specimens (97%), the pathologists at the two hospitals agreed exactly about the diagnosis. Agreement overall was moderate (kappa = 0.39). The discordant diagnoses were attributed to factors related to diseases morphologically difficult to diagnose, such as soft tissue sarcomas and primitive tumours. Internet-based conferencing systems offer an inexpensive method of obtaining a primary diagnosis by telepathology and consulting on cases that require subspecialty expertise.

AI (artificial intelligence) in histopathology--from image analysis to automated diagnosis

The technological progress in digitalization of complete histological glass slides has opened a new door in tissue--based diagnosis. The presentation of microscopic images as a whole in a digital matrix is called virtual slide. A virtual slide allows calculation and related presentation of image information that otherwise can only be seen by individual human performance. The digital world permits attachments of several (if not all) fields of view and the contemporary visualization on a screen. The presentation of all microscopic magnifications is possible if the basic pixel resolution is less than 0.25 microns. To introduce digital tissue--based diagnosis into the daily routine work of a surgical pathologist requires a new setup of workflow arrangement and procedures. The quality of digitized images is sufficient for diagnostic purposes; however, the time needed for viewing virtual slides exceeds that of viewing original glass slides by far. The reason lies in a slower and more difficult sampling procedure, which is the selection of information containing fields of view. By application of artificial intelligence, tissue--based diagnosis in routine work can be managed automatically in steps as follows: 1. The individual image quality has to be measured, and corrected, if necessary. 2. A diagnostic algorithm has to be applied. An algorithm has be developed, that includes both object based (object features, structures) and pixel based (texture) measures. 3. These measures serve for diagnosis classification and feedback to order additional information, for example in virtual immunohistochemical slides. 4. The measures can serve for automated image classification and detection of relevant image information by themselves without any labeling. 5. The pathologists' duty will not be released by such a system; to the contrary, it will manage and supervise the system, i.e., just working at a "higher level". Virtual slides are already in use for teaching and continuous education in anatomy and pathology. First attempts to introduce them into routine work have been reported. Application of AI has been established by automated immunohistochemical measurement systems (EAMUS, www.diagnomX.eu). The performance of automated diagnosis has been reported for a broad variety of organs at sensitivity and specificity levels >85%). The implementation of a complete connected AI supported system is in its childhood. Application of AI in digital tissue--based diagnosis will allow the pathologists to work as supervisors and no longer as primary "water carriers". Its accurate use will give them the time needed to concentrating on difficult cases for the benefit of their patients.

Theory of sampling and its application in tissue based diagnosis

BACKGROUND

A general theory of sampling and its application in tissue based diagnosis is presented. Sampling is defined as extraction of information from certain limited spaces and its transformation into a statement or measure that is valid for the entire (reference) space. The procedure should be reproducible in time and space, i.e. give the same results when applied under similar circumstances. Sampling includes two different aspects, the procedure of sample selection and the efficiency of its performance. The practical performance of sample selection focuses on search for localization of specific compartments within the basic space, and search for presence of specific compartments.

METHODS

When a sampling procedure is applied in diagnostic processes two different procedures can be distinguished: I) the evaluation of a diagnostic significance of a certain object, which is the probability that the object can be grouped into a certain diagnosis, and II) the probability to detect these basic units. Sampling can be performed without or with external knowledge, such as size of searched objects, neighbourhood conditions, spatial distribution of objects, etc. If the sample size is much larger than the object size, the application of a translation invariant transformation results in Kriege's formula, which is widely used in search for ores. Usually, sampling is performed in a series of area (space) selections of identical size. The size can be defined in relation to the reference space or according to interspatial relationship. The first method is called random sampling, the second stratified sampling.

RESULTS

Random sampling does not require knowledge about the reference space, and is used to estimate the number and size of objects. Estimated features include area (volume) fraction, numerical, boundary and surface densities. Stratified sampling requires the knowledge of objects (and their features) and evaluates spatial features in relation to the detected objects (for example grey value distribution around an object). It serves also for the definition of parameters of the probability function in so-called active segmentation.

CONCLUSION

The method is useful in standardization of images derived from immunohistochemically stained slides, and implemented in the EAMUS system http://www.diagnomX.de. It can also be applied for the search of "objects possessing an amplification function", i.e. a rare event with "steering function". A formula to calculate the efficiency and potential error rate of the described sampling procedures is given.

Image standards in tissue-based diagnosis (diagnostic surgical pathology)

Background

Progress in automated image analysis, virtual microscopy, hospital information systems, and interdisciplinary data exchange require image standards to be applied in tissue-based diagnosis.

Aims

To describe the theoretical background, practical experiences and comparable solutions in other medical fields to promote image standards applicable for diagnostic pathology.

Theory and experiences

Images used in tissue-based diagnosis present with pathology – specific characteristics. It seems appropriate to discuss their characteristics and potential standardization in relation to the levels of hierarchy in which they appear. All levels can be divided into legal, medical, and technological properties. Standards applied to the first level include regulations or aims to be fulfilled. In legal properties, they have to regulate features of privacy, image documentation, transmission, and presentation; in medical properties, features of disease – image combination, human – diagnostics, automated information extraction, archive retrieval and access; and in technological properties features of image acquisition, display, formats, transfer speed, safety, and system dynamics. The next lower second level has to implement the prescriptions of the upper one, i.e. describe how they are implemented. Legal aspects should demand secure encryption for privacy of all patient related data, image archives that include all images used for diagnostics for a period of 10 years at minimum, accurate annotations of dates and viewing, and precise hardware and software information. Medical aspects should demand standardized patients' files such as DICOM 3 or HL 7 including history and previous examinations, information of image display hardware and software, of image resolution and fields of view, of relation between sizes of biological objects and image sizes, and of access to archives and retrieval. Technological aspects should deal with image acquisition systems (resolution, colour temperature, focus, brightness, and quality evaluation procedures), display resolution data, implemented image formats, storage, cycle frequency, backup procedures, operation system, and external system accessibility. The lowest third level describes the permitted limits and threshold in detail. At present, an applicable standard including all mentioned features does not exist to our knowledge; some aspects can be taken from radiological standards (PACS, DICOM 3); others require specific solutions or are not covered yet.

Conclusion

The progress in virtual microscopy and application of artificial intelligence (AI) in tissue-based diagnosis demands fast preparation and implementation of an internationally acceptable standard. The described hierarchic order as well as analytic investigation in all potentially necessary aspects and details offers an appropriate tool to specifically determine standardized requirements.

A feasibility study of virtual slides in surgical pathology in China

China's huge territorial expanse and its imbalance of regional economic development have resulted in an uneven distribution of experienced pathologists. Developing telepathology for consultation is of special relevance to China. We developed a newly designed telepathology workstation, which includes a small file size of each slide, permitting easy transmission, storage, and manipulation, and a feedback function, and also evaluated its feasibility in surgical pathology in China. Four hundred cases covering a broad spectrum of surgical pathology problems were investigated in a blinded fashion by the 2 pathologists using this virtual microscope system. These cases were then randomized and re-reviewed a second time with light microscope. Diagnoses and time spent for each diagnosis were recorded for both methods. The diagnostic accuracies achieved by viewing glass slides and virtual images were 97.25% (389 of 400) and 95.5% (382 of 400) for pathologist A and 96.25% (385 of 400) and 94.75% (379 of 400) for pathologist B, respectively. There was no significant diagnostic discrepancy between the 2 methods for the 2 pathologists. The average times for viewing a virtual slide were 3.41 and 5.24 minutes for pathologists A and B, respectively, whereas the average times for viewing a glass slide were 1.16 and 3.35 minutes for pathologists A and B. There was a statistical difference between the time costs of the 2 methods. However, the slight time increase using virtual slides is less than that using dynamic telepathology and traditional consultation, and is acceptable to the pathologists. These results showed that this newly designed virtual microscope system have an acceptable diagnostic accuracy that is of practical value and may be suitable for application in China.

Assessment of diagnostic accuracy and feasibility of dynamic telepathology in China

To assess the feasibility, including diagnostic accuracy and time cost, of a real-time telepathology system with pathologic slides, 600 cases covering a wide spectrum of lesions from 16 organ systems were tested. The "correct" diagnosis (gold standard) was established as a consensus by 2 experienced pathologists. The cases were first examined by 4 pathologists at different levels of experience with dynamic telepathology. Cases were then reviewed by the same pathologists using light microscopy in a blinded fashion 3 weeks to 2 months later. A diagnosis, together with reading times for telepathology and light microscopy, was recorded for each case. Diagnostic accuracy by telepathology was 94.8% (569/600), 93.3% (560/600), 91.6% (550/600), and 97% (388/400) for pathologists A, B, C, and D, respectively. Telepathologic diagnosis was concordant with the gold standard and with direct microscopy, with a mean of 94.2% and 99.26%, respectively. Most cases (510 or 85%) were diagnosed in 15 to 40 minutes by telepathology, with a mean of 17.0 minutes. The time needed to review a slide by telepathology was 3 to 4 times longer than that of standard light microscopy. All 4 pathologists were able to render a diagnosis in all cases. Our results showed that robotic telepathology is sufficiently accurate for primary diagnosis in surgical pathology, but modifications in laboratory protocols, telepathology hardware, and internet speed are needed to reduce the time necessary for diagnosis by telepathology before this method may be deemed suitable for use in a busy practice.

A randomized controlled trial of the diagnostic accuracy of internet-based telepathology compared with conventional microscopy

AIMS

To compare the diagnostic accuracy of internet-based virtual microscopy with conventional light microscopy, in the context of renal biopsies assessed by participants in the UK National Renal Pathology External Quality Assessment (EQA) Scheme.

METHODS AND RESULTS

'Virtual slides' of current EQA cases were made available over the internet to participants in the scheme. The approach permitted what may reasonably be described as a randomized controlled trial of the diagnostic accuracy of this mode of telepathology, in the context of renal pathology. No significant difference in diagnostic accuracy could be detected between the diagnoses proffered on the basis of virtual slides and conventional slides; but using virtual slides took pathologists considerably longer.

CONCLUSIONS

This result provides some encouragement for the implementation of such virtual slide-based telepathology systems. However, in failing to detect a difference, equivalence of diagnostic accuracy has not been proved; nor has the relevance of this result to other fields of histopathology been demonstrated. A decision to implement a diagnostic telepathology system requires consideration of numerous factors beyond diagnostic accuracy, including financial, legal, professional and ethical issues.

Grid technology in tissue-based diagnosis: fundamentals and potential developments

Tissue-based diagnosis still remains the most reliable and specific diagnostic medical procedure. It is involved in all technological developments in medicine and biology and incorporates tools of quite different applications. These range from molecular genetics to image acquisition and recognition algorithms (for image analysis), or from tissue culture to electronic communication services. Grid technology seems to possess all features to efficiently target specific constellations of an individual patient in order to obtain a detailed and accurate diagnosis in providing all relevant information and references. Grid technology can be briefly explained by so-called nodes that are linked together and share certain communication rules in using open standards. The number of nodes can vary as well as their functionality, depending on the needs of a specific user at a given point in time. In the beginning of grid technology, the nodes were used as supercomputers in combining and enhancing the computation power. At present, at least five different Grid functions can be distinguished, that comprise 1) computation services, 2) data services, 3) application services, 4) information services, and 5) knowledge services. The general structures and functions of a Grid are described, and their potential implementation into virtual tissue-based diagnosis is analyzed. As a result Grid technology offers a new dimension to access distributed information and knowledge and to improving the quality in tissue-based diagnosis and therefore improving the medical quality.

The use of digital imaging, video conferencing, and telepathology in histopathology: a national survey

AIMS

To undertake a large scale survey of histopathologists in the UK to determine the current infrastructure, training, and attitudes to digital pathology.

METHODS

A postal questionnaire was sent to 500 consultant histopathologists randomly selected from the membership of the Royal College of Pathologists in the UK.

RESULTS

There was a response rate of 47%. Sixty four per cent of respondents had a digital camera mounted on their microscope, but only 12% had any sort of telepathology equipment. Thirty per cent used digital images in electronic presentations at meetings at least once a year and only 24% had ever used telepathology in a diagnostic situation. Fifty nine per cent had received no training in digital imaging. Fifty eight per cent felt that the medicolegal implications of duty of care were a barrier to its use. A large proportion of pathologists (69%) were interested in using video conferencing for remote attendance at multidisciplinary team meetings.

CONCLUSIONS

There is a reasonable level of equipment and communications infrastructure among histopathologists in the UK but a very low level of training. There is resistance to the use of telepathology in the diagnostic context but enthusiasm for the use of video conferencing in multidisciplinary team meetings.

Beyond usability: designing effective technology implementation systems to promote patient safety

Evidence is emerging that certain technologies such as computerized provider order entry may reduce the likelihood of patient harm. However, many technologies that should reduce medical errors have been abandoned because of problems with their design, their impact on workflow, and general dissatisfaction with them by end users. Patient safety researchers have therefore looked to human factors engineering for guidance on how to design technologies to be usable (easy to use) and useful (improving job performance, efficiency, and/or quality). While this is a necessary step towards improving the likelihood of end user satisfaction, it is still not sufficient. Human factors engineering research has shown that the manner in which technologies are implemented also needs to be designed carefully if benefits are to be realized. This paper reviews the theoretical knowledge on what leads to successful technology implementation and how this can be translated into specifically designed processes for successful technology change. The literature on diffusion of innovations, technology acceptance, organisational justice, participative decision making, and organisational change is reviewed and strategies for promoting successful implementation are provided. Given the rapid and ever increasing pace of technology implementation in health care, it is critical for the science of technology implementation to be understood and incorporated into efforts to improve patient safety.

Beyond usability: designing effective technology implementation systems to promote patient safety

Evidence is emerging that certain technologies such as computerized provider order entry may reduce the likelihood of patient harm. However, many technologies that should reduce medical errors have been abandoned because of problems with their design, their impact on workflow, and general dissatisfaction with them by end users. Patient safety researchers have therefore looked to human factors engineering for guidance on how to design technologies to be usable (easy to use) and useful (improving job performance, efficiency, and/or quality). While this is a necessary step towards improving the likelihood of end user satisfaction, it is still not sufficient. Human factors engineering research has shown that the manner in which technologies are implemented also needs to be designed carefully if benefits are to be realized. This paper reviews the theoretical knowledge on what leads to successful technology implementation and how this can be translated into specifically designed processes for successful technology change. The literature on diffusion of innovations, technology acceptance, organisational justice, participative decision making, and organisational change is reviewed and strategies for promoting successful implementation are provided. Given the rapid and ever increasing pace of technology implementation in health care, it is critical for the science of technology implementation to be understood and incorporated into efforts to improve patient safety.

An automated tissue preclassification approach for telepathology: implementation and performance analysis

Telepathology is generally defined as the use of telecommunications technologies in the practice of anatomic or surgical pathology. In the usual telepathology scenario, a remotely located pathologist views images of tissues samples in order to render a diagnosis of the biopsy. Some telepathology systems involve interactive remote control of a microscope-based imaging system which delivers diagnostic quality imagery to the remote pathologist. The usefulness of such interactive systems depends on minimizing the end-to-end delays involved in controlling the robotic microscope, manipulating the tissue sample, and acquiring and transmitting the high-resolution image. An approach to minimizing end-to-end delay involves adding "intelligence" to the image acquisition system so that it can gather, classify, rank, and transmit diagnostically useful images in a semiautonomous fashion. In this research, we develop image analysis and ranking techniques which can improve the end-to-end performance of a robotic telepathology imaging system. Our semiautonomous image collection system uses morphological techniques to extract seed points for suspicious regions, a novel region growing algorithm to segment the regions of interest, and heuristically motivated expert system ranking techniques to select diagnostically relevant "next-step" image acquisitions. Diagnostic relevance of our segmentation and ranking algorithms is established via subjective and objective testing of the system. In subjective testing, pathologists Agree or Strongly Agree that all segmented regions are diagnostically relevant with probability greater than 0.75. In objective testing, 84% of "next-step" images acquired by our algorithms coincide with the areas most likely to be chosen by a pathologist.