1
|
Dinnes J, Deeks JJ, Chuchu N, Matin RN, Wong KY, Aldridge RB, Durack A, Gulati A, Chan SA, Johnston L, Bayliss SE, Leonardi‐Bee J, Takwoingi Y, Davenport C, O'Sullivan C, Tehrani H, Williams HC. Visual inspection and dermoscopy, alone or in combination, for diagnosing keratinocyte skin cancers in adults. Cochrane Database Syst Rev 2018; 12:CD011901. [PMID: 30521688 PMCID: PMC6516870 DOI: 10.1002/14651858.cd011901.pub2] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/03/2023]
Abstract
BACKGROUND Early accurate detection of all skin cancer types is important to guide appropriate management, to reduce morbidity and to improve survival. Basal cell carcinoma (BCC) is almost always a localised skin cancer with potential to infiltrate and damage surrounding tissue, whereas a minority of cutaneous squamous cell carcinomas (cSCCs) and invasive melanomas are higher-risk skin cancers with the potential to metastasise and cause death. Dermoscopy has become an important tool to assist specialist clinicians in the diagnosis of melanoma, and is increasingly used in primary-care settings. Dermoscopy is a precision-built handheld illuminated magnifier that allows more detailed examination of the skin down to the level of the superficial dermis. Establishing the value of dermoscopy over and above visual inspection for the diagnosis of BCC or cSCC in primary- and secondary-care settings is critical to understanding its potential contribution to appropriate skin cancer triage, including referral of higher-risk cancers to secondary care, the identification of low-risk skin cancers that might be treated in primary care and to provide reassurance to those with benign skin lesions who can be safely discharged. OBJECTIVES To determine the diagnostic accuracy of visual inspection and dermoscopy, alone or in combination, for the detection of (a) BCC and (b) cSCC, in adults. We separated studies according to whether the diagnosis was recorded face-to-face (in person) or based on remote (image-based) assessment. SEARCH METHODS We undertook a comprehensive search of the following databases from inception up to August 2016: Cochrane Central Register of Controlled Trials; MEDLINE; Embase; CINAHL; CPCI; Zetoc; Science Citation Index; US National Institutes of Health Ongoing Trials Register; NIHR Clinical Research Network Portfolio Database; and the World Health Organization International Clinical Trials Registry Platform. We studied reference lists and published systematic review articles. SELECTION CRITERIA Studies of any design that evaluated visual inspection or dermoscopy or both in adults with lesions suspicious for skin cancer, compared with a reference standard of either histological confirmation or clinical follow-up. DATA COLLECTION AND ANALYSIS Two review authors independently extracted all data using a standardised data extraction and quality assessment form (based on QUADAS-2). We contacted authors of included studies where information related to the target condition or diagnostic thresholds were missing. We estimated accuracy using hierarchical summary ROC methods. We undertook analysis of studies allowing direct comparison between tests. To facilitate interpretation of results, we computed values of sensitivity at the point on the SROC curve with 80% fixed specificity and values of specificity with 80% fixed sensitivity. We investigated the impact of in-person test interpretation; use of a purposely-developed algorithm to assist diagnosis; and observer expertise. MAIN RESULTS We included 24 publications reporting on 24 study cohorts, providing 27 visual inspection datasets (8805 lesions; 2579 malignancies) and 33 dermoscopy datasets (6855 lesions; 1444 malignancies). The risk of bias was mainly low for the index test (for dermoscopy evaluations) and reference standard domains, particularly for in-person evaluations, and high or unclear for participant selection, application of the index test for visual inspection and for participant flow and timing. We scored concerns about the applicability of study findings as of 'high' or 'unclear' concern for almost all studies across all domains assessed. Selective participant recruitment, lack of reproducibility of diagnostic thresholds and lack of detail on observer expertise were particularly problematic.The detection of BCC was reported in 28 datasets; 15 on an in-person basis and 13 image-based. Analysis of studies by prior testing of participants and according to observer expertise was not possible due to lack of data. Studies were primarily conducted in participants referred for specialist assessment of lesions with available histological classification. We found no clear differences in accuracy between dermoscopy studies undertaken in person and those which evaluated images. The lack of effect observed may be due to other sources of heterogeneity, including variations in the types of skin lesion studied, in dermatoscopes used, or in the use of algorithms and varying thresholds for deciding on a positive test result.Meta-analysis found in-person evaluations of dermoscopy (7 evaluations; 4683 lesions and 363 BCCs) to be more accurate than visual inspection alone for the detection of BCC (8 evaluations; 7017 lesions and 1586 BCCs), with a relative diagnostic odds ratio (RDOR) of 8.2 (95% confidence interval (CI) 3.5 to 19.3; P < 0.001). This corresponds to predicted differences in sensitivity of 14% (93% versus 79%) at a fixed specificity of 80% and predicted differences in specificity of 22% (99% versus 77%) at a fixed sensitivity of 80%. We observed very similar results for the image-based evaluations.When applied to a hypothetical population of 1000 lesions, of which 170 are BCC (based on median BCC prevalence across studies), an increased sensitivity of 14% from dermoscopy would lead to 24 fewer BCCs missed, assuming 166 false positive results from both tests. A 22% increase in specificity from dermoscopy with sensitivity fixed at 80% would result in 183 fewer unnecessary excisions, assuming 34 BCCs missed for both tests. There was not enough evidence to assess the use of algorithms or structured checklists for either visual inspection or dermoscopy.Insufficient data were available to draw conclusions on the accuracy of either test for the detection of cSCCs. AUTHORS' CONCLUSIONS Dermoscopy may be a valuable tool for the diagnosis of BCC as an adjunct to visual inspection of a suspicious skin lesion following a thorough history-taking including assessment of risk factors for keratinocyte cancer. The evidence primarily comes from secondary-care (referred) populations and populations with pigmented lesions or mixed lesion types. There is no clear evidence supporting the use of currently-available formal algorithms to assist dermoscopy diagnosis.
Collapse
Affiliation(s)
- Jacqueline Dinnes
- University of BirminghamInstitute of Applied Health ResearchBirminghamUKB15 2TT
- University Hospitals Birmingham NHS Foundation Trust and University of BirminghamNIHR Birmingham Biomedical Research CentreBirminghamUK
| | - Jonathan J Deeks
- University of BirminghamInstitute of Applied Health ResearchBirminghamUKB15 2TT
- University Hospitals Birmingham NHS Foundation Trust and University of BirminghamNIHR Birmingham Biomedical Research CentreBirminghamUK
| | - Naomi Chuchu
- University of BirminghamInstitute of Applied Health ResearchBirminghamUKB15 2TT
| | - Rubeta N Matin
- Churchill HospitalDepartment of DermatologyOld RoadHeadingtonOxfordUKOX3 7LE
| | - Kai Yuen Wong
- Oxford University Hospitals NHS Foundation TrustDepartment of Plastic and Reconstructive SurgeryOxfordUK
| | - Roger Benjamin Aldridge
- NHS Lothian/University of EdinburghDepartment of Plastic Surgery25/6 India StreetEdinburghUKEH3 6HE
| | - Alana Durack
- Addenbrooke’s Hospital, Cambridge University Hospitals NHS Foundation TrustDermatologyHills RoadCambridgeUKCB2 0QQ
| | - Abha Gulati
- Barts Health NHS TrustDepartment of DermatologyWhitechapelLondonUKE11BB
| | - Sue Ann Chan
- City HospitalBirmingham Skin CentreDudley RdBirminghamUKB18 7QH
| | - Louise Johnston
- NIHR Diagnostic Evidence Co‐operative Newcastle2nd Floor William Leech Building (Rm M2.061) Institute of Cellular Medicine Newcastle UniversityFramlington PlaceNewcastle upon TyneUKNE2 4HH
| | - Susan E Bayliss
- University of BirminghamInstitute of Applied Health ResearchBirminghamUKB15 2TT
| | - Jo Leonardi‐Bee
- The University of NottinghamDivision of Epidemiology and Public HealthClinical Sciences BuildingNottingham City Hospital NHS Trust Campus, Hucknall RoadNottinghamUKNG5 1PB
| | - Yemisi Takwoingi
- University of BirminghamInstitute of Applied Health ResearchBirminghamUKB15 2TT
- University Hospitals Birmingham NHS Foundation Trust and University of BirminghamNIHR Birmingham Biomedical Research CentreBirminghamUK
| | - Clare Davenport
- University of BirminghamInstitute of Applied Health ResearchBirminghamUKB15 2TT
| | | | - Hamid Tehrani
- Whiston HospitalDepartment of Plastic and Reconstructive SurgeryWarrington RoadLiverpoolUKL35 5DR
| | - Hywel C Williams
- University of NottinghamCentre of Evidence Based DermatologyQueen's Medical CentreDerby RoadNottinghamUKNG7 2UH
| | | | | |
Collapse
|
2
|
Chuchu N, Dinnes J, Takwoingi Y, Matin RN, Bayliss SE, Davenport C, Moreau JF, Bassett O, Godfrey K, O'Sullivan C, Walter FM, Motley R, Deeks JJ, Williams HC. Teledermatology for diagnosing skin cancer in adults. Cochrane Database Syst Rev 2018; 12:CD013193. [PMID: 30521686 PMCID: PMC6517019 DOI: 10.1002/14651858.cd013193] [Citation(s) in RCA: 46] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/16/2023]
Abstract
BACKGROUND Early accurate detection of all skin cancer types is essential to guide appropriate management and to improve morbidity and survival. Melanoma and squamous cell carcinoma (SCC) are high-risk skin cancers which have the potential to metastasise and ultimately lead to death, whereas basal cell carcinoma (BCC) is usually localised with potential to infiltrate and damage surrounding tissue. Anxiety around missing early curable cases needs to be balanced against inappropriate referral and unnecessary excision of benign lesions. Teledermatology provides a way for generalist clinicians to access the opinion of a specialist dermatologist for skin lesions that they consider to be suspicious without referring the patients through the normal referral pathway. Teledermatology consultations can be 'store-and-forward' with electronic digital images of a lesion sent to a dermatologist for review at a later time, or can be live and interactive consultations using videoconferencing to connect the patient, referrer and dermatologist in real time. OBJECTIVES To determine the diagnostic accuracy of teledermatology for the detection of any skin cancer (melanoma, BCC or cutaneous squamous cell carcinoma (cSCC)) in adults, and to compare its accuracy with that of in-person diagnosis. SEARCH METHODS We undertook a comprehensive search of the following databases from inception up to August 2016: Cochrane Central Register of Controlled Trials, MEDLINE, Embase, CINAHL, CPCI, Zetoc, Science Citation Index, US National Institutes of Health Ongoing Trials Register, NIHR Clinical Research Network Portfolio Database and the World Health Organization International Clinical Trials Registry Platform. We studied reference lists and published systematic review articles. SELECTION CRITERIA Studies evaluating skin cancer diagnosis for teledermatology alone, or in comparison with face-to-face diagnosis by a specialist clinician, compared with a reference standard of histological confirmation or clinical follow-up and expert opinion. We also included studies evaluating the referral accuracy of teledermatology compared with a reference standard of face-to-face diagnosis by a specialist clinician. DATA COLLECTION AND ANALYSIS Two review authors independently extracted all data using a standardised data extraction and quality assessment form (based on QUADAS-2). We contacted authors of included studies where there were information related to the target condition of any skin cancer missing. Data permitting, we estimated summary sensitivities and specificities using the bivariate hierarchical model. Due to the scarcity of data, we undertook no covariate investigations for this review. For illustrative purposes, we plotted estimates of sensitivity and specificity on coupled forest plots for diagnostic threshold and target condition under consideration. MAIN RESULTS The review included 22 studies reporting diagnostic accuracy data for 4057 lesions and 879 malignant cases (16 studies) and referral accuracy data for reported data for 1449 lesions and 270 'positive' cases as determined by the reference standard face-to-face decision (six studies). Methodological quality was variable with poor reporting hindering assessment. The overall risk of bias was high or unclear for participant selection, reference standard, and participant flow and timing in at least half of all studies; the majority were at low risk of bias for the index test. The applicability of study findings were of high or unclear concern for most studies in all domains assessed due to the recruitment of participants from secondary care settings or specialist clinics rather than from primary or community-based settings in which teledermatology is more likely to be used and due to the acquisition of lesion images by dermatologists or in specialist imaging units rather than by primary care clinicians.Seven studies provided data for the primary target condition of any skin cancer (1588 lesions and 638 malignancies). For the correct diagnosis of lesions as malignant using photographic images, summary sensitivity was 94.9% (95% confidence interval (CI) 90.1% to 97.4%) and summary specificity was 84.3% (95% CI 48.5% to 96.8%) (from four studies). Individual study estimates using dermoscopic images or a combination of photographic and dermoscopic images generally suggested similarly high sensitivities with highly variable specificities. Limited comparative data suggested similar diagnostic accuracy between teledermatology assessment and in-person diagnosis by a dermatologist; however, data were too scarce to draw firm conclusions. For the detection of invasive melanoma or atypical intraepidermal melanocytic variants both sensitivities and specificities were more variable. Sensitivities ranged from 59% (95% CI 42% to 74%) to 100% (95% CI 48% to 100%) and specificities from 30% (95% CI 22% to 40%) to 100% (95% CI 93% to 100%), with reported diagnostic thresholds including the correct diagnosis of melanoma, classification of lesions as 'atypical' or 'typical, and the decision to refer or to excise a lesion.Referral accuracy data comparing teledermatology against a face-to-face reference standard suggested good agreement for lesions considered to require some positive action by face-to-face assessment (sensitivities of over 90%). For lesions considered of less concern when assessed face-to-face (e.g. for lesions not recommended for excision or referral), agreement was more variable with teledermatology specificities ranging from 57% (95% CI 39% to 73%) to 100% (95% CI 86% to 100%), suggesting that remote assessment is more likely recommend excision, referral or follow-up compared to in-person decisions. AUTHORS' CONCLUSIONS Studies were generally small and heterogeneous and methodological quality was difficult to judge due to poor reporting. Bearing in mind concerns regarding the applicability of study participants and of lesion image acquisition in specialist settings, our results suggest that teledermatology can correctly identify the majority of malignant lesions. Using a more widely defined threshold to identify 'possibly' malignant cases or lesions that should be considered for excision is likely to appropriately triage those lesions requiring face-to-face assessment by a specialist. Despite the increasing use of teledermatology on an international level, the evidence base to support its ability to accurately diagnose lesions and to triage lesions from primary to secondary care is lacking and further prospective and pragmatic evaluation is needed.
Collapse
Affiliation(s)
- Naomi Chuchu
- University of BirminghamInstitute of Applied Health ResearchBirminghamUKB15 2TT
| | - Jacqueline Dinnes
- University of BirminghamInstitute of Applied Health ResearchBirminghamUKB15 2TT
- University Hospitals Birmingham NHS Foundation Trust and University of BirminghamNIHR Birmingham Biomedical Research CentreBirminghamUK
| | - Yemisi Takwoingi
- University of BirminghamInstitute of Applied Health ResearchBirminghamUKB15 2TT
- University Hospitals Birmingham NHS Foundation Trust and University of BirminghamNIHR Birmingham Biomedical Research CentreBirminghamUK
| | - Rubeta N Matin
- Churchill HospitalDepartment of DermatologyOld RoadHeadingtonOxfordUKOX3 7LE
| | - Susan E Bayliss
- University of BirminghamInstitute of Applied Health ResearchBirminghamUKB15 2TT
| | - Clare Davenport
- University of BirminghamInstitute of Applied Health ResearchBirminghamUKB15 2TT
| | - Jacqueline F Moreau
- University of Pittsburgh Medical CenterInternal MedicineDepartment of Medicine, Office of EducationUPMC Montefiore Hospital, N715PittsburghUSAPA, 15213
| | - Oliver Bassett
- Addenbrooke's HospitalPlastic SurgeryHills RoadCambridgeUKCB2 0QQ
| | - Kathie Godfrey
- The University of Nottinghamc/o Cochrane Skin GroupNottinghamUK
| | | | - Fiona M Walter
- University of CambridgePublic Health & Primary CareStrangeways Research Laboratory, Worts CausewayCambridgeUKCB1 8RN
| | - Richard Motley
- University Hospital of WalesWelsh Institute of DermatologyHeath ParkCardiffUKCF14 4XW
| | - Jonathan J Deeks
- University of BirminghamInstitute of Applied Health ResearchBirminghamUKB15 2TT
- University Hospitals Birmingham NHS Foundation Trust and University of BirminghamNIHR Birmingham Biomedical Research CentreBirminghamUK
| | - Hywel C Williams
- University of NottinghamCentre of Evidence Based DermatologyQueen's Medical CentreDerby RoadNottinghamUKNG7 2UH
| | | | | |
Collapse
|
3
|
Dinnes J, Deeks JJ, Chuchu N, Ferrante di Ruffano L, Matin RN, Thomson DR, Wong KY, Aldridge RB, Abbott R, Fawzy M, Bayliss SE, Grainge MJ, Takwoingi Y, Davenport C, Godfrey K, Walter FM, Williams HC. Dermoscopy, with and without visual inspection, for diagnosing melanoma in adults. Cochrane Database Syst Rev 2018; 12:CD011902. [PMID: 30521682 PMCID: PMC6517096 DOI: 10.1002/14651858.cd011902.pub2] [Citation(s) in RCA: 69] [Impact Index Per Article: 11.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/13/2023]
Abstract
BACKGROUND Melanoma has one of the fastest rising incidence rates of any cancer. It accounts for a small percentage of skin cancer cases but is responsible for the majority of skin cancer deaths. Although history-taking and visual inspection of a suspicious lesion by a clinician are usually the first in a series of 'tests' to diagnose skin cancer, dermoscopy has become an important tool to assist diagnosis by specialist clinicians and is increasingly used in primary care settings. Dermoscopy is a magnification technique using visible light that allows more detailed examination of the skin compared to examination by the naked eye alone. Establishing the additive value of dermoscopy over and above visual inspection alone across a range of observers and settings is critical to understanding its contribution for the diagnosis of melanoma and to future understanding of the potential role of the growing number of other high-resolution image analysis techniques. OBJECTIVES To determine the diagnostic accuracy of dermoscopy alone, or when added to visual inspection of a skin lesion, for the detection of cutaneous invasive melanoma and atypical intraepidermal melanocytic variants in adults. We separated studies according to whether the diagnosis was recorded face-to-face (in-person), or based on remote (image-based), assessment. SEARCH METHODS We undertook a comprehensive search of the following databases from inception up to August 2016: CENTRAL; MEDLINE; Embase; CINAHL; CPCI; Zetoc; Science Citation Index; US National Institutes of Health Ongoing Trials Register; NIHR Clinical Research Network Portfolio Database; and the World Health Organization International Clinical Trials Registry Platform. We studied reference lists and published systematic review articles. SELECTION CRITERIA Studies of any design that evaluated dermoscopy in adults with lesions suspicious for melanoma, compared with a reference standard of either histological confirmation or clinical follow-up. Data on the accuracy of visual inspection, to allow comparisons of tests, was included only if reported in the included studies of dermoscopy. DATA COLLECTION AND ANALYSIS Two review authors independently extracted all data using a standardised data extraction and quality assessment form (based on QUADAS-2). We contacted authors of included studies where information related to the target condition or diagnostic threshold were missing. We estimated accuracy using hierarchical summary receiver operating characteristic (SROC),methods. Analysis of studies allowing direct comparison between tests was undertaken. To facilitate interpretation of results, we computed values of sensitivity at the point on the SROC curve with 80% fixed specificity and values of specificity with 80% fixed sensitivity. We investigated the impact of in-person test interpretation; use of a purposely developed algorithm to assist diagnosis; observer expertise; and dermoscopy training. MAIN RESULTS We included a total of 104 study publications reporting on 103 study cohorts with 42,788 lesions (including 5700 cases), providing 354 datasets for dermoscopy. The risk of bias was mainly low for the index test and reference standard domains and mainly high or unclear for participant selection and participant flow. Concerns regarding the applicability of study findings were largely scored as 'high' concern in three of four domains assessed. Selective participant recruitment, lack of reproducibility of diagnostic thresholds and lack of detail on observer expertise were particularly problematic.The accuracy of dermoscopy for the detection of invasive melanoma or atypical intraepidermal melanocytic variants was reported in 86 datasets; 26 for evaluations conducted in person (dermoscopy added to visual inspection), and 60 for image-based evaluations (diagnosis based on interpretation of dermoscopic images). Analyses of studies by prior testing revealed no obvious effect on accuracy; analyses were hampered by the lack of studies in primary care, lack of relevant information and the restricted inclusion of lesions selected for biopsy or excision. Accuracy was higher for in-person diagnosis compared to image-based evaluations (relative diagnostic odds ratio (RDOR) 4.6, 95% confidence interval (CI) 2.4 to 9.0; P < 0.001).We compared accuracy for (a), in-person evaluations of dermoscopy (26 evaluations; 23,169 lesions and 1664 melanomas),versus visual inspection alone (13 evaluations; 6740 lesions and 459 melanomas), and for (b), image-based evaluations of dermoscopy (60 evaluations; 13,475 lesions and 2851 melanomas),versus image-based visual inspection (11 evaluations; 1740 lesions and 305 melanomas). For both comparisons, meta-analysis found dermoscopy to be more accurate than visual inspection alone, with RDORs of (a), 4.7 (95% CI 3.0 to 7.5; P < 0.001), and (b), 5.6 (95% CI 3.7 to 8.5; P < 0.001). For a), the predicted difference in sensitivity at a fixed specificity of 80% was 16% (95% CI 8% to 23%; 92% for dermoscopy + visual inspection versus 76% for visual inspection), and predicted difference in specificity at a fixed sensitivity of 80% was 20% (95% CI 7% to 33%; 95% for dermoscopy + visual inspection versus 75% for visual inspection). For b) the predicted differences in sensitivity was 34% (95% CI 24% to 46%; 81% for dermoscopy versus 47% for visual inspection), at a fixed specificity of 80%, and predicted difference in specificity was 40% (95% CI 27% to 57%; 82% for dermoscopy versus 42% for visual inspection), at a fixed sensitivity of 80%.Using the median prevalence of disease in each set of studies ((a), 12% for in-person and (b), 24% for image-based), for a hypothetical population of 1000 lesions, an increase in sensitivity of (a), 16% (in-person), and (b), 34% (image-based), from using dermoscopy at a fixed specificity of 80% equates to a reduction in the number of melanomas missed of (a), 19 and (b), 81 with (a), 176 and (b), 152 false positive results. An increase in specificity of (a), 20% (in-person), and (b), 40% (image-based), at a fixed sensitivity of 80% equates to a reduction in the number of unnecessary excisions from using dermoscopy of (a), 176 and (b), 304 with (a), 24 and (b), 48 melanomas missed.The use of a named or published algorithm to assist dermoscopy interpretation (as opposed to no reported algorithm or reported use of pattern analysis), had no significant impact on accuracy either for in-person (RDOR 1.4, 95% CI 0.34 to 5.6; P = 0.17), or image-based (RDOR 1.4, 95% CI 0.60 to 3.3; P = 0.22), evaluations. This result was supported by subgroup analysis according to algorithm used. We observed higher accuracy for observers reported as having high experience and for those classed as 'expert consultants' in comparison to those considered to have less experience in dermoscopy, particularly for image-based evaluations. Evidence for the effect of dermoscopy training on test accuracy was very limited but suggested associated improvements in sensitivity. AUTHORS' CONCLUSIONS Despite the observed limitations in the evidence base, dermoscopy is a valuable tool to support the visual inspection of a suspicious skin lesion for the detection of melanoma and atypical intraepidermal melanocytic variants, particularly in referred populations and in the hands of experienced users. Data to support its use in primary care are limited, however, it may assist in triaging suspicious lesions for urgent referral when employed by suitably trained clinicians. Formal algorithms may be of most use for dermoscopy training purposes and for less expert observers, however reliable data comparing approaches using dermoscopy in person are lacking.
Collapse
Affiliation(s)
- Jacqueline Dinnes
- University of BirminghamInstitute of Applied Health ResearchBirminghamUKB15 2TT
- University Hospitals Birmingham NHS Foundation Trust and University of BirminghamNIHR Birmingham Biomedical Research CentreBirminghamUK
| | - Jonathan J Deeks
- University of BirminghamInstitute of Applied Health ResearchBirminghamUKB15 2TT
- University Hospitals Birmingham NHS Foundation Trust and University of BirminghamNIHR Birmingham Biomedical Research CentreBirminghamUK
| | - Naomi Chuchu
- University of BirminghamInstitute of Applied Health ResearchBirminghamUKB15 2TT
| | | | - Rubeta N Matin
- Churchill HospitalDepartment of DermatologyOld RoadHeadingtonOxfordUKOX3 7LE
| | | | - Kai Yuen Wong
- Oxford University Hospitals NHS Foundation TrustDepartment of Plastic and Reconstructive SurgeryOxfordUK
| | - Roger Benjamin Aldridge
- NHS Lothian/University of EdinburghDepartment of Plastic Surgery25/6 India StreetEdinburghUKEH3 6HE
| | - Rachel Abbott
- University Hospital of WalesWelsh Institute of DermatologyHeath ParkCardiffUKCF14 4XW
| | - Monica Fawzy
- Norfolk and Norwich University Hospital NHS TrustDepartment of Plastic and Reconstructive SurgeryColney LaneNorwichUKNR4 7UY
| | - Susan E Bayliss
- University of BirminghamInstitute of Applied Health ResearchBirminghamUKB15 2TT
| | - Matthew J Grainge
- School of MedicineDivision of Epidemiology and Public HealthUniversity of NottinghamNottinghamUKNG7 2UH
| | - Yemisi Takwoingi
- University of BirminghamInstitute of Applied Health ResearchBirminghamUKB15 2TT
- University Hospitals Birmingham NHS Foundation Trust and University of BirminghamNIHR Birmingham Biomedical Research CentreBirminghamUK
| | - Clare Davenport
- University of BirminghamInstitute of Applied Health ResearchBirminghamUKB15 2TT
| | - Kathie Godfrey
- The University of Nottinghamc/o Cochrane Skin GroupNottinghamUK
| | - Fiona M Walter
- University of CambridgePublic Health & Primary CareStrangeways Research Laboratory, Worts CausewayCambridgeUKCB1 8RN
| | - Hywel C Williams
- University of NottinghamCentre of Evidence Based DermatologyQueen's Medical CentreDerby RoadNottinghamUKNG7 2UH
| | | | | |
Collapse
|
4
|
Platiša L, Brantegem LV, Kumcu A, Ducatelle R, Philips W. Influence of study design on digital pathology image quality evaluation: the need to define a clinical task. J Med Imaging (Bellingham) 2017; 4:021108. [PMID: 28653011 PMCID: PMC5478946 DOI: 10.1117/1.jmi.4.2.021108] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2016] [Accepted: 05/22/2017] [Indexed: 11/14/2022] Open
Abstract
Despite the current rapid advance in technologies for whole slide imaging, there is still no scientific consensus on the recommended methodology for image quality assessment of digital pathology slides. For medical images in general, it has been recommended to assess image quality in terms of doctors' success rates in performing a specific clinical task while using the images (clinical image quality, cIQ). However, digital pathology is a new modality, and already identifying the appropriate task is difficult. In an alternative common approach, humans are asked to do a simpler task such as rating overall image quality (perceived image quality, pIQ), but that involves the risk of nonclinically relevant findings due to an unknown relationship between the pIQ and cIQ. In this study, we explored three different experimental protocols: (1) conducting a clinical task (detecting inclusion bodies), (2) rating image similarity and preference, and (3) rating the overall image quality. Additionally, within protocol 1, overall quality ratings were also collected (task-aware pIQ). The experiments were done by diagnostic veterinary pathologists in the context of evaluating the quality of hematoxylin and eosin-stained digital pathology slides of animal tissue samples under several common image alterations: additive noise, blurring, change in gamma, change in color saturation, and JPG compression. While the size of our experiments was small and prevents drawing strong conclusions, the results suggest the need to define a clinical task. Importantly, the pIQ data collected under protocols 2 and 3 did not always rank the image alterations the same as their cIQ from protocol 1, warning against using conventional pIQ to predict cIQ. At the same time, there was a correlation between the cIQ and task-aware pIQ ratings from protocol 1, suggesting that the clinical experiment context (set by specifying the clinical task) may affect human visual attention and bring focus to their criteria of image quality. Further research is needed to assess whether and for which purposes (e.g., preclinical testing) task-aware pIQ ratings could substitute cIQ for a given clinical task.
Collapse
Affiliation(s)
- Ljiljana Platiša
- Ghent University, Faculty of Engineering and Architecture, Department of Telecommunications and Information Processing, imec-IPI-UGent, Ghent, Belgium
| | - Leen Van Brantegem
- Ghent University, Faculty of Veterinary Medicine, Department of Pathology, Bacteriology and Poultry Diseases, Merelbeke, Belgium
| | - Asli Kumcu
- Ghent University, Faculty of Engineering and Architecture, Department of Telecommunications and Information Processing, imec-IPI-UGent, Ghent, Belgium
| | - Richard Ducatelle
- Ghent University, Faculty of Veterinary Medicine, Department of Pathology, Bacteriology and Poultry Diseases, Merelbeke, Belgium
| | - Wilfried Philips
- Ghent University, Faculty of Engineering and Architecture, Department of Telecommunications and Information Processing, imec-IPI-UGent, Ghent, Belgium
| |
Collapse
|
5
|
Provedel LF, Pimentel BNADS, Jesus TMD, Lacerda APS, Rubira-Bullen IRF, Sarmento VA. Effects of Image Compression on Linear Measurements of Digital Panoramic Radiographs. Braz Dent J 2016; 27:757-760. [DOI: 10.1590/0103-6440201601157] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2016] [Accepted: 09/06/2016] [Indexed: 11/21/2022] Open
Abstract
Abstract This study aimed to evaluate the accuracy of panoramic radiographs obtained by digital system based on charge coupled device (CCD) and a phosphor storage plate (PSP) system with two different file formats, JPEG irreversible type and BMP. Linear measurements of artificial bony defects were made in dry mandibles with a digital caliper. Measures of digital panoramic radiographs were taken in ImageJ(r) software. Each measurement was performed twice by an experienced examiner. The intra-rater agreement was considered very strong (Pearson's correlation coefficient of 0.97). There was no significant difference between the linear measurements of dry mandibles, considered the gold standard, in relation to measurements obtained from digital radiographs (p=0.47). The error of these measures for the CCD was 1.04 mm (9.97%) for JPEG images and 1.03 mm (9.99%) for those with BMP format. For the PSP images, these values were 1.48 mm (14.94%) and 1.43 mm (14.43%), respectively. Although there was no statistical difference between the images with JPEG and BMP format, for both digital systems (p=1.00 for CCD and p=0.98 for PSP system), errors made on radiographs obtained by PSP system were significantly higher than those of CCD (p<0.05). The size of the files saved in JPEG was also significantly lower (p=0.005) compared with the files saved in BMP. It may be concluded that the digital radiographs, both saved in JPEG and BMP formats, are accurate, regardless the used digital system, and JPEG images are more suitable for teleradiology.
Collapse
|
6
|
Abstract
BACKGROUND As a product of electronic health, teledermatology is a cost-effective means of improving access to care, facilitating specialist consultations, and supporting patient self-management. Even so, use of traditional teledermatology services is limited by infrastructure and costs in the form of digital cameras, computers, and Internet access. METHODS Considering the significant improvement in smartphone camera resolution and the rapidly increasing number of physicians using smartphones, we explored the use of smartphones as reliable, effective clinical tools in store-and-forward teledermatology. We describe the technical specifications of modern smartphone cameras, the widespread use of smartphones by physicians, and the advantages of smartphones over traditional camera and Internet teledermatology, and we propose recommendations as to how mobile teledermatology may be more effectively used in modern dermatologic practice.
Collapse
|
7
|
Zhang K, Liu WL, Locatis C, Ackerman M. Uncompressed high-definition videoconferencing tools for telemedicine and distance learning. Telemed J E Health 2013; 19:579-84. [PMID: 23808905 PMCID: PMC3719438 DOI: 10.1089/tmj.2012.0219] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2012] [Revised: 11/21/2012] [Accepted: 11/23/2012] [Indexed: 11/12/2022] Open
Abstract
Uncompressed high-definition (HD) video image quality is superior to compressed HD video provided in most commercially available videoconferencing products. Uncompressed HD videoconferencing tools provide a more immersive experience because there is no reduction of image information and, in most cases, lower latency. Four open source uncompressed video applications are reviewed that have been tested at the National Library of Medicine: three transmitting uncompressed HD video and one transmitting loosely compressed standard-definition video. The technical requirements for implementing each are described, and test results in terms of image quality, latency, and application reliability are presented. Because the hardware and bandwidth requirements for uncompressed HD video are relatively high and most applications are still under development, they are generally not ready for mass deployment. Some are, however, ready for pilot testing and experimentation in clinical settings by either those who have or anticipate having bandwidth sufficient to support them or those interested in researching the effects higher-quality video may have on diagnostic and other clinical outcomes.
Collapse
Affiliation(s)
- Kai Zhang
- Office of High Performance Computing and Communications, National Library of Medicine, National Institutes of Health, Bethesda, MD 20894, USA.
| | | | | | | |
Collapse
|
8
|
Guarneri F, Vaccaro M, Guarneri C, Cannavò SP. JPEG vs. JPEG2000: benchmarking with dermatological images. Skin Res Technol 2013; 20:67-73. [PMID: 23724923 DOI: 10.1111/srt.12085] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/03/2013] [Indexed: 11/29/2022]
Abstract
BACKGROUND Despite the importance of images in the discipline and the diffusion of digital imaging devices, the issue of image compression in dermatology was discussed only in few studies, which yielded results often not comparable, and left some unanswered questions. OBJECTIVE To evaluate and compare the performance of the JPEG and JPEG2000 algorithms for compression of dermatological images. METHODS Nineteen macroscopic and fifteen videomicroscopic images of skin lesions were compressed with JPEG and JPEG2000 at 18 different compression rates, from 90% to 99.5%. Compressed images were shown, next to uncompressed versions, to three dermatologists with different experience, who judged quality and suitability for educational/scientific and diagnostic purposes. Moreover, alterations and quality were evaluated by calculation of mean 'distance' of pixel colors between compressed and original images and by peak signal-to-noise ratio, respectively. RESULTS JPEG2000 was qualitatively better than JPEG at all compression rates, particularly highest ones, as shown by dermatologists' ratings and objective parameters. Agreement between raters was high, but with some differences in specific cases, showing that different professional experience can influence judgement on images. CONCLUSION In consideration of its high qualitative performance and wide diffusion, JPEG2000 represents an optimal solution for the compression of digital dermatological images.
Collapse
Affiliation(s)
- F Guarneri
- Dipartimento di Medicina Clinica e Sperimentale - Dermatologia, University of Messina, Messina, Italy
| | | | | | | |
Collapse
|
9
|
Quintana J, Garcia R, Neumann L. A novel method for color correction in epiluminescence microscopy. Comput Med Imaging Graph 2011; 35:646-52. [DOI: 10.1016/j.compmedimag.2011.03.006] [Citation(s) in RCA: 28] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2010] [Revised: 03/03/2011] [Accepted: 03/24/2011] [Indexed: 11/15/2022]
|
10
|
Kroemer S, Frühauf J, Campbell T, Massone C, Schwantzer G, Soyer H, Hofmann-Wellenhof R. Mobile teledermatology for skin tumour screening: diagnostic accuracy of clinical and dermoscopic image tele-evaluation using cellular phones. Br J Dermatol 2011; 164:973-9. [DOI: 10.1111/j.1365-2133.2011.10208.x] [Citation(s) in RCA: 147] [Impact Index Per Article: 11.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
11
|
Gulkesen KH, Akman A, Yuce YK, Yilmaz E, Samur AA, Isleyen F, Cakcak DS, Alpsoy E. Evaluation of JPEG and JPEG2000 compression algorithms for dermatological images. J Eur Acad Dermatol Venereol 2009; 24:893-6. [DOI: 10.1111/j.1468-3083.2009.03538.x] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
|
12
|
Guarneri F, Vaccaro M, Guarneri C. Digital image compression in dermatology: format comparison. Telemed J E Health 2009; 14:666-70. [PMID: 18817495 DOI: 10.1089/tmj.2007.0119] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Abstract
Digital image compression (reduction of the amount of numeric data needed to represent a picture) is widely used in electronic storage and transmission devices. Few studies have compared the suitability of the different compression algorithms for dermatologic images. We aimed at comparing the performance of four popular compression formats, Tagged Image File (TIF), Portable Network Graphics (PNG), Joint Photographic Expert Group (JPEG), and JPEG2000 on clinical and videomicroscopic dermatologic images. Nineteen (19) clinical and 15 videomicroscopic digital images were compressed using JPEG and JPEG2000 at various compression factors and TIF and PNG. TIF and PNG are "lossless" formats (i.e., without alteration of the image), JPEG is "lossy" (the compressed image has a lower quality than the original), JPEG2000 has a lossless and a lossy mode. The quality of the compressed images was assessed subjectively (by three expert reviewers) and quantitatively (by measuring, point by point, the color differences from the original). Lossless JPEG2000 (49% compression) outperformed the other lossless algorithms, PNG and TIF (42% and 31% compression, respectively). Lossy JPEG2000 compression was slightly less efficient than JPEG, but preserved image quality much better, particularly at higher compression factors. For its good quality and compression ratio, JPEG2000 appears to be a good choice for clinical/videomicroscopic dermatologic image compression. Additionally, its diffusion and other features, such as the possibility of embedding metadata in the image file and to encode various parts of an image at different compression levels, make it perfectly suitable for the current needs of dermatology and teledermatology.
Collapse
Affiliation(s)
- F Guarneri
- Institute of Dermatology, University of Messina, Messina, Italy.
| | | | | |
Collapse
|
13
|
Fabbrocini G, Balato A, Rescigno O, Mariano M, Scalvenzi M, Brunetti B. Telediagnosis and face-to-face diagnosis reliability for melanocytic and non-melanocytic ‘pink’ lesions. J Eur Acad Dermatol Venereol 2007; 22:229-34. [DOI: 10.1111/j.1468-3083.2007.02400.x] [Citation(s) in RCA: 13] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
14
|
Di Stefani A, Zalaudek I, Argenziano G, Chimenti S, Soyer HP. Feasibility of a two-step teledermatologic approach for the management of patients with multiple pigmented skin lesions. Dermatol Surg 2007; 33:686-92. [PMID: 17550445 DOI: 10.1111/j.1524-4725.2007.33144.x] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
Abstract
BACKGROUND Recent studies demonstrating accuracy of teledermatology and teledermoscopy in the evaluation of pigmented skin lesions (PSL) have been performed only on PSL previously selected by face-to-face examination. OBJECTIVES The objective was to investigate the feasibility of teledermatology for the management of individuals exhibiting multiple PSL with a two-step procedure. MATERIALS AND METHODS In the first step, remote consultants selected clinically equivocal lesions evaluating a teletransmitted clinical image of patients' backs. In the second step, dermoscopic images of selected lesions were evaluated. Management recommendations of both steps were compared with face-to-face. RESULTS For a total of 465 PSL in 18 patients, the agreement between the face-to-face and the two remote experts resulted moderate (kappa value, 0.530-0.565) in the first step and substantial (kappa value, 0.681-0.703) in the second step. CONCLUSIONS Although there are limitations of this pilot experience (population and technical restrictions), our results provide preliminary evidence that a two-step teledermatologic approach may be feasible in managing individuals with multiple PSL.
Collapse
|
15
|
Eminović N, de Keizer NF, Bindels PJE, Hasman A. Maturity of teledermatology evaluation research: a systematic literature review. Br J Dermatol 2007; 156:412-9. [PMID: 17300227 DOI: 10.1111/j.1365-2133.2006.07627.x] [Citation(s) in RCA: 72] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
Abstract
BACKGROUND There is a growing interest in teledermatology in today's clinical practice, but the maturity of the evaluation research of this technology is still unclear. OBJECTIVES This systematic review describes the maturity of teledermatology evaluation research over time and explores what kind of teledermatology outcome measures have been evaluated. METHODS Systematic review of literature found in Medline database (1966 up to April 2006). A telemedicine evaluation strategy consisting of four consecutive research phases (parallel to drug and diagnostics evaluation research) extended with a fifth postimplementation phase was used to classify all included studies by two independent reviewers. In addition, main characteristics (store-and-forward or real-time, study design, outcome measures) were registered. RESULTS Three hundred and forty-five papers were systematically selected from Medline, and 244 papers were excluded. For two randomized controlled trials (RCTs), multiple papers in phase III were found. After correcting for this, 99 studies remained included (11 phase I, 72 phase II, two phase III, six phase IV, eight postimplementation phase). The number of phase II studies is the largest and still growing, while other phases are much less represented. Diagnostic accuracy was the most often used outcome measure and was found in phase I, II and IV. Store-and-forward teledermatology has been evaluated more since 2001, but most phase IV studies (RCTs, including cost aspects) are on real-time teledermatology. CONCLUSIONS Most teledermatology evaluation studies are classified as feasibility studies (phase II). The number of phase III and IV studies remains low through the years. Compared with other specialties in telemedicine (i.e. telesurgery, telepaediatrics), teledermatology seems to be a mature application. However, more evaluation studies with a focus on clinical outcomes such as preventable referrals or time to recovery are needed to prove that teledermatology indeed is a promising and cost-saving technology.
Collapse
Affiliation(s)
- N Eminović
- Department of Medical Informatics, Academic Medical Centre, Meibergdreef 15, 1105 AZ Amsterdam, The Netherlands.
| | | | | | | |
Collapse
|
16
|
Feasibility of a Two-Step Teledermatologic Approach for the Management of Patients with Multiple Pigmented Skin Lesions. Dermatol Surg 2007. [DOI: 10.1097/00042728-200706000-00005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
17
|
Grana C, Pellacani G, Seidenari S. Practical color calibration for dermoscopy, applied to a digital epiluminescence microscope. Skin Res Technol 2005; 11:242-7. [PMID: 16221140 DOI: 10.1111/j.0909-725x.2005.00127.x] [Citation(s) in RCA: 32] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
Abstract
BACKGROUND/PURPOSE The assessment of colors is essential for melanoma (MM) diagnosis, both for pattern analysis on dermoscopic images, and when using semiquantitative methods. Our aim was to provide a simple, precise characterization and reproducible calibration of the color response for dermoscopic instruments. METHODS Three processes were used to correct the non-uniform illumination pattern of the instrument, to easily estimate the camera gamma settings and to describe the color space conversion matrices required to produce standard images, in any color space. A specific color space was also developed to optimize the representation of dermatoscopic colors. The calibration technique was tested both on synthetic reference surfaces and on real images by comparing the difference between the images colors obtained with two different equipments. RESULTS The differences between the images acquired by means of the two instruments, calculated on the reference patterns after calibration, were up to 10 times lower then before, while comparison of histograms referring to real images provided an improvement of about seven times on average. CONCLUSIONS A complete workflow for dermatologic image calibration, which allows the user to continue using his own software and algorithms, but with a much higher informative content, is presented. The technique is simple and may improve cooperation between different research centers, in teleconsulting contexts or for result comparisons.
Collapse
Affiliation(s)
- C Grana
- Department of Computer Engineering, University of Modena and Reggio Emilia, Modena, Italy
| | | | | |
Collapse
|
18
|
Seidenari S, Pellacani G, Grana C. Colors in atypical nevi: a computer description reproducing clinical assessment. Skin Res Technol 2005; 11:36-41. [PMID: 15691257 DOI: 10.1111/j.1600-0846.2005.00097.x] [Citation(s) in RCA: 15] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
Abstract
BACKGROUND/PURPOSE Atypical nevi (AN) share some dermoscopic features with early melanoma (MM), and computer elaboration of digital images could represent a useful support to diagnosis to assess automatically colors in AN, and to compare the data with those referring to clearly benign nevi (BN) and MMs. METHODS An image analysis program enabling the numerical description of color areas in melanocytic lesions was used on 459 videomicroscopic images, referring to 76 AN, 288 clearly BN and 95 MMs. RESULTS Black, white and blue-gray were more frequently found in AN than in clearly BN, but less frequently than in MMs. Color area values significantly differed between the three groups. CONCLUSION The clinical-morphological interpretation of the numerical data, based on the mathematical description of the aspect and distribution of different color areas in different lesion types may contribute to the characterization of AN and their distinction from MMs.
Collapse
Affiliation(s)
- Stefania Seidenari
- Department of Dermatology, University of Modena and Reggio Emila, Italy.
| | | | | |
Collapse
|