CD, or not CD, that is the question: a digital interobserver agreement study in coeliac disease

OBJECTIVE

Coeliac disease (CD) diagnosis generally depends on histological examination of duodenal biopsies. We present the first study analysing the concordance in examination of duodenal biopsies using digitised whole-slide images (WSIs). We further investigate whether the inclusion of immunoglobulin A tissue transglutaminase (IgA tTG) and haemoglobin (Hb) data improves the interobserver agreement of diagnosis.

DESIGN

We undertook a large study of the concordance in histological examination of duodenal biopsies using digitised WSIs in an entirely virtual reporting setting. Our study was organised in two phases: in phase 1, 13 pathologists independently classified 100 duodenal biopsies (40 normal; 40 CD; 20 indeterminate enteropathy) in the absence of any clinical or laboratory data. In phase 2, the same pathologists examined the (re-anonymised) WSIs with the inclusion of IgA tTG and Hb data.

RESULTS

We found the mean probability of two observers agreeing in the absence of additional data to be 0.73 (±0.08) with a corresponding Cohen's kappa of 0.59 (±0.11). We further showed that the inclusion of additional data increased the concordance to 0.80 (±0.06) with a Cohen's kappa coefficient of 0.67 (±0.09).

CONCLUSION

We showed that the addition of serological data significantly improves the quality of CD diagnosis. However, the limited interobserver agreement in CD diagnosis using digitised WSIs, even after the inclusion of IgA tTG and Hb data, indicates the importance of interpreting duodenal biopsy in the appropriate clinical context. It further highlights the unmet need for an objective means of reproducible duodenal biopsy diagnosis, such as the automated analysis of WSIs using artificial intelligence.

Disease activity indices in coeliac disease: systematic review and recommendations for clinical trials

OBJECTIVE

Although several pharmacological agents have emerged as potential adjunctive therapies to a gluten-free diet for coeliac disease, there is currently no widely accepted measure of disease activity used in clinical trials. We conducted a systematic review of coeliac disease activity indices to evaluate their operating properties and potential as outcome measures in registration trials.

DESIGN

MEDLINE, EMBASE and the Cochrane central library were searched from 1966 to 2015 for eligible studies in adult and/or paediatric patients with coeliac disease that included coeliac disease activity markers in their outcome measures. The operating characteristics of histological indices, patient-reported outcomes (PROs) and endoscopic indices were evaluated for content and construct validity, reliability, responsiveness and feasibility using guidelines proposed by the US Food and Drug Administration (FDA).

RESULTS

Of 19 123 citations, 286 studies were eligible, including 24 randomised-controlled trials. Three of five PROs identified met most key evaluative criteria but only the Celiac Disease Symptom Diary (CDSD) and the Celiac Disease Patient-Reported Outcome (CeD PRO) have been approved by the FDA. All histological and endoscopic scores identified lacked content validity. Quantitative morphometric histological analysis had better reliability and responsiveness compared with qualitative scales. Endoscopic indices were infrequently used, and only one index demonstrated responsiveness to effective therapy.

CONCLUSIONS

Current best evidence suggests that the CDSD and the CeD PRO are appropriate for use in the definition of primary end points in coeliac disease registration trials. Morphometric histology should be included as a key secondary or co-primary end point. Further work is needed to optimise end point configuration to inform efficient drug development.