Use of wide-spectrum antimicrobials with blood culture tests during chemotherapy as an accurate marker of febrile neutropenia in the DPC database: A validation study

Validation studies of Japanese administrative health care data: A scoping review

PURPOSE

Large-scale administrative health care databases are increasingly being utilized for research. However, there has not been much literature that validated administrative data in Japan; a previous review identified six validation studies published between 2011 and 2017. We conducted a literature review of studies that assessed the validity of Japanese administrative health care data.

METHODS

We searched for studies published by March 2022 that compared individual-level administrative data with a reference standard from another data source, as well as studies that validated administrative data using other data within the same database. The eligible studies were also summarized based on characteristics which included data types, settings, reference standard used, numbers of patients, and conditions validated.

RESULTS

There were 36 eligible studies, including 29 that used external reference standard and seven that validated administrative data using other data within the same database. Chart review was the reference standard in 21 studies (range of the numbers of patients, 72-1674; 11 studies conducted in single institutions and nine studies in 2-5 institutions). Five studies used a disease registry as the reference standard. Diagnoses of cardiovascular diseases, cancer, and diabetes were frequently evaluated.

CONCLUSIONS

Validation studies are being conducted at an increasing rate in Japan, although most of them are small scale. Further large-scale comprehensive validation studies are necessary to effectively utilize the databases for research.

Validity of diagnoses of respiratory diseases recorded in a Japanese administrative database

BACKGROUND

Validating the information recorded in administrative databases is essential. However, no study has comprehensively validated the accuracy of Japanese Diagnosis Procedure Combination (DPC) data on various respiratory diseases. Therefore, this study aimed to evaluate the validity of diagnoses of respiratory diseases in the DPC database.

METHODS

We conducted chart reviews of 400 patients hospitalized in the departments of respiratory medicine in two acute-care hospitals in Tokyo, between April 1, 2019 and March 31, 2021, and used them as reference standards. The sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) of DPC data on 25 respiratory diseases were determined.

RESULTS

Sensitivity ranged from 22.2% (aspiration pneumonia) to 100% (chronic eosinophilic pneumonia and malignant pleural mesothelioma) and was <50% for eight diseases, while specificity was >90% for all diseases. PPV ranged from 40.0% (aspiration pneumonia) to 100% (coronavirus disease 2019, bronchiectasis, chronic eosinophilic pneumonia, pulmonary hypertension, squamous cell carcinoma, small cell carcinoma, lung cancer of other histological types, and malignant pleural mesothelioma) and was >80% for 16 diseases. Except for chronic obstructive pulmonary disease (82.9%) and interstitial pneumonia (other than idiopathic pulmonary fibrosis) (85.4%), NPV was >90% for all diseases. These validity indices were similar in both hospitals.

CONCLUSIONS

The validity of diagnoses of respiratory diseases in the DPC database was high in general, thereby providing an important basis for future studies.