The Impact of Structured and Standardized Documentation on Documentation Quality; a Multicenter, Retrospective Study

A Consensus to Revise the Minimum Speech Test Battery-Version 3

PURPOSE

The Minimum Speech Test Battery (MSTB) for adults was introduced in 1996 (Nilsson et al., 1996) and subsequently updated in 2011 (Advanced-Bionics et al., 2011). The MSTB has been widely used by clinicians as a guide for cochlear implant (CI) candidacy evaluations and to document post-operative speech recognition performance. Due to changes in candidacy over the past 10 years, a revision to the MSTB was needed.

METHOD

In 2022, the Institute for Cochlear Implant Training (ICIT) recruited a panel of expert CI audiologists to update and revise the MSTB. This panel utilized a modified Delphi consensus process to revise the test battery and to improve its applicability considering recent changes in CI care.

RESULTS

This resulted in the MTSB-Version 3 (MSTB-3), which includes test protocols for identifying not only traditional CI candidates but also possible candidates for electric-acoustic stimulation and patients with single-sided deafness and asymmetric hearing loss. The MSTB-3 provides information that supplements the earlier versions of the MSTB, such as recommendations of when to refer patients for a CI, recommended patient-reported outcome measures, considerations regarding the use of cognitive screeners, and sample report templates for clinical documentation of pre- and post-operative care. Electronic versions of test stimuli, along with all the materials described above, will be available to clinicians via the ICIT website (https://www.cochlearimplanttraining.com).

CONCLUSION

The goal of the MSTB-3 is to be an evidence-based test battery that will facilitate a streamlined standard of care for adult CI candidates and recipients that will be widely used by CI clinicians.

A human centered design approach to define and measure documentation quality using an EHR virtual simulation

Electronic health record (EHR) documentation serves multiple functions, including recording patient health status, enabling interprofessional communication, supporting billing, and providing data to support the quality infrastructure of a Learning Healthcare System. There is no definition and standardized method to assess documentation quality in EHRs. Using a human-centered design (HCD) approach, we define and describe a method to measure documentation quality. Documentation quality was defined as timely, accurate, user-centered, and efficient. Measurement of quality used a virtual simulated standardized patient visit via an EHR vendor platform. By observing and recording documentation efforts, nurse practitioners (NPs) (N = 12) documented the delivery of an Age-Friendly Health System (AFHS) 4Ms (what Matters, Medication, Mentation, and Mobility) clinic visit using a standardized case. Results for timely documentation indicated considerable variability in completion times of documenting the 4Ms. Accuracy varied, as there were many types of episodes of erroneous documentation and extra time in seconds in documenting the 4Ms. The type and frequency of erroneous documentation efforts were related to navigation burden when navigating to different documentation tabs. The evaluated system demonstrated poor usability, with most participants scoring between 60 and 70 on the System Usability Scale (SUS). Efficiency, measured as click burden (the number of clicks used to navigate through a software system), revealed significant variability in the number of clicks required, with the NPs averaging approximately 13 clicks above the minimum requirement. The HCD methodology used in this study to assess the documentation quality proved feasible and provided valuable information on the quality of documentation. By assessing the quality of documentation, the gathered data can be leveraged to enhance documentation, optimize user experience, and elevate the quality of data within a Learning Healthcare System.

Building a performance measurement framework for telephone triage services in Finland: a consensus-making study based on nominal group technique

BACKGROUND

There has been a significant expansion in the measurement of healthcare system performance. However, there is a lack of a comprehensive performance measurement framework to assess the effects of telephone triage services on the urgent care system. The aim of our Delphi study was to construct and validate a performance measurement framework designed explicitly for telephone triage services.

METHODS

This study was conducted in Finland with a group of eight experienced senior physicians from the country's 20 largest joint emergency departments, serving over 90% of the population for urgent care. The Nominal Group Technique (NGT) was utilised to achieve consensus on measuring telephone triage performance. Initially, performance indicators (PIs) were identified through Delphi method rounds from December 10th to December 27th, 2021, with eight experts participating, and from December 29th, 2021, to January 23rd, 2022, where five of these experts responded. NGT further deepened these themes and perspectives, aiding in the development of a comprehensive performance measurement framework. The final framework validation began with an initial round from February 13th to March 3rd, 2022, receiving five responses. Due to the limited number of responses, an additional validation round was conducted from October 29th to November 7th, 2023, resulting in two more responses, increasing the total number of respondents in the validation phase to seven.

RESULTS

The study identified a strong desire among professionals to implement a uniform framework for measuring telephone triage performance. The finalised framework evaluates telephone triage across five dimensions: service accessibility, patient experience, quality and safety, process outcome, and cost per case. Eight specific PIs were established, including call response metrics, service utility, follow-up care type and distribution, ICPC-2 classified encounter reasons, patient compliance with follow-up care, medical history review during assessment, and service cost per call.

CONCLUSIONS

This study validated a performance measurement framework for telephone triage services, utilising existing literature and the NGT method. The framework includes five key dimensions: patient experience, quality and safety, outcome of the telephone triage process, cost per case, and eight PIs. It offers a structured and comprehensive approach to measuring the overall performance of telephone triage services, enhancing our ability to evaluate these services effectively.

Child Migrants in Family Detention in the US: Addressing Fragmented Care

BACKGROUND/OBJECTIVES

Migrant children in family detention facilities often experience frequent relocations and prolonged stays in precarious living conditions. This frequent relocation results in fragmentation of necessary medical care, leading to delays and inadequate medical care. We aim to highlight the critical need for comprehensive medical documentation in immigration detention facilities, a fragmented health care system and potential harm to these children without appropriate medical documentation.

METHODS

We conducted a retrospective review of 165 medical records from children detained at the Karnes County Family Residential Center between June 2018 and October 2020 to evaluate the adequacy of pediatric medical documentation in an Immigration and Customs Enforcement (ICE) family detention facility. Specific areas of interest included acute care, nutrition, immunization, developmental screening, and tuberculosis screening. Simple descriptive statistics were used to analyze the data.

RESULTS

Only 25% of 418 acute medical care visits included specific diagnoses. There was no documentation regarding follow-up recommendations upon release. 97% of children had a chest X-ray completed for tuberculosis screening, however no follow-up recommendations were documented for those with granulomas. Vaccination histories were inconsistently documented. No nutritional categorizations were completed despite 16% of children being at risk for malnutrition or already malnourished.

CONCLUSIONS

Our findings revealed significant gaps in documentation, particularly in medical decision-making and clinical reasoning. In a fragmented medical system, inadequate documentation can result in avoidable errors in diagnosis and management. Improving documentation practices is crucial to ensure that all children, regardless of immigration status, receive quality healthcare aligned with national and international standards.

Use of Lean Management Methodology to Reduce the Rate of Unfinished Nursing Care in the Emergency Observation Room: A Quality Improvement Project

BACKGROUND AND OBJECTIVES

The integration of lean management in optimizing nursing workflow necessitates the careful examination of several factors, including nurses' work efficiency, patient experience, and health outcomes. To evaluate the extent of unfinished nursing care and patient satisfaction, we have incorporated the lean management approach into our quality improvement efforts. This proactive measure aims to address potential adverse outcomes, such as subpar inpatient experiences, escalated occurrence of adverse events, and decreased job satisfaction among nursing staff.

METHODS

We utilized the lean management methodology of value stream mapping in a specific facility between February and August 2021, aiming to pinpoint the crucial areas for enhancing nurses' workflow. By employing fishbone diagrams, we thoroughly analyzed the underlying causes, and subsequently employed the Plan-Do-Study-Act model to execute interventions devised based on these identified causes. Interventions included: (1) specifying the time of doctors' conventional rounds; (2) changing unreasonable scheduling; (3) employing 5S management to manage nursing supplies; and (4) eliminating duplicate papers and electronic reports.

RESULTS

After implementing these interventions, the rate of unfinished nursing reduced from 73.4% to 39.6%, and that of finished nursing care during the shift increased from 38.6% to 71.4%. Overtime was reduced from 37.2 ± 22.4 minutes to 14.1 ± 3.6 minutes. The total patient satisfaction score for the Patient Satisfaction Questionnaire short-form increased (P < .05).

CONCLUSIONS

The lean management of quality improvement methodologies provides effective enhancement to the work efficiency of nurses.

Evaluating Large Language Models for Drafting Emergency Department Discharge Summaries

Importance

Large language models (LLMs) possess a range of capabilities which may be applied to the clinical domain, including text summarization. As ambient artificial intelligence scribes and other LLM-based tools begin to be deployed within healthcare settings, rigorous evaluations of the accuracy of these technologies are urgently needed.

Objective

To investigate the performance of GPT-4 and GPT-3.5-turbo in generating Emergency Department (ED) discharge summaries and evaluate the prevalence and type of errors across each section of the discharge summary.

Design

Cross-sectional study.

Setting

University of California, San Francisco ED.

Participants

We identified all adult ED visits from 2012 to 2023 with an ED clinician note. We randomly selected a sample of 100 ED visits for GPT-summarization.

Exposure

We investigate the potential of two state-of-the-art LLMs, GPT-4 and GPT-3.5-turbo, to summarize the full ED clinician note into a discharge summary.

Main Outcomes and Measures

GPT-3.5-turbo and GPT-4-generated discharge summaries were evaluated by two independent Emergency Medicine physician reviewers across three evaluation criteria: 1) Inaccuracy of GPT-summarized information; 2) Hallucination of information; 3) Omission of relevant clinical information. On identifying each error, reviewers were additionally asked to provide a brief explanation for their reasoning, which was manually classified into subgroups of errors.

Results

From 202,059 eligible ED visits, we randomly sampled 100 for GPT-generated summarization and then expert-driven evaluation. In total, 33% of summaries generated by GPT-4 and 10% of those generated by GPT-3.5-turbo were entirely error-free across all evaluated domains. Summaries generated by GPT-4 were mostly accurate, with inaccuracies found in only 10% of cases, however, 42% of the summaries exhibited hallucinations and 47% omitted clinically relevant information. Inaccuracies and hallucinations were most commonly found in the Plan sections of GPT-generated summaries, while clinical omissions were concentrated in text describing patients' Physical Examination findings or History of Presenting Complaint.

Conclusions and Relevance

In this cross-sectional study of 100 ED encounters, we found that LLMs could generate accurate discharge summaries, but were liable to hallucination and omission of clinically relevant information. A comprehensive understanding of the location and type of errors found in GPT-generated clinical text is important to facilitate clinician review of such content and prevent patient harm.

Evaluating the Quality of Virtual Urgent Care: Barriers, Motivations, and Implementation of Quality Measures

BACKGROUND

Experts estimate virtual urgent care programs could replace approximately 20% of current emergency department visits. In the absence of widespread quality guidance to programs or quality reporting from these programs, little is known about the state of virtual urgent care quality monitoring initiatives.

OBJECTIVE

We sought to characterize ongoing quality monitoring initiatives among virtual urgent care programs.

APPROACH

Semi-structured interviews of virtual health and health system leaders were conducted using a pilot-tested interview guide to assess quality metrics captured related to care effectiveness and equity as well as programs' motivations for and barriers to quality measurement. We classified quality metrics according to the National Quality Forum Telehealth Measurement Framework. We developed a codebook from interview transcripts for qualitative analysis to classify motivations for and barriers to quality measurement.

KEY RESULTS

We contacted 13 individuals, and ultimately interviewed eight (response rate, 61.5%), representing eight unique virtual urgent care programs at primarily academic (6/8) and urban institutions (5/8). Most programs used quality metrics related to clinical and operational effectiveness (7/8). Only one program reported measuring a metric related to equity. Limited resources were most commonly cited by participants (6/8) as a barrier to quality monitoring.

CONCLUSIONS

We identified variation in quality measurement use and content by virtual urgent care programs. With the rapid growth in this approach to care delivery, more work is needed to identify optimal quality metrics. A standardized approach to quality measurement will be key to identifying variation in care and help focus quality improvement by virtual urgent care programs.

Getting More Out of Clinical Documentation: Can Clinical Dashboards Yield Clinically Useful Information?

This study investigated coded data retrieved from clinical dashboards, which are decision-support tools that include a graphical display of clinical progress and clinical activities. Data were extracted from clinical dashboards representing 256 youth (M age = 11.9) from 128 practitioners who were trained in the Managing and Adapting Practice (MAP) system (Chorpita & Daleiden in BF Chorpita EL Daleiden 2014 Structuring the collaboration of science and service in pursuit of a shared vision. 43(2):323 338. 2014, Chorpita & Daleiden in BF Chorpita EL Daleiden 2018 Coordinated strategic action: Aspiring to wisdom in mental health service systems. 25(4):e12264. 2018) in 55 agencies across 5 regional mental health systems. Practitioners labeled up to 35 fields (i.e., descriptions of clinical activities), with the options of drawing from a controlled vocabulary or writing in a client-specific activity. Practitioners then noted when certain activities occurred during the episode of care. Fields from the extracted data were coded and reliability was assessed for Field Type, Practice Element Type, Target Area, and Audience (e.g., Caregiver Psychoeducation: Anxiety would be coded as Field Type = Practice Element; Practice Element Type = Psychoeducation; Target Area = Anxiety; Audience = Caregiver). Coders demonstrated moderate to almost perfect interrater reliability. On average, practitioners recorded two activities per session, and clients had 10 unique activities across all their sessions. Results from multilevel models showed that clinical activity characteristics and sessions accounted for the most variance in the occurrence, recurrence, and co-occurrence of clinical activities, with relatively less variance accounted for by practitioners, clients, and regional systems. Findings are consistent with patterns of practice reported in other studies and suggest that clinical dashboards may be a useful source of clinical information. More generally, the use of a controlled vocabulary for clinical activities appears to increase the retrievability and actionability of healthcare information and thus sets the stage for advancing the utility of clinical documentation.

Standardization of Emergency Department Clinical Note Templates: A Retrospective Analysis across an Integrated Health System

BACKGROUND AND OBJECTIVE

 Clinical documentation is essential for conveying medical decision-making, communication between providers and patients, and capturing quality, billing, and regulatory measures during emergency department (ED) visits. Growing evidence suggests the benefits of note template standardization; however, variations in documentation practices are common. The primary objective of this study is to measure the utilization and coding performance of a standardized ED note template implemented across a nine-hospital health system.

METHODS

 This was a retrospective study before and after the implementation of a standardized ED note template. A multi-disciplinary group consensus was built around standardized note elements, provider note workflows within the electronic health record (EHR), and how to incorporate newly required medical decision-making elements. The primary outcomes measured included the proportion of ED visits using standardized note templates, and the distribution of billing codes in the 6 months before and after implementation.

RESULTS

 In the preimplementation period, a total of six legacy ED note templates were being used across nine EDs, with the most used template accounting for approximately 36% of ED visits. Marked variations in documentation elements were noted across six legacy templates. After the implementation, 82% of ED visits system-wide used a single standardized note template. Following implementation, we observed a 1% increase in the proportion of ED visits coded as highest acuity and an unchanged proportion coded as second highest acuity.

CONCLUSION

 We observed a greater than twofold increase in the use of a standardized ED note template across a nine-hospital health system in anticipation of the new 2023 coding guidelines. The development and utilization of a standardized note template format relied heavily on multi-disciplinary stakeholder engagement to inform design that worked for varied documentation practices within the EHR. After the implementation of a standardized note template, we observed better-than-anticipated coding performance.

Correctly structured problem lists lead to better and faster clinical decision-making in electronic health records compared to non-curated problem lists: A single-blinded crossover randomized controlled trial

BACKGROUND

Correctly structured problem lists in electronic health records (EHRs) offer major benefits to patient care. Without structured lists, diagnosis information is often scatteredly documented in free text, which may contribute to errors and inefficient information retrieval. This study aims to assess whether EHRs with correctly structured problem lists result in better and faster clinical decision-making compared to non-curated problem lists.

METHODS

Two versions of two patient records (A and B) were created in an EHR training environment: one version included diagnosis information structured and coded on the problem list ("correctly structured problem list"), the other version had missing problem list diagnoses and diagnosis information partly documented in free text ("non-curated problem list"). In this single-blinded crossover randomized controlled trial, healthcare providers, who can prescribe medications, from two Dutch university medical center locations first evaluated a randomized version of patient A, then B. Participants were asked to motivate their answer to two medication prescription questions. One (test) question required information similarly presented in both record versions. The second (comparison) question required information documented on problem lists and/or in notes. The primary outcome measure was the correctness of the motivated answer to the comparison question. Secondary outcome measure was the time to answer and motivate both questions correctly.

RESULTS

As planned, 160 participants enrolled. Two were excluded for not meeting inclusion criteria. Correctly structured problem lists increased providers' ability to answer the comparison question correctly (56.3 % versus 33.5 %, McNemar odds ratio 2.80 (1.65-4.93) 95 %-CI). Median time to answer both questions correctly was significantly lower for EHRs with correctly structured problem lists (Wilcoxon-signed-rank test p = 0.00002, with incorrect answers coded equally at slowest time).

CONCLUSIONS

Correctly structured problem lists lead to better and faster clinical decision-making. Increased structured problem lists usage may be warranted for which implementation policies should be developed.

Learnings in Digital Health Design: Insights From a Pilot Web App for Structured Note-Taking for Patients With Rheumatoid Arthritis

BACKGROUND

Patients fail to accurately remember 40% to 80% of medical information relayed during doctor appointments, and most standard after-visit summaries fail to effectively help patients comply with behaviors to manage their health conditions. The value of technology to empower and engage patients in their health management has been shown, and here we apply technology to help patients remember and act upon information communicated during their medical appointments.

OBJECTIVE

We describe the development of WellNote, a digital notebook designed for patients to create a customized plan to manage their condition, plan for their appointments, track important actions (eg, medications and labs), and receive reminders for appointments and labs.

METHODS

For this pilot, we chose to focus on rheumatoid arthritis, a chronic condition that relies on many of these features. The development of WellNote followed a structured method based on design thinking and co-design principles, with the app built in close collaboration with patients and a physician partner to ensure clinical relevance. Our design process consisted of 3 rounds: patient and physician interviews, visual prototypes, and a functional pilot app.

RESULTS

Over the course of the design process, WellNote's features were refined, with the final version being a digital notebook designed for patients with rheumatoid arthritis to manage their health by helping them track medications and labs and plan for appointments. It features several pages, like a dashboard, patient profile, appointment notes, preplanning, medication management, lab tracking, appointment archives, reminders, and a pillbox for medication visualization.

CONCLUSIONS

WellNote's active and structured note-taking features allow patients to clearly document the information from their physician without detracting from the conversation, helping the patient to become more empowered and engaged in their health management. The co-design process empowered these stakeholders to share their needs and participate in the development of a solution that truly solves pain points for these groups. This viewpoint highlights the role of digital health tools and the co-design of new health care innovations to empower patients and support clinicians.

Improving the Quality of General Surgical Operation Notes According to the Royal College of Surgeons (RCS) Guidelines: A Closed-Loop Audit

Background Thorough and precise operative notes play a vital role in patient care, facilitating communication among healthcare teams and serving as essential documents for legal purposes. Poor documentation can jeopardize patient safety and the quality of care provided. The use of standardized guidelines, such as those endorsed by recognized surgical organizations, is crucial to ensure consistent and detailed record-keeping. This study aims to assess the alignment of postoperative notes with established guidelines, with the goal of enhancing documentation practices in the healthcare setting. Objectives This study aimed to evaluate the quality and comprehensiveness of postoperative surgical notes and assess their alignment with established guidelines for surgical documentation, specifically focusing on adherence to recognized standards in surgical practice. Methods This cross-sectional audit assessed 150 operative notes (79 pre-implementation and 71 post-implementation of the Royal College of Surgeons (RCS) guidelines) in the General Surgery Unit at Khyber Teaching Hospital Peshawar, Pakistan. Data included peri-operative findings, operative diagnosis, team information, operational details, complications, procedures, prosthesis, closure, DVT prophylaxis, time out, postoperative orders, and signatures. Results Post-implementation, peri-operative findings were noted in 68 (95.7%) notes, compared to 56 (70.8%) pre-implementation. Operative diagnosis consistently increased from 65 (82.3%) to 69 (97.2%). Post-implementation, operation type, date, and time were consistently included in 67 (94.4%) notes. Complications, additional procedures, and tissue alterations surged to 66 (92.9%), 64 (90.1%), and 60 (84.5%), respectively. Prosthesis and closure techniques were recorded in 65 (91.5%) and 66 (92.9%). Deep vein thrombosis (DVT) prophylaxis and "time out" were documented in 68 (95.8%) notes. Postoperative orders and signatures improved to 70 (98.6%) and 69 (97.2%), respectively. Conclusion Our study revealed the significant positive impact of RCS guideline implementation on operative note documentation. Improvements were noted in essential components such as peri-operative findings, diagnosis, team details, complications, procedures, and more. These enhancements have far-reaching implications, bolstering patient care and ensuring clear communication among healthcare providers, all while serving a vital role in medico-legal matters. By adopting the RCS guidelines, healthcare institutions commit to a higher documentation standard, ultimately supporting good clinical governance.

Unraveling the Predictive Potential of Rapid Scoring in Pleural Infection: A Critical Review

Pleural infection, or pleural empyema, is a severe medical condition associated with high morbidity and mortality rates. Timely and accurate prognostication is crucial for optimizing patient outcomes and resource allocation. Rapid scoring systems have emerged as promising tools in pleural infection prognostication, integrating various clinical and laboratory parameters to assess disease severity and quantitatively predict short-term and long-term outcomes. This review article critically evaluates existing rapid scoring systems, including CURB-65 (confusion, uremia, respiratory rate, blood pressure, age ≥ 65 years), A-DROP (age (male >70 years, female >75 years), dehydration, respiratory failure, orientation disturbance, and low blood pressure), and APACHE II (acute physiology and chronic health evaluation II), assessing their predictive accuracy and limitations. Our analysis highlights the potential clinical implications of rapid scoring, including risk stratification, treatment tailoring, and follow-up planning. We discuss practical considerations and challenges in implementing rapid scoring such as data accessibility and potential sources of bias. Furthermore, we emphasize the importance of validation, transparency, and multidisciplinary collaboration to refine and enhance the clinical applicability of these scoring systems. The prospects for rapid scoring in pleural infection management are promising, with ongoing research and data science advances offering improvement opportunities. Ultimately, the successful integration of rapid scoring into clinical practice can potentially improve patient care and outcomes in pleural infection management.

The Use of Templates for Documenting Advance Care Planning Conversations: A Descriptive Analysis

CONTEXT

While professional societies and expert panels have recommended quality indicators related to advance care planning (ACP) documentation, including using structured documentation templates, it is unclear how clinicians document these conversations.

OBJECTIVE

To explore how clinicians document ACP, specifically, which components of these conversations are documented.

METHODS

A codebook was developed based on existing frameworks for ACP conversations and documentation. ACP documentation from a hospital medicine quality improvement project conducted from November 2019 to April 2021 were included and assessed. Documentation was examined for the presence or absence of each component within the coding schema. Clinician documented ACP using three different note types: template (only template prompts were used), template plus (authors added additional text to the template), and free text only. ACP note components were analyzed by note type and author department.

RESULTS

A total of 182 ACP notes were identified and reviewed. The most common note type was template plus (58%), followed by free text (28%) and template (14%). The most frequent components across all note types were: important relationships to patient (92%), and discussion of life-sustaining treatment preferences (87%). There was considerable heterogeneity in the components across note types. The presence of components focused on treatment decisions and legal paperwork differed significantly between note types (P < 0.05). Components on preference for medical information, emotional state, or spiritual support were rarely included across all note types.

CONCLUSION

This study provides a preliminary exploration of ACP documentation and found that templates may influence what information is documented after an ACP conversation.

Using Existing Clinical Information Models for Dutch Quality Registries to Reuse Data and Follow COUMT Paradigm

BACKGROUND

 Reuse of health care data for various purposes, such as the care process, for quality measurement, research, and finance, will become increasingly important in the future; therefore, "Collect Once Use Many Times" (COUMT). Clinical information models (CIMs) can be used for content standardization. Data collection for national quality registries (NQRs) often requires manual data entry or batch processing. Preferably, NQRs collect required data by extracting data recorded during the health care process and stored in the electronic health record.

OBJECTIVES

 The first objective of this study was to analyze the level of coverage of data elements in NQRs with developed Dutch CIMs (DCIMs). The second objective was to analyze the most predominant DCIMs, both in terms of the coverage of data elements as well as in their prevalence across existing NQRs.

METHODS

 For the first objective, a mapping method was used which consisted of six steps, ranging from a description of the clinical pathway to a detailed mapping of data elements. For the second objective, the total number of data elements that matched with a specific DCIM was counted and divided by the total number of evaluated data elements.

RESULTS

 An average of 83.0% (standard deviation: 11.8%) of data elements in studied NQRs could be mapped to existing DCIMs . In total, 5 out of 100 DCIMs were needed to map 48.6% of the data elements.

CONCLUSION

 This study substantiates the potential of using existing DCIMs for data collection in Dutch NQRs and gives direction to further implementation of DCIMs. The developed method is applicable to other domains. For NQRs, implementation should start with the five DCIMs that are most prevalently used in the NQRs. Furthermore, a national agreement on the leading principle of COUMT for the use and implementation for DCIMs and (inter)national code lists is needed.