Health technology assessment of diagnostic tests: a state of the art review of methods guidance from international organizations

HTA model for laboratory medicine technologies: overview of approaches adopted in some international agencies

The Health Technology Assessment (HTA) Working Group of the Emerging Technology Division of International Federation of Clinical Chemistry and Laboratory Medicine (IFCC) aims to develop a methodological approach for producing structured HTA information for laboratory medicine technologies. This approach seeks to support decision-making processes at the country, regional, and/or hospital levels regarding the introduction of specific technologies. The focus of this model will primarily be on defining assessment elements within the domains of 'organizational aspects' and 'costs and economic evaluations', potentially differentiated by the type of diagnostic technology (e.g., genetic tests, molecular tests). To achieve this project's goal, a literature review and examination of websites of international HTA agencies have been conducted. The research aims to identify multidisciplinary methodological approaches used to assess laboratory diagnostic technologies and to pinpoint the domains and assessment elements utilized. We found 7 methodological articles describing methodological approaches adopted to assess laboratory diagnostic technologies. Among the HTA organizations considered, 23 reports were found, of which 7 were produced by the European Network of HTA (EUnetHTA), 4 by the National Institute for Health and Care Excellence Diagnostic Assessment Program (NICE DAP), and 12 by other HTA agencies. The EUnetHTA reports were rapid collaborative assessments covering various domains, while the NICE DAP reports focused on diagnostic guidances, including descriptions of technologies, clinical need and practice, diagnostic tests, accuracy, effectiveness, and cost-effectiveness. Finally, a survey targeting laboratory professionals will be conducted to introduce assessment elements, differentiated by the type of diagnostic technology, primarily for organizational and economic domains.

Health technology assessment in musculoskeletal radiology: the case study of EOSedge™

OBJECTIVES

Health technology assessment (HTA) is a systematic process used to evaluate the properties and effects of healthcare technologies within their intended use context. This paper describes the adoption of HTA process to assess the adoption of the EOSedge™ system in clinical practice.

METHODS

The EOSedge™ system is a digital radiography system that delivers whole-body, high-quality 2D/3D biplanar images covering the complete set of musculoskeletal and orthopedic exams. Full HTA model was chosen using the EUnetHTA Core Model® version 3.0. The HTA Core Model organizes the information into nine domains. Information was researched and obtained by consulting the manufacturers' user manuals, scientific literature, and institutional sites for regulatory aspects.

RESULTS

All nine domains of the EUnetHTA Core Model® helped conduct the HTA of the EOSedge, including (1) description and technical characteristics of the technology; (2) health problem and current clinical practice; (3) safety; (4) clinical effectiveness; (5) organizational aspects; (6) economic evaluation; (7) impact on the patient; (8) ethical aspects; and (9) legal aspects.

CONCLUSIONS

EOS technologies may be a viable alternative to conventional radiographs. EOSedge has the same intended use and similar indications for use, technological characteristics, and operation principles as the EOS System and provides significant dose reduction factors for whole spine imaging compared to the EOS System without compromising image quality. Regarding the impact of EOS imaging on patient outcomes, most studies aim to establish technical ability without evaluating their ability to improve patient outcomes; thus, more studies on this aspect are warranted.

A pilot study investigating severe community-acquired febrile illness through implementation of an innovative microbiological and nucleic acid amplification testing strategy in Timor-Leste (ISIN-MANAS-TL)

Objectives

Acute febrile illness (AFI) causes significant health-seeking, morbidity, and mortality in Southeast Asia. This pilot study aimed to describe presentation, etiology, treatment, and outcomes of patients with AFI at one hospital in Timor-Leste and assessing the feasibility of conducting larger studies in this setting.

Methods

Patients attending Hospital Nacional Guido Valadares with tympanic or axillary temperature ≥37.5°C in whom a blood culture was taken as part of routine clinical care were eligible. Participants were followed up daily for 10 days and again after 30 days. Whole blood was analyzed using a real-time quantitative polymerase chain reaction assay detecting dengue virus serotypes 1-4 and other arthropod-borne infections.

Results

A total of 82 participants were recruited. Polymerase chain reaction testing was positive for dengue in 14 of 82 (17.1%) participants and blood culture identified a bacterial pathogen in three of 82 (3.7%) participants. Follow-up was completed by 75 of 82 (91.5%) participants. High rates of hospital admission (58 of 82, 70.7%), broad-spectrum antimicrobial treatment (34 of 82, 41.5%), and mortality (9 of 82, 11.0%) were observed.

Conclusions

Patients with AFI experience poor clinical outcomes. Prospective observational and interventional studies assessing interventions, such as enhanced diagnostic testing, clinical decision support tools, or antimicrobial stewardship interventions, are required and would be feasible to conduct in this setting.

Is the Comparator in Your Diagnostic Cost-Effectiveness Model "Standard of Care"? Recommendations from Literature Reviews and Expert Interviews on How to Identify and Operationalize It

OBJECTIVES

This research aimed to develop best-practice recommendations for identifying the "standard of care" (SoC) and integrate it when it is the comparator in diagnostic economic models (SoC comparator).

METHODS

A multi-methods approach comprising 2 pragmatic literature reviews and 9 expert interviews was used. Experts rated their agreement with draft recommendations based on the authors' analysis of the reviews. These were refined iteratively to produce final recommendations.

RESULTS

Fourteen best-practice recommendations are provided. Care pathway mapping (using quantitative, qualitative, or mixed-methods approaches) should be used for identifying the SoC comparator. Guidelines analysis can be integrated with expert opinion to identify pathway variability and discrepancies from clinical practice. For integrating the SoC comparator into the model, recommendations around structure, input sourcing, data aggregation and reporting, input uncertainty, and model variability are presented. For example, modelers should consider that the reference standard is not synonymous with the SoC, and the SoC may not be the only comparator. The comparator limitations should be discussed with clinical experts, but elicitation of its diagnostic accuracy is not recommended. Probabilistic sensitivity analysis is recommended when evaluating the overall input uncertainty, and deterministic sensitivity analysis is useful when there is high model uncertainty or SoC variability. Consensus could not be reached for some topics (eg, the role of real-world data, model averaging, and alternative model structures), but the reported discussions provide points for consideration.

CONCLUSIONS

To our knowledge, this is the first guidance to support modelers when identifying and operationalizing the SoC comparator in diagnostic cost-effectiveness models.

Evidence Synthesis and Linkage for Modelling the Cost-Effectiveness of Diagnostic Tests: Preliminary Good Practice Recommendations

OBJECTIVES

To develop preliminary good practice recommendations for synthesising and linking evidence of treatment effectiveness when modelling the cost-effectiveness of diagnostic tests.

METHODS

We conducted a targeted review of guidance from key Health Technology Assessment (HTA) bodies to summarise current recommendations on synthesis and linkage of treatment effectiveness evidence within economic evaluations of diagnostic tests. We then focused on a specific case study, the cost-effectiveness of troponin for the diagnosis of myocardial infarction, and reviewed the approach taken to synthesise and link treatment effectiveness evidence in different modelling studies.

RESULTS

The Australian and UK HTA bodies provided advice for synthesising and linking treatment effectiveness in diagnostic models, acknowledging that linking test results to treatment options and their outcomes is common. Across all reviewed models for the case study, uniform test-directed treatment decision making was assumed, i.e., all those who tested positive were treated. Treatment outcome data from a variety of sources, including expert opinion, were utilised for linked clinical outcomes. Preliminary good practice recommendations for data identification, integration and description are proposed.

CONCLUSION

Modelling the cost-effectiveness of diagnostic tests poses unique challenges in linking evidence on test accuracy to treatment effectiveness data to understand how a test impacts patient outcomes and costs. Upfront consideration of how a test and its results will likely be incorporated into patient diagnostic pathways is key to exploring the optimal design of such models. We propose some preliminary good practice recommendations to improve the quality of cost-effectiveness evaluations of diagnostics tests going forward.

Toolkit for emerging technologies in laboratory medicine

An emerging technology (ET) for laboratory medicine can be defined as an analytical method (including biomarkers) or device (software, applications, and algorithms) that by its stage of development, translation into broad routine clinical practice, or geographical adoption and implementation has the potential to add value to clinical diagnostics. Considering the laboratory medicine-specific definition, this document examines eight key tools, encompassing clinical, analytical, operational, and financial aspects, used throughout the life cycle of ET implementation. The tools provide a systematic approach starting with identifying the unmet need or identifying opportunities for improvement (Tool 1), forecasting (Tool 2), technology readiness assessment (Tool 3), health technology assessment (Tool 4), organizational impact map (Tool 5), change management (Tool 6), total pathway to method evaluation checklist (Tool 7), and green procurement (Tool 8). Whilst there are differences in clinical priorities between different settings, the use of this set of tools will help support the overall quality and sustainability of the emerging technology implementation.

Future Role of Health Technology Assessment for Genomic Medicine in Oncology: A Canadian Laboratory Perspective

Genome-based testing in oncology is a rapidly expanding area of health care that is the basis of the emerging area of precision medicine. The efficient and considered adoption of novel genomic medicine testing is hampered in Canada by the fragmented nature of health care oversight as well as by lack of clear and transparent processes to support rapid evaluation, assessment, and implementation of genomic tests. This article provides an overview of some key barriers and proposes approaches to addressing these challenges as a potential pathway to developing a national approach to genomic medicine in oncology.