Lifecycle evaluation of medical devices: supporting or jeopardizing patient outcomes? A comparative analysis of evaluation models

OBJECTIVES

Lack of evidence regarding safety and effectiveness at market entry is driving the need to consider adopting a lifecycle approach to evaluating medical devices, but it is unclear what lifecycle evaluation means. This research sought to explore the tacit meanings of "lifecycle" and "lifecycle evaluation" as embodied within evaluation models/frameworks used for medical devices.

METHODS

Drawing on qualitative evidence synthesis methods and using an inductive approach, novel methods were developed to identify, appraise, analyze, and synthesize lifecycle evaluation models used for medical devices. Data was extracted (including purpose; audience; characterization; outputs; timing; and type of model) from key texts for coding, categorization, and comparison, exploring embodied meaning across four broad perspectives.

RESULTS

Fifty-two models were included in the synthesis. They demonstrated significant heterogeneity of meaning, form, scope, timing, and purpose. The "lifecycle" may represent a single stage, a series of stages, a cycle of innovation, or a system. "Lifecycle evaluation" focuses on the overarching goal of the stakeholder group, and may use a single or repeated evaluation to inform decision-making regarding the adoption of health technologies (Healthcare), resource allocation (Policymaking), investment in new product development or marketing (Trade and Industry), or market regulation (Regulation). The adoption of a lifecycle approach by regulators has resulted in the deferral of evidence generation to the post-market phase.

CONCLUSIONS

Using a "lifecycle evaluation" approach to inform reimbursement decision-making must not be allowed to further jeopardize evidence generation and patient safety by accepting inadequate evidence of safety and effectiveness for reimbursement decisions.

Improving Bridging from Informatics Theory to Practice

BACKGROUND

In 1962, Methods of Information in Medicine (MIM) began to publish papers on the methodology and scientific fundamentals of managing data, information, and knowledge in biomedicine and health care. Meeting an increasing demand for research about practical implementation of health information systems, the journal Applied Clinical Informatics (ACI) was launched in 2009. Both journals are official journals of the International Medical Informatics Association (IMIA).

OBJECTIVES

Based on prior analyses, we aimed to describe major topics published in MIM during 2014 and to explore whether theory of MIM influenced practice of ACI. Our objectives were further to describe lessons learned and to discuss possible editorial policies to improve bridging from theory to practice.

METHODS

We conducted a retrospective, observational study reviewing MIM articles published during 2014 (N=61) and analyzing reference lists of ACI articles from 2014 (N=70). Lessons learned and opinions about MIM editorial policies were developed in consensus by the two authors. These have been influenced by discussions with the journal's associate editors and editorial board members.

RESULTS

The publication topics of MIM in 2014 were broad, covering biomedical and health informatics, medical biometry and epidemiology. Important topics discussed were biosignal interpretation, boosting methodologies, citation analysis, health-enabling and ambient assistive technologies, health record banking, safety, and standards. Nine ACI practice articles from 2014 cited eighteen MIM theory papers from any year. These nine ACI articles covered mainly the areas of clinical documentation and medication-related decision support. The methodological basis they cited from was almost exclusively related to evaluation. We could show some direct links where theory impacted practice. These links are however few in relation to the total amount of papers published.

CONCLUSIONS

Editorial policies such as publishing systematic methodological reviews and clarification of possible practical impact of theory-focused articles may improve bridging.