1
|
Clutton J, Montgomery RN, Mudaranthakam DP, Blocker EM, Shaw AR, Szabo Reed AN, Vidoni ED. An open-source system for efficient clinical trial support: The COMET study experience. PLoS One 2023; 18:e0293874. [PMID: 38011138 PMCID: PMC10681164 DOI: 10.1371/journal.pone.0293874] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2023] [Accepted: 10/05/2023] [Indexed: 11/29/2023] Open
Abstract
Exercise clinical trials are complex, logistically burdensome, and require a well-coordinated multi-disciplinary approach. Challenges include managing, curating, and reporting on many disparate information sources, while remaining responsive to a variety of stakeholders. The Combined Exercise Trial (COMET, NCT04848038) is a one-year comparison of three exercise modalities delivered in the community. Target enrollment is 280 individuals over 4 years. To support rigorous execution of COMET, the study team has developed a suite of scripts and dashboards to assist study stakeholders in each of their various functions. The result is a highly automated study system that preserves rigor, increases communication, and reduces staff burden. This manuscript describes system considerations and the COMET approach to data management and use, with a goal of encouraging further development and adaptation by other study teams in various fields.
Collapse
Affiliation(s)
- Jonathan Clutton
- University of Kansas Medical Center, Kansas City, Kansas, United States of America
| | | | | | - Erin M. Blocker
- Emporia State University, Emporia, Kansas, United States of America
| | - Ashley R. Shaw
- University of Kansas Medical Center, Kansas City, Kansas, United States of America
| | - Amanda N. Szabo Reed
- University of Kansas Medical Center, Kansas City, Kansas, United States of America
| | - Eric D. Vidoni
- University of Kansas Medical Center, Kansas City, Kansas, United States of America
| |
Collapse
|
2
|
Shen L, Zhai Y, Pan AX, Zhao Q, Zhou M, Liu J. Development of an integrated and comprehensive clinical trial process management system. BMC Med Inform Decis Mak 2023; 23:61. [PMID: 37024877 PMCID: PMC10078087 DOI: 10.1186/s12911-023-02158-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2021] [Accepted: 03/17/2023] [Indexed: 04/08/2023] Open
Abstract
BACKGROUND The process of initiating and completing clinical drug trials in hospital settings is highly complex, with numerous institutional, technical, and record-keeping barriers. In this study, we independently developed an integrated clinical trial management system (CTMS) designed to comprehensively optimize the process management of clinical trials. The CTMS includes system development methods, efficient integration with external business systems, terminology, and standardization protocols, as well as data security and privacy protection. METHODS The development process proceeded through four stages, including demand analysis and problem collection, system design, system development and testing, system trial operation, and training the whole hospital to operate the system. The integrated CTMS comprises three modules: project approval and review management, clinical trial operations management, and background management modules. These are divided into seven subsystems and 59 internal processes, realizing all the functions necessary to comprehensively perform the process management of clinical trials. Efficient data integration is realized through extract-transform-load, message queue, and remote procedure call services with external systems such as the hospital information system (HIS), laboratory information system (LIS), electronic medical record (EMR), and clinical data repository (CDR). Data security is ensured by adopting corresponding policies for data storage and data access. Privacy protection complies with laws and regulations and de-identifies sensitive patient information. RESULTS The integrated CTMS was successfully developed in September 2015 and updated to version 4.2.5 in March 2021. During this period, 1388 study projects were accepted, 43,051 electronic data stored, and 12,144 subjects recruited in the First Affiliated Hospital, Zhejiang University School of Medicine. CONCLUSION The developed integrated CTMS realizes the data management of the entire clinical trials process, providing basic conditions for the efficient, high-quality, and standardized operation of clinical trials.
Collapse
Affiliation(s)
- Liang Shen
- Department of Information Technology, The First Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, 310003, China
| | - You Zhai
- Research Center for Clinical Pharmacy, Department of Clinical Pharmacy, The First Affiliated Hospital, Zhejiang University School of Medicine, Zhejiang Provincial Key Laboratory for Drug Evaluation and Clinical Research, Hangzhou, 310003, China
| | - AXiang Pan
- Department of Information Technology, The First Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, 310003, China
| | - Qingwei Zhao
- Research Center for Clinical Pharmacy, Department of Clinical Pharmacy, The First Affiliated Hospital, Zhejiang University School of Medicine, Zhejiang Provincial Key Laboratory for Drug Evaluation and Clinical Research, Hangzhou, 310003, China
| | - Min Zhou
- Department of Information Technology, The First Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, 310003, China.
| | - Jian Liu
- Research Center for Clinical Pharmacy, Department of Clinical Pharmacy, The First Affiliated Hospital, Zhejiang University School of Medicine, Zhejiang Provincial Key Laboratory for Drug Evaluation and Clinical Research, Hangzhou, 310003, China.
| |
Collapse
|
3
|
Greer M, Garza MY, Lee J, Prior F, Tarbox L, Tobler J, Walden A, Zozus MN, Snowden J. Informatics infrastructure in a rural pediatric clinical trials network: Matching specific clinical research needs with best practices and industry guidelines. Contemp Clin Trials 2023; 126:107110. [PMID: 36738915 PMCID: PMC10512201 DOI: 10.1016/j.cct.2023.107110] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/10/2022] [Revised: 01/28/2023] [Accepted: 01/30/2023] [Indexed: 02/05/2023]
Abstract
Children have historically been underrepresented in randomized controlled trials and multi-center studies. This is particularly true for children who reside in rural and underserved areas. Conducting multi-center trials in rural areas presents unique informatics challenges. These challenges call for increased attention towards informatics infrastructure and the need for development and application of sound informatics approaches to the collection, processing, and management of data for clinical studies. By modifying existing local infrastructure and utilizing open source tools, we have been able to successfully deploy a multi-site data coordinating and operations center. We report our implementation decisions for data collection and management for the IDeA States Pediatric Clinical Trial Network (ISPCTN) based on the functionality needed for the ISPCTN, our synthesis of the extant literature in data collection and management methodology, and Good Clinical Data Management Practices.
Collapse
Affiliation(s)
- Melody Greer
- Department of Biomedical Informatics, University of Arkansas for Medical Sciences, Little Rock, AR, USA
| | - Maryam Y Garza
- Department of Biomedical Informatics, University of Arkansas for Medical Sciences, Little Rock, AR, USA
| | - Jeannette Lee
- Department of Biostatistics, University of Arkansas for Medical Sciences, Little Rock, AR, USA
| | - Fred Prior
- Department of Biomedical Informatics, University of Arkansas for Medical Sciences, Little Rock, AR, USA
| | - Lawrence Tarbox
- Department of Biomedical Informatics, University of Arkansas for Medical Sciences, Little Rock, AR, USA
| | - Jeff Tobler
- Department of Biomedical Informatics, University of Arkansas for Medical Sciences, Little Rock, AR, USA
| | - Anita Walden
- Oregon Clinical and Translational Research Institute, Oregon Health & Science University, Portland, OR, USA
| | - Meredith Nahm Zozus
- Department of Population Health Sciences, University of Texas Health, San Antonio, TX, USA
| | - Jessica Snowden
- Department of Biostatistics, University of Arkansas for Medical Sciences, Little Rock, AR, USA; Department of Pediatrics, University of Arkansas for Medical Sciences, Little Rock, AR, USA.
| |
Collapse
|
4
|
Nourani A, Ayatollahi H, Solaymani-Dodaran M. Data management system for diabetes clinical trials: a pre-post evaluation study. BMC Med Inform Decis Mak 2023; 23:14. [PMID: 36670481 PMCID: PMC9854045 DOI: 10.1186/s12911-023-02110-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2022] [Accepted: 01/13/2023] [Indexed: 01/22/2023] Open
Abstract
BACKGROUND Data management system for diabetes clinical trials is used to support clinical data management processes. The purpose of this study was to evaluate the quality and usability of this system from the users' perspectives. METHODS This study was conducted in 2020, and the pre-post evaluation method was used to examine the quality and usability of the designed system. Initially, a questionnaire was designed and distributed among the researchers who were involved in the diabetes clinical trials (n = 30) to investigate their expectations. Then, the researchers were asked to use the system and explain their perspectives about it by completing two questionnaires. RESULTS There was no statistically significant differences between the users' perspectives about the information quality, service quality, achievements, and communication before and after using the system. However, in terms of the system quality (P = 0.042) and users' autonomy (P = 0.026), the users' expectations were greater than the system performance. The system usability was at a good level based on the users' opinions. CONCLUSION It seems that the designed system largely met the users' expectations in most areas. However, the system quality and users' autonomy need further attentions. In addition, the system should be used in multicenter trials and re-evaluated by a larger group of users.
Collapse
Affiliation(s)
- Aynaz Nourani
- Department of Health Information Technology, Urmia University of Medical Sciences, Urmia, Iran
| | - Haleh Ayatollahi
- Health Management and Economics Research Center, Health Management Research Institute, Iran University of Medical Sciences, Tehran, Iran.
- Department of Health Information Management, School of Health Management and Information Sciences, Iran University of Medical Sciences, Tehran, Iran.
| | | |
Collapse
|
5
|
Nourani A, Ayatollahi H, Solaymani Dodaran M. Data management in diabetes clinical trials: a qualitative study. Trials 2022; 23:187. [PMID: 35241149 PMCID: PMC8895796 DOI: 10.1186/s13063-022-06110-5] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2021] [Accepted: 02/15/2022] [Indexed: 11/16/2022] Open
Abstract
Background Clinical trials play an important role in expanding the knowledge of diabetes prevention, diagnosis, and treatment, and data management is one of the main issues in clinical trials. Lack of appropriate planning for data management in clinical trials may negatively influence achieving the desired results. The aim of this study was to explore data management processes in diabetes clinical trials in three research institutes in Iran. Method This was a qualitative study conducted in 2019. In this study, data were collected through in-depth semi-structured interviews with 16 researchers in three endocrinology and metabolism research institutes. To analyze data, the method of thematic analysis was used. Results The five themes that emerged from data analysis included (1) clinical trial data collection, (2) technologies used in data management, (3) data security and confidentiality management, (4) data quality management, and (5) data management standards. In general, the findings indicated that no clear and standard process was used for data management in diabetes clinical trials, and each research center executed its own methods and processes. Conclusion According to the results, the common methods of data management in diabetes clinical trials included a set of paper-based processes. It seems that using information technology can help facilitate data management processes in a variety of clinical trials, including diabetes clinical trials.
Collapse
Affiliation(s)
- Aynaz Nourani
- Department of Health Information Technology, Urmia University of Medical Sciences, Urmia, Iran
| | - Haleh Ayatollahi
- Health Management and Economics Research Center, Health Management Research Institute, Iran University of Medical Sciences, Tehran, Iran. .,Department of Health Information Management, School of Health Management and Information Sciences, Iran University of Medical Sciences, Tehran, Iran.
| | | |
Collapse
|
6
|
Gurugubelli VS, Fang H, Shikany JM, Balkus SV, Rumbut J, Ngo H, Wang H, Allison JJ, Steffen LM. A review of harmonization methods for studying dietary patterns. SMART HEALTH (AMSTERDAM, NETHERLANDS) 2022; 23:100263. [PMID: 35252528 PMCID: PMC8896407 DOI: 10.1016/j.smhl.2021.100263] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/11/2023]
Abstract
Data harmonization is the process by which each of the variables from different research studies are standardized to similar units resulting in comparable datasets. These data may be integrated for more powerful and accurate examination and prediction of outcomes for use in the intelligent and smart electronic health software programs and systems. Prospective harmonization is performed when researchers create guidelines for gathering and managing the data before data collection begins. In contrast, retrospective harmonization is performed by pooling previously collected data from various studies using expert domain knowledge to identify and translate variables. In nutritional epidemiology, dietary data harmonization is often necessary to construct the nutrient and food databases necessary to answer complex research questions and develop effective public health policy. In this paper, we review methods for effective data harmonization, including developing a harmonization plan, which common standards already exist for harmonization, and defining variables needed to harmonize datasets. Currently, several large-scale studies maintain harmonized nutrient databases, especially in Europe, and steps have been proposed to inform the retrospective harmonization process. As an example, data harmonization methods are applied to several U.S longitudinal diet datasets. Based on our review, considerations for future dietary data harmonization include user agreements for sharing private data among participating studies, defining variables and data dictionaries that accurately map variables among studies, and the use of secure data storage servers to maintain privacy. These considerations establish necessary components of harmonized data for smart health applications which can promote healthier eating and provide greater insights into the effect of dietary patterns on health.
Collapse
Affiliation(s)
| | - Hua Fang
- University of Massachusetts Dartmouth, 285 Old Westport Rd, North Dartmouth, 02747, Massachusetts, USA
- Department of Quantitative Health Sciences, University of Massachusetts Medical School, 55 N Lake Ave, Worcester, 01655, Massachusetts, USA
- Corresponding author. Tel.: +0-508-910-6411;
| | - James M Shikany
- Division of Preventive Medicine, University of Alabama at Birmingham, 1720 University Blvd, Birmingham, 35294, Alabama, USA
| | - Salvador V Balkus
- University of Massachusetts Dartmouth, 285 Old Westport Rd, North Dartmouth, 02747, Massachusetts, USA
| | - Joshua Rumbut
- University of Massachusetts Dartmouth, 285 Old Westport Rd, North Dartmouth, 02747, Massachusetts, USA
- Department of Quantitative Health Sciences, University of Massachusetts Medical School, 55 N Lake Ave, Worcester, 01655, Massachusetts, USA
| | - Hieu Ngo
- University of Massachusetts Dartmouth, 285 Old Westport Rd, North Dartmouth, 02747, Massachusetts, USA
| | - Honggang Wang
- University of Massachusetts Dartmouth, 285 Old Westport Rd, North Dartmouth, 02747, Massachusetts, USA
| | - Jeroan J Allison
- Department of Quantitative Health Sciences, University of Massachusetts Medical School, 55 N Lake Ave, Worcester, 01655, Massachusetts, USA
| | - Lyn M. Steffen
- Division of Epidemiology and Community Health, School of Public Health, University of Minnesota, Minneapolis, 55455, Minnesota, USA
| |
Collapse
|
7
|
Nourani A, Ayatollahi H, Solaymani-Dodaran M. A Clinical Data Management System for Diabetes Clinical Trials. JOURNAL OF HEALTHCARE ENGINEERING 2022; 2022:8421529. [PMID: 35251579 PMCID: PMC8894039 DOI: 10.1155/2022/8421529] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/24/2021] [Revised: 12/27/2021] [Accepted: 02/02/2022] [Indexed: 01/23/2023]
Abstract
BACKGROUND The use of novel medications and methods to prevent, diagnose, treat, and manage diabetes requires confirmation of safety and efficacy in a well-designed study prior to widespread adoption. Diabetes clinical trials are the studies that examine these issues. The aim of the present study was to develop a web-based system for data management in diabetes clinical trials. METHODS The present research was a mixed-methods study conducted in 2019. To identify the required data elements and functions to develop the system, 60 researchers completed a questionnaire. The designed system was evaluated using two methods. The usability of the system was initially evaluated by a group of researchers (n = 6) using the think-aloud method, and after system improvement, the system functions were evaluated by other researchers (n = 30) using a questionnaire. RESULTS The main data elements which were required to develop a case report form included "study data," "participant's personal data," and "clinical data." The functional requirements of the system were "managing the study," "creating case report forms," "data management," "data quality control," and "data security and confidentiality." After using the system, researchers rated the system functions at a "good" level (6.3 ± 0.73) on a seven-point Likert scale. CONCLUSION Given the complexity of the data management processes in diabetes clinical trials and the widespread use of information technologies in research, the use of clinical data management systems in diabetes clinical trials seems inevitable. The system developed in the current study can facilitate and improve the process of creating and managing case report forms as well as collecting data in diabetes clinical trials.
Collapse
Affiliation(s)
- Aynaz Nourani
- Department of Health Information Technology, Urmia University of Medical Sciences, Urmia, Iran
| | - Haleh Ayatollahi
- Health Management and Economics Research Center, Health Management Research Institute, Iran University of Medical Sciences, Tehran, Iran
- Department of Health Information Management, School of Health Management and Information Sciences, Iran University of Medical Sciences, Tehran, Iran
| | | |
Collapse
|
8
|
Lockery JE, Collyer TA, Reid CM, Ernst ME, Gilbertson D, Hay N, Kirpach B, McNeil JJ, Nelson MR, Orchard SG, Pruksawongsin K, Shah RC, Wolfe R, Woods RL. Overcoming challenges to data quality in the ASPREE clinical trial. Trials 2019; 20:686. [PMID: 31815652 PMCID: PMC6902598 DOI: 10.1186/s13063-019-3789-2] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2019] [Accepted: 10/05/2019] [Indexed: 11/28/2022] Open
Abstract
BACKGROUND Large-scale studies risk generating inaccurate and missing data due to the complexity of data collection. Technology has the potential to improve data quality by providing operational support to data collectors. However, this potential is under-explored in community-based trials. The Aspirin in reducing events in the elderly (ASPREE) trial developed a data suite that was specifically designed to support data collectors: the ASPREE Web Accessible Relational Database (AWARD). This paper describes AWARD and the impact of system design on data quality. METHODS AWARD's operational requirements, conceptual design, key challenges and design solutions for data quality are presented. Impact of design features is assessed through comparison of baseline data collected prior to implementation of key functionality (n = 1000) with data collected post implementation (n = 18,114). Overall data quality is assessed according to data category. RESULTS At baseline, implementation of user-driven functionality reduced staff error (from 0.3% to 0.01%), out-of-range data entry (from 0.14% to 0.04%) and protocol deviations (from 0.4% to 0.08%). In the longitudinal data set, which contained more than 39 million data values collected within AWARD, 96.6% of data values were entered within specified query range or found to be accurate upon querying. The remaining data were missing (3.4%). Participant non-attendance at scheduled study activity was the most common cause of missing data. Costs associated with cleaning data in ASPREE were lower than expected compared with reports from other trials. CONCLUSIONS Clinical trials undertake complex operational activity in order to collect data, but technology rarely provides sufficient support. We find the AWARD suite provides proof of principle that designing technology to support data collectors can mitigate known causes of poor data quality and produce higher-quality data. Health information technology (IT) products that support the conduct of scheduled activity in addition to traditional data entry will enhance community-based clinical trials. A standardised framework for reporting data quality would aid comparisons across clinical trials. TRIAL REGISTRATION International Standard Randomized Controlled Trial Number Register, ISRCTN83772183. Registered on 3 March 2005.
Collapse
Affiliation(s)
- Jessica E. Lockery
- Department of Epidemiology & Preventive Medicine, Monash University, ASPREE Co-ordinating Centre, 99 Commercial Road, Melbourne, VIC 3004 Australia
| | - Taya A. Collyer
- Department of Epidemiology & Preventive Medicine, Monash University, ASPREE Co-ordinating Centre, 99 Commercial Road, Melbourne, VIC 3004 Australia
| | - Christopher M. Reid
- Department of Epidemiology & Preventive Medicine, Monash University, ASPREE Co-ordinating Centre, 99 Commercial Road, Melbourne, VIC 3004 Australia
- School of Public Health, Curtin University, Perth, WA Australia
| | - Michael E. Ernst
- Department of Pharmacy Practice and Science, College of Pharmacy and Department of Family Medicine, Carver College of Medicine, The University of Iowa, Iowa City, USA
| | - David Gilbertson
- Chronic Disease Research Group, Minneapolis Medical Research Foundation, Minneapolis, Minnesota USA
| | - Nino Hay
- Department of Epidemiology & Preventive Medicine, Monash University, ASPREE Co-ordinating Centre, 99 Commercial Road, Melbourne, VIC 3004 Australia
| | - Brenda Kirpach
- Berman Center for Outcomes and Clinical Research, Hennepin Healthcare Research Institute (HHRI), Hennepin Healthcare, Minneapolis, MN USA
| | - John J. McNeil
- Department of Epidemiology & Preventive Medicine, Monash University, ASPREE Co-ordinating Centre, 99 Commercial Road, Melbourne, VIC 3004 Australia
| | - Mark R. Nelson
- Department of Epidemiology & Preventive Medicine, Monash University, ASPREE Co-ordinating Centre, 99 Commercial Road, Melbourne, VIC 3004 Australia
- Menzies Institute for Medical Research, University of Tasmania, Hobart, TAS Australia
| | - Suzanne G. Orchard
- Department of Epidemiology & Preventive Medicine, Monash University, ASPREE Co-ordinating Centre, 99 Commercial Road, Melbourne, VIC 3004 Australia
| | - Kunnapoj Pruksawongsin
- Department of Epidemiology & Preventive Medicine, Monash University, ASPREE Co-ordinating Centre, 99 Commercial Road, Melbourne, VIC 3004 Australia
| | - Raj C. Shah
- Department of Family Medicine and Rush Alzheimer’s Disease Center, Rush University Medical Center, Chicago, IL USA
| | - Rory Wolfe
- Department of Epidemiology & Preventive Medicine, Monash University, ASPREE Co-ordinating Centre, 99 Commercial Road, Melbourne, VIC 3004 Australia
| | - Robyn L. Woods
- Department of Epidemiology & Preventive Medicine, Monash University, ASPREE Co-ordinating Centre, 99 Commercial Road, Melbourne, VIC 3004 Australia
| | - on behalf of the ASPREE Investigator Group
- Department of Epidemiology & Preventive Medicine, Monash University, ASPREE Co-ordinating Centre, 99 Commercial Road, Melbourne, VIC 3004 Australia
- School of Public Health, Curtin University, Perth, WA Australia
- Department of Pharmacy Practice and Science, College of Pharmacy and Department of Family Medicine, Carver College of Medicine, The University of Iowa, Iowa City, USA
- Chronic Disease Research Group, Minneapolis Medical Research Foundation, Minneapolis, Minnesota USA
- Berman Center for Outcomes and Clinical Research, Hennepin Healthcare Research Institute (HHRI), Hennepin Healthcare, Minneapolis, MN USA
- Menzies Institute for Medical Research, University of Tasmania, Hobart, TAS Australia
- Department of Family Medicine and Rush Alzheimer’s Disease Center, Rush University Medical Center, Chicago, IL USA
| |
Collapse
|