1
|
Li A, Dayomi M, Graili P, Balouchi A, Guergachi A, Keshavjee K. Validation of a Design Architecture to Deliver Health Management and Behavior Change Evidence at Scale. Stud Health Technol Inform 2024; 312:112-117. [PMID: 38372321 DOI: 10.3233/shti231323] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/20/2024]
Abstract
Forty-four percent of Canadians over the age of 20 have a non-communicable disease (NCD). Millions of Canadians are at risk of developing the complications of NCDs; millions have already experienced those complications. Fortunately, the evidence base for NCD prevention and behavior change is large and growing and digital technologies can deliver them at scale and with high fidelity. However, the current model of in-person primary care is not designed nor capable of operationalizing that evidence. New developments in artificial intelligence that can predict who will develop NCD or the complications of NCD are increasingly available, making the challenge of delivering disease prevention even more urgent. This paper presents findings from stakeholder engagement on a design architecture to address three initial barriers to large-scale deployment of health management and behavior change evidence: 1) the challenges of regulating mobile health apps, 2) the challenge of creating a value-based rationale for payers to invest in deploying mobile health apps at scale, and 3) the high cost of customer acquisition for delivering mobile health apps to those at risk.
Collapse
Affiliation(s)
| | - Mark Dayomi
- Institute for Health Policy, Management and Evaluation, Dalla Lana School of Public Health, University of Toronto, Toronto, ON, Canada
| | - Pooyeh Graili
- Institute for Health Policy, Management and Evaluation, Dalla Lana School of Public Health, University of Toronto, Toronto, ON, Canada
- Quality HTA, Oakville, ON, Canada
- Department of Information Technology Management, Ted Rogers School of Management, Toronto Metropolitan University, Toronto, ON, Canada
| | - Ali Balouchi
- Department of Information Technology Management, Ted Rogers School of Management, Toronto Metropolitan University, Toronto, ON, Canada
| | - Aziz Guergachi
- Institute for Health Policy, Management and Evaluation, Dalla Lana School of Public Health, University of Toronto, Toronto, ON, Canada
- Department of Information Technology Management, Ted Rogers School of Management, Toronto Metropolitan University, Toronto, ON, Canada
- Department of Mathematics and Statistics, York University, Toronto, ON, Canada
| | - Karim Keshavjee
- Institute for Health Policy, Management and Evaluation, Dalla Lana School of Public Health, University of Toronto, Toronto, ON, Canada
| |
Collapse
|
2
|
Keshavjee K, Candeliere J, Cepeda F, Mittal M, Ali S, Guergachi A. A Framework for Implementing Disease Prevention and Behavior Change Evidence at Scale. Stud Health Technol Inform 2024; 312:3-8. [PMID: 38372303 DOI: 10.3233/shti231301] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/20/2024]
Abstract
The current corpus of evidence-based information for chronic disease prevention and treatment is vast and growing rapidly. Behavior change theories are increasingly more powerful but difficult to operationalize in the current healthcare system. Millions of Canadians are unable to access personalized preventive and behavior change care because our in-person model of care is running at full capacity and is not set up for mass education and behavior change programs. We propose a framework to utilize data from electronic medical records to identify patients at risk of developing chronic disease and reach out to them using digital health tools that are overseen by the primary care team. The framework leverages emerging technologies such as artificial intelligence, digital health tools, and patient-generated data to deliver evidence-based knowledge and behavior change to patients across Canada at scale. The framework is flexible to enable new technologies to be added without overwhelming providers, patients or implementers.
Collapse
Affiliation(s)
- Karim Keshavjee
- Institute of Health, Policy and Management, Dalla Lana School of Public Health, University of Toronto, Toronto, ON, Canada
| | - Jasmine Candeliere
- Institute of Health, Policy and Management, Dalla Lana School of Public Health, University of Toronto, Toronto, ON, Canada
| | - Felipe Cepeda
- Institute of Health, Policy and Management, Dalla Lana School of Public Health, University of Toronto, Toronto, ON, Canada
| | - Manmohan Mittal
- Institute of Health, Policy and Management, Dalla Lana School of Public Health, University of Toronto, Toronto, ON, Canada
| | - Shawar Ali
- Institute of Health, Policy and Management, Dalla Lana School of Public Health, University of Toronto, Toronto, ON, Canada
| | - Aziz Guergachi
- Institute of Health, Policy and Management, Dalla Lana School of Public Health, University of Toronto, Toronto, ON, Canada
- Department of Information Technology Management, Ted Rogers School of Management, Toronto Metropolitan University, Toronto, ON, Canada
- Department of Mathematics and Statistics, York University, Toronto, ON, Canada
| |
Collapse
|
3
|
Keshavjee K, Marcus J, Doherty R, Khatami A, Arslan F, Guergachi A. Measuring and Managing Healthcare Supply and Demand in Real-Time. Stud Health Technol Inform 2024; 312:9-15. [PMID: 38372304 DOI: 10.3233/shti231302] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/20/2024]
Abstract
Measuring the supply and demand for access to and wait-times for healthcare is key to managing healthcare services and allocating resources appropriately. Yet, few jurisdictions in distributed, socialized medicine settings have any way to do so. In this paper, we propose the requirements for a jurisdictional patient scheduling system that can measure key metrics, such as supply of and demand for regulated health care professional care, access to and wait times for care, real-time health system utilization and provide the data to compute patient journeys. The system is also capable of tracking new supply of providers and who does not have access to a primary care provider. Benefits, limitations and risks of the model are discussed.
Collapse
Affiliation(s)
- Karim Keshavjee
- Institute for Health Policy, Management and Evaluation, Dalla Lana School of Public Health, University of Toronto, ON, Canada
| | - Jonathan Marcus
- Dr. Jonathan Marcus Medicine Professional Corp., Toronto, ON, Canada
| | | | - Alireza Khatami
- Institute for Health Policy, Management and Evaluation, Dalla Lana School of Public Health, University of Toronto, ON, Canada
- Department of Information Technology Management, Ted Rogers School of Management, Toronto Metropolitan University, Toronto, ON, Canada
| | - Faiza Arslan
- Institute for Health Policy, Management and Evaluation, Dalla Lana School of Public Health, University of Toronto, ON, Canada
| | - Aziz Guergachi
- Institute for Health Policy, Management and Evaluation, Dalla Lana School of Public Health, University of Toronto, ON, Canada
- Department of Information Technology Management, Ted Rogers School of Management, Toronto Metropolitan University, Toronto, ON, Canada
- Department of Mathematics and Statistics, York University, Toronto, ON, Canada
| |
Collapse
|
4
|
Khatami A, Marcus J, Arslan F, Guergachi A, Keshavjee K. Towards a Regulatory Framework for Electronic Medical Record Interoperability in Canada. Stud Health Technol Inform 2024; 312:59-63. [PMID: 38372312 DOI: 10.3233/shti231312] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/20/2024]
Abstract
All complex systems are potentially predisposed to failure. Healthcare systems are complex systems that are prone to many errors that can result in dire consequences for patients and healthcare providers. The healthcare system in Canada is under unprecedented strain due to shortages of healthcare providers, provider burnout, inefficient workflows, and a lack of appropriate digital infrastructure. We used failure mode and effects analysis (FMEA) to identify the failure modes for care provided in primary care settings. We identified failure modes in appointment scheduling, patient-provider communications, referrals, laboratory and diagnostic procedures, and medication prescriptions as the main failure modes. To mitigate the detected risks, we recommend solutions to 'close the loop' on failure modes to prevent patients from falling through the cracks, as vulnerable patients who cannot advocate for themselves are most likely to do so. We provide preliminary requirements for a regulatory regime for electronic health records that can reduce provider burnout, improve regulatory compliance, and improve system efficiency, all while improving patient safety, experience, and outcomes.
Collapse
Affiliation(s)
- Alireza Khatami
- Institute of Health, Policy and Management, Dalla Lana School of Public Health, University of Toronto, Toronto, ON, Canada
- Department of Information Technology Management, Ted Rogers School of Management, Toronto Metropolitan University, Toronto, ON, Canada
- InfoClin Inc. Toronto, ON, Canada
| | - Jonathan Marcus
- Dr. Jonathan Marcus Medicine Professional Corp., Toronto, ON, Canada
| | - Faiza Arslan
- Institute of Health, Policy and Management, Dalla Lana School of Public Health, University of Toronto, Toronto, ON, Canada
| | - Aziz Guergachi
- Department of Information Technology Management, Ted Rogers School of Management, Toronto Metropolitan University, Toronto, ON, Canada
| | - Karim Keshavjee
- Institute of Health, Policy and Management, Dalla Lana School of Public Health, University of Toronto, Toronto, ON, Canada
- InfoClin Inc. Toronto, ON, Canada
| |
Collapse
|
5
|
Arslan F, Marcus J, Khatami A, Guergachi A, Keshavjee K. Towards a Regulatory Framework for Workflow Improvement in Electronic Medical Records. Stud Health Technol Inform 2024; 312:54-58. [PMID: 38372311 DOI: 10.3233/shti231311] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/20/2024]
Abstract
Physicians have to complete several time-consuming and burnout-inducing tasks in their EMRs for everyday care of patients. Poor workflow design generates increased effort for physicians. In this study, we measure time doctors take to retrieve and review information in the patient chart at the beginning of a visit; one of approximately 12 tasks a doctor must do in the EMR during the visit. Information retrieval takes approximately 40 minutes per day. Automation could save 75% of that time. We estimate that if every family doctor in Canada could save 30 minutes through automation of just this one process, we could free up time equivalent to >3000 physicians and >5 million patients; enough to absorb the vast majority of patients who currently do not have a doctor. We know of no more powerful intervention than workflow automation in Canadian EMRs to increase the supply of doctors while simultaneously reducing a major cause of burnout. We recommend an accelerated research program to identify additional opportunities for workflow automation and a regulatory program to ensure that every physician has access to workflow automation in their EMR.
Collapse
Affiliation(s)
- Faiza Arslan
- Institute of Health, Policy and Management, Dalla Lana School of Public Health, University of Toronto, Toronto, ON, Canada
| | - Jonathan Marcus
- Dr. Jonathan Marcus Medicine Professional Corp., Toronto, ON, Canada
| | - Alireza Khatami
- Institute of Health, Policy and Management, Dalla Lana School of Public Health, University of Toronto, Toronto, ON, Canada
- Department of Information Technology Management, Ted Rogers School of Management, Toronto Metropolitan University, Toronto, ON, Canada
| | - Aziz Guergachi
- Institute of Health, Policy and Management, Dalla Lana School of Public Health, University of Toronto, Toronto, ON, Canada
- Department of Information Technology Management, Ted Rogers School of Management, Toronto Metropolitan University, Toronto, ON, Canada
- Department of Mathematics and Statistics, York University, Toronto, ON, Canada
| | - Karim Keshavjee
- Institute of Health, Policy and Management, Dalla Lana School of Public Health, University of Toronto, Toronto, ON, Canada
- Department of Information Technology Management, Ted Rogers School of Management, Toronto Metropolitan University, Toronto, ON, Canada
| |
Collapse
|
6
|
Simeone D, Lenatti M, Lagoa C, Keshavjee K, Guergachi A, Dabbene F, Paglialonga A. Multi-Input Multi-Output Dynamic Modelling of Type 2 Diabetes Progression. Stud Health Technol Inform 2023; 309:228-232. [PMID: 37869847 DOI: 10.3233/shti230784] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2023]
Abstract
Type 2 Diabetes Mellitus (T2D) is a chronic health condition that affects millions of people globally. Early identification of risk can support preventive intervention and therefore slow down disease progression. Risk characterization is also necessary to monitor the mechanisms behind the pathology through the analysis of the interrelationships between the predictors and their time course. In this work, a multi-input multi-output Gaussian Process model is proposed to describe the evolution of different biomarkers in patients who will/will not develop T2D considering the interdependencies between outputs. The preliminary results obtained suggest that the trends in biomarkers captured by the model are coherent with the literature and with real-world data, demonstrating the value of multi-input multi-output approaches. In future developments, the proposed method could be applied to assess how the biomarkers evolve and interact with each other in groups of patients having in common one or more risk factors.
Collapse
Affiliation(s)
- Davide Simeone
- CNR-IEIIT, Milan, Italy
- Politecnico di Milano, Milan, Italy
| | | | | | | | - Aziz Guergachi
- Toronto Metropolitan University, Toronto, Canada
- York University, Toronto, Canada
| | | | | |
Collapse
|
7
|
Naveed I, Kaleem MF, Keshavjee K, Guergachi A. Artificial intelligence with temporal features outperforms machine learning in predicting diabetes. PLOS Digit Health 2023; 2:e0000354. [PMID: 37878561 PMCID: PMC10599553 DOI: 10.1371/journal.pdig.0000354] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/04/2023] [Accepted: 08/19/2023] [Indexed: 10/27/2023]
Abstract
Diabetes mellitus type 2 is increasingly being called a modern preventable pandemic, as even with excellent available treatments, the rate of complications of diabetes is rapidly increasing. Predicting diabetes and identifying it in its early stages could make it easier to prevent, allowing enough time to implement therapies before it gets out of control. Leveraging longitudinal electronic medical record (EMR) data with deep learning has great potential for diabetes prediction. This paper examines the predictive competency of deep learning models in contrast to state-of-the-art machine learning models to incorporate the time dimension of risk. The proposed research investigates a variety of deep learning models and features for predicting diabetes. Model performance was appraised and compared in relation to predominant features, risk factors, training data density and visit history. The framework was implemented on the longitudinal EMR records of over 19K patients extracted from the Canadian Primary Care Sentinel Surveillance Network (CPCSSN). Empirical findings demonstrate that deep learning models consistently outperform other state-of-the-art competitors with prediction accuracy of above 91%, without overfitting. Fasting blood sugar, hemoglobin A1c and body mass index are the key predictors of future onset of diabetes. Overweight, middle aged patients and patients with hypertension are more vulnerable to developing diabetes, consistent with what is already known. Model performance improves as training data density or the visit history of a patient increases. This study confirms the ability of the LSTM deep learning model to incorporate the time dimension of risk in its predictive capabilities.
Collapse
Affiliation(s)
- Iqra Naveed
- Department of Electrical Engineering, University of Management and Technology, Lahore, Pakistan
| | - Muhammad Farhat Kaleem
- Department of Electrical Engineering, University of Management and Technology, Lahore, Pakistan
| | - Karim Keshavjee
- Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, Canada
| | - Aziz Guergachi
- Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, Canada
- Ted Rogers School of Information Technology Management, Toronto Metropolitan University, Toronto, Canada
- Department of Mathematics and Statistics, York University, Toronto, Canada
| |
Collapse
|
8
|
Keshavjee K, Ali S, Khatami A, Guergachi A. Two decade of diabetes prevention efforts: A call to innovate and revitalize our approach to lifestyle change. Diabetes Res Clin Pract 2023; 201:110680. [PMID: 37105402 DOI: 10.1016/j.diabres.2023.110680] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/26/2023] [Accepted: 04/03/2023] [Indexed: 04/29/2023]
Affiliation(s)
- Karim Keshavjee
- Institute of Health Policy, Management and Evaluation, Dalla Lana School of Public Health, University of Toronto, 155 College St 4th Floor, Toronto, ON M5T 3M6, Canada.
| | - Shawar Ali
- Department of Laboratory Medicine and Pathobiology, Temerty Faculty of Medicine, University of Toronto, 1 King's College Circle, Toronto, ON M5S 1A8, Canada
| | - Alireza Khatami
- Institute of Health Policy, Management and Evaluation, Dalla Lana School of Public Health, University of Toronto, 155 College St 4th Floor, Toronto, ON M5T 3M6, Canada
| | - Aziz Guergachi
- Department of Information Technology Management, Ted Rogers School of Management, Toronto Metropolitan University, 350 Victoria Street Toronto, ON M5B 2K3, Canada
| |
Collapse
|
9
|
Guida F, Lenatti M, Keshavjee K, Khatami A, Guergachi A, Paglialonga A. Characterization of Inclination Analysis for Predicting Onset of Heart Failure from Primary Care Electronic Medical Records. Sensors (Basel) 2023; 23:s23094228. [PMID: 37177432 PMCID: PMC10181219 DOI: 10.3390/s23094228] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/08/2023] [Revised: 04/05/2023] [Accepted: 04/22/2023] [Indexed: 05/15/2023]
Abstract
The aim of this study is to characterize the performance of an inclination analysis for predicting the onset of heart failure (HF) from routinely collected clinical biomarkers extracted from primary care electronic medical records. A balanced dataset of 698 patients (with/without HF), including a minimum of five longitudinal measures of nine biomarkers (body mass index, diastolic and systolic blood pressure, fasting glucose, glycated hemoglobin, low-density and high-density lipoproteins, total cholesterol, and triglycerides) is used. The proposed algorithm achieves an accuracy of 0.89 (sensitivity of 0.89, specificity of 0.90) to predict the inclination of biomarkers (i.e., their trend towards a 'survival' or 'collapse' as defined by an inclination analysis) on a labeled, balanced dataset of 40 patients. Decision trees trained on the predicted inclination of biomarkers have significantly higher recall (0.69 vs. 0.53) and significantly higher negative predictive value (0.60 vs. 0.55) than those trained on the average values computed from the measures of biomarkers available before the onset of the disease, suggesting that an inclination analysis can help identify the onset of HF in the primary care patient population from routinely available clinical data. This exploratory study provides the basis for further investigations of inclination analyses to identify at-risk patients and generate preventive measures (i.e., personalized recommendations to reverse the trend of biomarkers towards collapse).
Collapse
Affiliation(s)
- Federica Guida
- Dipartimento di Elettronica, Informazione e Bioingegneria (DEIB), Politecnico di Milano, 20133 Milan, Italy
| | - Marta Lenatti
- Cnr-Istituto di Elettronica e di Ingegneria dell'Informazione e delle Telecomunicazioni (CNR-IEIIT), 20133 Milan, Italy
| | - Karim Keshavjee
- Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, ON M5T 3M6, Canada
| | - Alireza Khatami
- Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, ON M5T 3M6, Canada
| | - Aziz Guergachi
- Ted Rogers School of Management, Toronto Metropolitan University, Toronto, ON M5G 2C3, Canada
- Ted Rogers School of Information Technology Management, Toronto Metropolitan University, Toronto, ON M5G 2C3, Canada
- Department of Mathematics and Statistics, York University, Toronto, ON M3J 1P3, Canada
| | - Alessia Paglialonga
- Cnr-Istituto di Elettronica e di Ingegneria dell'Informazione e delle Telecomunicazioni (CNR-IEIIT), 20133 Milan, Italy
| |
Collapse
|
10
|
Dekamin A, Wahab MIM, Keshavjee K, Guergachi A. High cardiovascular disease risk-associated with the incidence of Type 2 diabetes among prediabetics. Eur J Intern Med 2022; 106:56-62. [PMID: 36156254 DOI: 10.1016/j.ejim.2022.09.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/04/2022] [Revised: 08/24/2022] [Accepted: 09/07/2022] [Indexed: 11/22/2022]
Abstract
BACKGROUND Prediabetes is a risk factor for developing Type 2 diabetes mellitus (T2D). We report on the first cohort study of the association between high cardiovascular diseases (CVD) risk with the incidence of T2D in prediabetics. First, estimate the direct effect of developing T2D on patients with prediabetes who have high CVDs risk; and 2) assess the potential increased risk of developing T2D mediated by statins. METHODS We conducted a population-based cohort study using a subset of data from the Canadian Primary Care Sentinel Surveillance Network (CPCSSN) from 2000 to 2015. Cox proportional hazards (PH) regressions were conducted to estimate our primary outcome, which is the time to T2D among patients with prediabetes. RESULTS From the 4995 filtered prediabetic participants identified between 2000 and 2015, 2800 participants were diagnosed with high CVDs risk scores as measured by the Framingham risk score. 2195 participants were non-high CVDs risk controls. The covariate-adjusted hazard ratio (HR) of 1.24 [95% confidence interval (CI), 1.10-1.31] for T2D by CVDs risk among prediabetics was observed. The total effect of CVDs risk on developing T2D was decomposed to a natural direct effect of high CVDs risk HR= 1.18 [95% CI, 1.01-1.48] and an indirect effect through statin therapy of HR= 1.06 [95% CI, 0.97-1.30]. CONCLUSION Patients with prediabetes and high CVDs risk had a 24% higher chance of developing T2D. The high CVDs risk effect was mediated by statin therapy. Regular monitoring and counselling of prediabetics using statins is likely warranted to prevent the incidence of T2D.
Collapse
Affiliation(s)
- Azam Dekamin
- Department of Mechanical and Industrial Engineering, Toronto Metropolitan University, 350 Victoria Street, Toronto ON M5B 2K3, Canada.
| | - M I M Wahab
- Department of Mechanical and Industrial Engineering, Toronto Metropolitan University, 350 Victoria Street, Toronto ON M5B 2K3, Canada
| | - Karim Keshavjee
- Institute of Health Policy, Management and Evaluation, University of Toronto, Dalla Lana School of Public Health, Toronto ON M5T 3M6, Canada
| | - Aziz Guergachi
- Ted Rogers, School of Information Technology Management, Toronto Metropolitan University, 350 Victoria Street, Toronto ON M5B 2K3, Canada; Ted Rogers, School of Management, Toronto Metropolitan University, 350 Victoria Street, Toronto ON M5B 2K3, Canada; Department of Mathematics and Statistics, York University, N520 Ross, 4700 Keele Street, Toronto ON M3J 1P3, Canada; Fields Institute for Research in Mathematical Sciences, 222 College St., Toronto, Ontario, Canada
| |
Collapse
|
11
|
Lenatti M, Carlevaro A, Guergachi A, Keshavjee K, Mongelli M, Paglialonga A. A novel method to derive personalized minimum viable recommendations for type 2 diabetes prevention based on counterfactual explanations. PLoS One 2022; 17:e0272825. [PMCID: PMC9671330 DOI: 10.1371/journal.pone.0272825] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2022] [Accepted: 11/02/2022] [Indexed: 11/19/2022] Open
Abstract
Despite the growing availability of artificial intelligence models for predicting type 2 diabetes, there is still a lack of personalized approaches to quantify minimum viable changes in biomarkers that may help reduce the individual risk of developing disease. The aim of this article is to develop a new method, based on counterfactual explanations, to generate personalized recommendations to reduce the one-year risk of type 2 diabetes. Ten routinely collected biomarkers extracted from Electronic Medical Records of 2791 patients at low risk and 2791 patients at high risk of type 2 diabetes were analyzed. Two regions characterizing the two classes of patients were estimated using a Support Vector Data Description classifier. Counterfactual explanations (i.e., minimal changes in input features able to change the risk class) were generated for patients at high risk and evaluated using performance metrics (availability, validity, actionability, similarity, and discriminative power) and a qualitative survey administered to seven expert clinicians. Results showed that, on average, the requested minimum viable changes implied a significant reduction of fasting blood sugar, systolic blood pressure, and triglycerides and a significant increase of high-density lipoprotein in patients at risk of diabetes. A significant reduction in body mass index was also recommended in most of the patients at risk, except in females without hypertension. In general, greater changes were recommended in hypertensive patients compared to non-hypertensive ones. The experts were overall satisfied with the proposed approach although in some cases the proposed recommendations were deemed insufficient to reduce the risk in a clinically meaningful way. Future research will focus on a larger set of biomarkers and different comorbidities, also incorporating clinical guidelines whenever possible. Development of additional mathematical and clinical validation approaches will also be of paramount importance.
Collapse
Affiliation(s)
- Marta Lenatti
- Institute of Electronics, Information Engineering and Telecommunications (IEIIT), National Research Council of Italy (CNR), Rome, Italy
| | - Alberto Carlevaro
- Institute of Electronics, Information Engineering and Telecommunications (IEIIT), National Research Council of Italy (CNR), Rome, Italy
- Department of Electrical, Electronics and Telecommunications Engineering and Naval Architecture (DITEN), University of Genoa, Genoa, Italy
| | - Aziz Guergachi
- Ted Rogers School of Management, Toronto Metropolitan University, Toronto, Canada
- Ted Rogers School of Information Technology Management, Toronto Metropolitan University, Toronto, Canada
- Department of Mathematics and Statistics, York University, Toronto, Canada
| | - Karim Keshavjee
- Institute of Health Policy, Management and Evaluation, Dalla Lana School of Public Health, University of Toronto, Toronto, Canada
- * E-mail:
| | - Maurizio Mongelli
- Institute of Electronics, Information Engineering and Telecommunications (IEIIT), National Research Council of Italy (CNR), Rome, Italy
| | - Alessia Paglialonga
- Institute of Electronics, Information Engineering and Telecommunications (IEIIT), National Research Council of Italy (CNR), Rome, Italy
| |
Collapse
|
12
|
Paglialonga A, Theal R, Barber D, Kyba R, Guergachi A, Keshavjee K. Behavioral Segmentation for Enhanced Peer-to-Peer Patient Education. Stud Health Technol Inform 2022; 294:125-126. [PMID: 35612032 DOI: 10.3233/shti220412] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
The aim of this study was to develop a peer-to-peer virtual intervention for patients with type 2 diabetes from different segments: patients who take several medications (medication group), patients who do not take diabetes medications (lifestyle group), and a mixed group. Preliminary results showed that patients in the lifestyle group were interested in preventive strategies, reporting better learning experience and higher motivation than those in the medication group. Future research is needed to design approaches tailored to patients in the medication group.
Collapse
Affiliation(s)
| | - Rebecca Theal
- Department of Family Medicine, Queen's University, Kingston, Canada
| | - David Barber
- Department of Family Medicine, Queen's University, Kingston, Canada
| | | | - Aziz Guergachi
- Ryerson University, Ted Rogers School of Management, Toronto, Canada
- York University, Department of Mathematics and Statistics, Toronto, Canada
| | - Karim Keshavjee
- Institute of Health Policy, Management and Evaluation, University of Toronto, Canada
| |
Collapse
|
13
|
Golkhandan E, Paglialonga A, Guergachi A, Lussier MT, Richard C, Dube L, Zenlea I, Kyba R, Mittal M, Smokey Thomas W, Keshavjee K. Design for a Virtual Peer-to-Peer Knowledge to Action Platform for Type 2 Diabetes. Stud Health Technol Inform 2022; 294:614-618. [PMID: 35612162 DOI: 10.3233/shti220542] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Many patients with Type 2 Diabetes (T2D) have difficulty in controlling their disease despite wide-spread availability of high-quality guidelines, T2D education programs and primary care follow-up programs. Current diabetes education and treatment programs translate knowledge from bench to bedside well, but underperform on the 'last-mile' of converting that knowledge into action (KTA). Two innovations to the last-mile problem in management of patients with T2D are introduced. 1) Design of a platform for peer-to-peer groups where patients can solve KTA problems together in a structured and psychologically safe environment using all the elements of the Action Cycle phase of the KTA framework. The platform uses Self-Determination Theory as the behavior change theory. 2) A novel patient segmentation method to enable the formation of groups of patients who have similar behavioral characteristics and therefore who are more likely to find common cause in the fight against diabetes.
Collapse
Affiliation(s)
| | - Alessia Paglialonga
- Institute of Electronics, Information Engineering and Telecommunications (IEIIT), National Research Council of Italy (CNR), Milan, Italy
| | | | | | | | - Laurette Dube
- McGill Centre for the Convergence of Health and Economics, McGill University, Montreal, Canada
| | - Ian Zenlea
- Trillium Health Partners, Mississauga, Canada
| | | | - Manmohan Mittal
- Institute of Health Policy, Management and Evaluation, University of Toronto, Canada
| | | | - Karim Keshavjee
- Institute of Health Policy, Management and Evaluation, University of Toronto, Canada
| |
Collapse
|
14
|
Lenatti M, Carlevaro A, Keshavjee K, Guergachi A, Paglialonga A, Mongelli M. Characterization of Type 2 Diabetes Using Counterfactuals and Explainable AI. Stud Health Technol Inform 2022; 294:98-103. [PMID: 35612024 DOI: 10.3233/shti220404] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Type 2 diabetes mellitus is a metabolic disorder of glucose management, whose prevalence is increasing inexorably worldwide. Adherence to therapies, along with a healthy lifestyle can help prevent the onset of disease. This preliminary study proposes the use of explainable artificial intelligence techniques with the aim of (i) characterizing diabetic patients through a set of easily interpretable rules and (ii) providing individualized recommendations for the prevention of the onset of the disease through the generation of counterfactual explanations, based on minimal variations of biomarkers routinely collected in primary care. The results of this preliminary study parallel findings from the literature as differences in biomarkers between patients with and without diabetes are observed for fasting blood sugar, body mass index, and high-density lipoprotein levels.
Collapse
Affiliation(s)
- Marta Lenatti
- National Research Council of Italy (CNR), Institute of Electronics, Information Engineering and Telecommunications (IEIIT), Italy
| | - Alberto Carlevaro
- National Research Council of Italy (CNR), Institute of Electronics, Information Engineering and Telecommunications (IEIIT), Italy.,University of Genoa, Department of Electrical, Electronics and Telecommunications Engineering and Naval Architecture (DITEN), Italy
| | - Karim Keshavjee
- University of Toronto, Institute of Health Policy, Management and Evaluation, Dalla Lana School of Public Health, Canada
| | - Aziz Guergachi
- Ryerson University, Ted Rogers School of Management, Toronto, Canada.,York University, Department of Mathematics and Statistics, Toronto, Canada
| | - Alessia Paglialonga
- National Research Council of Italy (CNR), Institute of Electronics, Information Engineering and Telecommunications (IEIIT), Italy
| | - Maurizio Mongelli
- National Research Council of Italy (CNR), Institute of Electronics, Information Engineering and Telecommunications (IEIIT), Italy
| |
Collapse
|
15
|
Darvishzadeh Sayadi A, Keshavjee K, Monkman H, Guergachi A, Paglialonga A. Improving Shared Decision-Making Using Cognitive Effort-Optimization. Stud Health Technol Inform 2022; 294:703-704. [PMID: 35612182 DOI: 10.3233/shti220561] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Diabetes Prevention Programs (DPPs) can prevent or delay type 2 diabetes (T2D). However, the participation rates in DPPs have been limited. Many individuals at risk of developing diabetes have difficulties making healthy choices because of the cognitive effort required to understand the risks, the role of biomarkers, the consequences of inaction and the actions required to delay or avoid development of T2D. We report on the design and development of a prototype digital tool that decreases cognitive effort for people at risk of developing T2D using the effort-optimized intervention framework.
Collapse
Affiliation(s)
| | - Karim Keshavjee
- Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, Canada.,School of Health Information Science, University of Victoria, Victoria, Canada
| | - Helen Monkman
- School of Health Information Science, University of Victoria, Victoria, Canada
| | - Aziz Guergachi
- Ted Rogers School of Management, Ryerson University, Toronto, Canada.,Department of Mathematics and Statistics, York University, Toronto, Canada
| | - Alessia Paglialonga
- National Research Council of Italy (CNR), Institute of Electronics, Information Engineering and Telecommunications (IEIIT), Milan, Italy
| |
Collapse
|
16
|
Kaleem M, Guergachi A, Krishnan S. Comparison of Empirical Mode Decomposition, Wavelets, and Different Machine Learning Approaches for Patient-Specific Seizure Detection Using Signal-Derived Empirical Dictionary Approach. Front Digit Health 2021; 3:738996. [PMID: 34966902 PMCID: PMC8710482 DOI: 10.3389/fdgth.2021.738996] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2021] [Accepted: 11/18/2021] [Indexed: 11/23/2022] Open
Abstract
Analysis of long-term multichannel EEG signals for automatic seizure detection is an active area of research that has seen application of methods from different domains of signal processing and machine learning. The majority of approaches developed in this context consist of extraction of hand-crafted features that are used to train a classifier for eventual seizure detection. Approaches that are data-driven, do not use hand-crafted features, and use small amounts of patients' historical EEG data for classifier training are few in number. The approach presented in this paper falls in the latter category, and is based on a signal-derived empirical dictionary approach, which utilizes empirical mode decomposition (EMD) and discrete wavelet transform (DWT) based dictionaries learned using a framework inspired by traditional methods of dictionary learning. Three features associated with traditional dictionary learning approaches, namely projection coefficients, coefficient vector and reconstruction error, are extracted from both EMD and DWT based dictionaries for automated seizure detection. This is the first time these features have been applied for automatic seizure detection using an empirical dictionary approach. Small amounts of patients' historical multi-channel EEG data are used for classifier training, and multiple classifiers are used for seizure detection using newer data. In addition, the seizure detection results are validated using 5-fold cross-validation to rule out any bias in the results. The CHB-MIT benchmark database containing long-term EEG recordings of pediatric patients is used for validation of the approach, and seizure detection performance comparable to the state-of-the-art is obtained. Seizure detection is performed using five classifiers, thereby allowing a comparison of the dictionary approaches, features extracted, and classifiers used. The best seizure detection performance is obtained using EMD based dictionary and reconstruction error feature and support vector machine classifier, with accuracy, sensitivity and specificity values of 88.2, 90.3, and 88.1%, respectively. Comparison is also made with other recent studies using the same database. The methodology presented in this paper is shown to be computationally efficient and robust for patient-specific automatic seizure detection. A data-driven methodology utilizing a small amount of patients' historical data is hence demonstrated as a practical solution for automatic seizure detection.
Collapse
Affiliation(s)
- Muhammad Kaleem
- Department of Electrical Engineering, University of Management and Technology, Lahore, Pakistan
| | - Aziz Guergachi
- Department of Information Technology Management, Ted Rogers School of Management, Ryerson University, Toronto, ON, Canada
| | - Sridhar Krishnan
- Department of Electrical, Computer and Biomedical Engineering, Ryerson University, Toronto, ON, Canada
| |
Collapse
|
17
|
Dekamin A, Wahab MIM, Guergachi A, Keshavjee K. FIUS: Fixed partitioning undersampling method. Clin Chim Acta 2021; 522:174-183. [PMID: 34425104 DOI: 10.1016/j.cca.2021.08.023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2021] [Revised: 07/30/2021] [Accepted: 08/18/2021] [Indexed: 11/28/2022]
Abstract
BACKGROUND AND OBJECTIVE In the medical field, data techniques for prediction and finding patterns of prevalent diseases are of increasing interest. Classification is one of the methods used to provide insight into predicting the future onset of type 2 diabetes of those at high risk of progression from pre-diabetes to diabetes. When applying classification techniques to real-world datasets, imbalanced class distribution has been one of the most significant limitations that leads to patients' misclassification. In this paper, we propose a novel balancing method to improve the prediction performance of type 2 diabetes mellitus in imbalanced electronic medical records (EMR). METHODS A novel undersampling method is proposed by utilizing a fixed partitioning distribution scheme in a regular grid. The proposed approach retains valuable information when balancing methods are applied to datasets. RESULTS The best AUC of 80% compared to other classifiers was obtained from the logistic regression (LR) classifier for EMR by applying our proposed undersampling method to balance the data. The new method improved the performance of the LR classifier compared to existing undersampling methods used in the balancing stage. CONCLUSION The results demonstrate the effectiveness and high performance of the proposed method for predicting diabetes in a Canadian imbalanced dataset. Our methodology can be used in other areas to overcome the limitations of imbalanced class distributions.
Collapse
Affiliation(s)
- Azam Dekamin
- Department of Mechanical and Industrial Engineering, Ryerson University, 350 Victoria Street, Toronto, ON M5B 2K3, Canada.
| | - M I M Wahab
- Department of Mechanical and Industrial Engineering, Ryerson University, 350 Victoria Street, Toronto, ON M5B 2K3, Canada
| | - Aziz Guergachi
- Ted Rogers, School of Information Technology Management, Ryerson University, 350 Victoria Street, Toronto, ON M5B 2K3, Canada
| | - Karim Keshavjee
- Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, ON M5T 3M6, Canada
| |
Collapse
|
18
|
Perveen S, Shahbaz M, Ansari MS, Keshavjee K, Guergachi A. A Hybrid Approach for Modeling Type 2 Diabetes Mellitus Progression. Front Genet 2020; 10:1076. [PMID: 31969896 PMCID: PMC6958689 DOI: 10.3389/fgene.2019.01076] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2019] [Accepted: 10/09/2019] [Indexed: 12/31/2022] Open
Abstract
Type 2 Diabetes Mellitus (T2DM) is a chronic, progressive metabolic disorder characterized by hyperglycemia resulting from abnormalities in insulin secretion, insulin action, or both. It is associated with an increased risk of developing vascular complication of micro as well as macro nature. Because of its inconspicuous and heterogeneous character, the management of T2DM is very complex. Modeling physiological processes over time demonstrating the patient’s evolving health condition is imperative to comprehending the patient’s current status of health, projecting its likely dynamics and assessing the requisite care and treatment measures in future. Hidden Markov Model (HMM) is an effective approach for such prognostic modeling. However, the nature of the clinical setting, together with the format of the Electronic Medical Records (EMRs) data, in particular the sparse and irregularly sampled clinical data which is well understood to present significant challenges, has confounded standard HMM. In the present study, we proposed an approximation technique based on Newton’s Divided Difference Method (NDDM) as a component with HMM to determine the risk of developing diabetes in an individual over different time horizons using irregular and sparsely sampled EMRs data. The proposed method is capable of exploiting available sequences of clinical measurements obtained from a longitudinal sample of patients for effective imputation and improved prediction performance. Furthermore, results demonstrated that the discrimination capability of our proposed method, in prognosticating diabetes risk, is superior to the standard HMM.
Collapse
Affiliation(s)
- Sajida Perveen
- Department of Computer Science & Engineering, University of Engineering & Technology, Lahore, Pakistan
| | - Muhammad Shahbaz
- Department of Computer Science & Engineering, University of Engineering & Technology, Lahore, Pakistan.,Research Lab for Advanced System Modelling, Ryerson University, Toronto, ON, Canada
| | | | - Karim Keshavjee
- Research Lab for Advanced System Modelling, Ryerson University, Toronto, ON, Canada.,Institute for Health Policy, Management and Evaluation, University of Toronto, Toronto, ON, Canada
| | - Aziz Guergachi
- Research Lab for Advanced System Modelling, Ryerson University, Toronto, ON, Canada.,Ted Rogers School of Information Technology Management, Ryerson University, Toronto, ON, Canada.,Department of Mathematics & Statistics, York University, Toronto, ON, Canada
| |
Collapse
|
19
|
Abstract
BACKGROUND Diabetes Mellitus is an increasingly prevalent chronic disease characterized by the body's inability to metabolize glucose. The objective of this study was to build an effective predictive model with high sensitivity and selectivity to better identify Canadian patients at risk of having Diabetes Mellitus based on patient demographic data and the laboratory results during their visits to medical facilities. METHODS Using the most recent records of 13,309 Canadian patients aged between 18 and 90 years, along with their laboratory information (age, sex, fasting blood glucose, body mass index, high-density lipoprotein, triglycerides, blood pressure, and low-density lipoprotein), we built predictive models using Logistic Regression and Gradient Boosting Machine (GBM) techniques. The area under the receiver operating characteristic curve (AROC) was used to evaluate the discriminatory capability of these models. We used the adjusted threshold method and the class weight method to improve sensitivity - the proportion of Diabetes Mellitus patients correctly predicted by the model. We also compared these models to other learning machine techniques such as Decision Tree and Random Forest. RESULTS The AROC for the proposed GBM model is 84.7% with a sensitivity of 71.6% and the AROC for the proposed Logistic Regression model is 84.0% with a sensitivity of 73.4%. The GBM and Logistic Regression models perform better than the Random Forest and Decision Tree models. CONCLUSIONS The ability of our model to predict patients with Diabetes using some commonly used lab results is high with satisfactory sensitivity. These models can be built into an online computer program to help physicians in predicting patients with future occurrence of diabetes and providing necessary preventive interventions. The model is developed and validated on the Canadian population which is more specific and powerful to apply on Canadian patients than existing models developed from US or other populations. Fasting blood glucose, body mass index, high-density lipoprotein, and triglycerides were the most important predictors in these models.
Collapse
Affiliation(s)
- Hang Lai
- Department of Mathematics and Statistics, York University, 4700 Keele Street, Toronto, Ontario M3J 1P3 Canada
- The Fields Institute for Research in Mathematical Sciences, Center for Quantitative Analysis and Modelling (CQAM) Lab, 222 College Street, Toronto, Ontario M5T 3J1 Canada
| | - Huaxiong Huang
- Department of Mathematics and Statistics, York University, 4700 Keele Street, Toronto, Ontario M3J 1P3 Canada
- The Fields Institute for Research in Mathematical Sciences, Center for Quantitative Analysis and Modelling (CQAM) Lab, 222 College Street, Toronto, Ontario M5T 3J1 Canada
| | - Karim Keshavjee
- The Fields Institute for Research in Mathematical Sciences, Center for Quantitative Analysis and Modelling (CQAM) Lab, 222 College Street, Toronto, Ontario M5T 3J1 Canada
- Institute of Health Policy, Management and Evaluation, University of Toronto, 155 College Street, Suite 425, Toronto, Ontario M5T 3M6 Canada
| | - Aziz Guergachi
- Department of Mathematics and Statistics, York University, 4700 Keele Street, Toronto, Ontario M3J 1P3 Canada
- The Fields Institute for Research in Mathematical Sciences, Center for Quantitative Analysis and Modelling (CQAM) Lab, 222 College Street, Toronto, Ontario M5T 3J1 Canada
- Ted Rogers School of Management - Information Technology Management, Ryerson University, 350 Victoria Street, Toronto, Ontario M5B 2K3 Canada
| | - Xin Gao
- Department of Mathematics and Statistics, York University, 4700 Keele Street, Toronto, Ontario M3J 1P3 Canada
- The Fields Institute for Research in Mathematical Sciences, Center for Quantitative Analysis and Modelling (CQAM) Lab, 222 College Street, Toronto, Ontario M5T 3J1 Canada
| |
Collapse
|
20
|
Daruwalla Z, Thakkar V, Aggarwal M, Kiasatdolatabadi A, Guergachi A, Keshavjee K. Patient Empowerment: The Role of Technology. Stud Health Technol Inform 2019; 257:70-74. [PMID: 30741175] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
Patient empowerment is a buzzword that has gained much currency in recent years. It is defined as a process that helps people gain control over their own lives and increases their capacity to act on issues that they themselves define as important. This paper outlines the problems faced by the current medical model of patient empowerment and proposes a unique framework for patient empowerment that provides guidance on how health technology supports or detracts from empowering patients and families. The paper provides an ethical lens for physicians, policymakers, patients, and families in the health care system to consider the central role of the principles of autonomy and justice in patient empowerment. This paper also discusses how technology can be used to further patient empowerment and patient-centeredness of health care systems.
Collapse
Affiliation(s)
| | | | | | | | - Aziz Guergachi
- Ted Rogers School of Management, Ryerson University, Toronto, Canada
| | | |
Collapse
|
21
|
Walimohamed F, Aggarwal M, Dong L, Lattimer R, Hakim Z, Goranson D, Ubhi K, Ali M, Shachak A, Guergachi A, Keshavjee K. Design for a Canadian Digital Health Policy & Practices Observatory. Stud Health Technol Inform 2019; 257:444-448. [PMID: 30741237] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
Canada has struggled to make digital health a reality. We identified 6 key issues that appear to impede progress: 1) an inability to coordinate the actions of a rapidly evolving set of stakeholders, 2) patients who lack the ability and resources to play a meaningful role in health system decision-making, 3) world-class innovation that doesn't reach the market, 4) an inability to kick-start interoperability projects that can catalyze system transformation, 5) an inability to procure early-stage innovative technologies at scale, and 6) an inability to share data seamlessly across organizational silos for patient coordination and care, health system management and research. We propose a set of policies and practices that can help Canada assess, monitor and provide feedback to stakeholders and citizens on how well they are progressing toward seamless digital health.
Collapse
Affiliation(s)
| | | | - Linying Dong
- Ted Rogers School of Management, Ryerson University, Toronto, ON
| | | | | | | | | | | | | | - Aziz Guergachi
- Ted Rogers School of Management, Ryerson University, Toronto, ON
| | | |
Collapse
|
22
|
Lan A, Lee A, Munroe K, McRae C, Kaleis L, Keshavjee K, Guergachi A. Review of cognitive behavioural therapy mobile apps using a reference architecture embedded in the patient-provider relationship. Biomed Eng Online 2018; 17:183. [PMID: 30558610 PMCID: PMC6296144 DOI: 10.1186/s12938-018-0611-4] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2017] [Accepted: 11/26/2018] [Indexed: 11/10/2022] Open
Abstract
Background Mobile health apps (mHealth apps) are increasing in popularity and utility for the management of many chronic diseases. Although the current reimbursement structure for mHealth apps is lagging behind the rapidly improving functionality, more clinicians will begin to recommend these apps as they prove their clinical worth. Payors such as the government or private insurance companies will start to reimburse for the use of these technologies, especially if they add value to patients by providing timely support, a more streamlined patient experience, and greater patient convenience. Payors are likely to see benefits for providers, as these apps could help increase productivity between in-office encounters without having to resort to expensive in-person visits when patients are having trouble managing their disease. Key findings To guide and perhaps speed up adoption of mHealth apps by patients and providers, analysis and evaluation of existing apps needs to be carried out and more feedback must be provided to app developers. In this paper, an evaluation of 35 mHealth apps claiming to provide cognitive behavioural therapy was conducted to assess the quality of the patient-provider relationship and evidence-based practices embedded in these apps. The mean score across the apps was 4.9 out of 20 functional criteria all of which were identified as important to the patient-provider relationship. The median score was 5 out of these 20 functional criteria. Conclusion Overall, the apps reviewed were mostly stand-alone apps that do not enhance the patient-provider relationship, improve patient accountability or help providers support patients more effectively between visits. Large improvements in patient experience and provider productivity can be made through enhanced integration of mHealth apps into the healthcare system.
Collapse
Affiliation(s)
- Alice Lan
- University of Toronto, Health Sciences Bldg, 155 College St, 4th Floor, Toronto, ON, M5T 1P8, Canada
| | - Alexandra Lee
- University of Toronto, Health Sciences Bldg, 155 College St, 4th Floor, Toronto, ON, M5T 1P8, Canada
| | - Kristin Munroe
- University of Toronto, Health Sciences Bldg, 155 College St, 4th Floor, Toronto, ON, M5T 1P8, Canada
| | - Cameron McRae
- University of Toronto, Health Sciences Bldg, 155 College St, 4th Floor, Toronto, ON, M5T 1P8, Canada
| | - Linda Kaleis
- University of Toronto, Health Sciences Bldg, 155 College St, 4th Floor, Toronto, ON, M5T 1P8, Canada
| | - Karim Keshavjee
- University of Toronto, Health Sciences Bldg, 155 College St, 4th Floor, Toronto, ON, M5T 1P8, Canada. .,Ryerson University, 111 Gerrard Street East, Unit 301, Toronto, ON, M5B 1G8, Canada.
| | - Aziz Guergachi
- Ryerson University, 350 Victoria Street, Toronto, ON, M5B 2K3, Canada
| |
Collapse
|
23
|
|
24
|
Kaleem M, Gurve D, Guergachi A, Krishnan S. Patient-specific seizure detection in long-term EEG using signal-derived empirical mode decomposition (EMD)-based dictionary approach. J Neural Eng 2018; 15:056004. [PMID: 29937449 DOI: 10.1088/1741-2552/aaceb1] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
OBJECTIVE The objective of the work described in this paper is the development of a computationally efficient methodology for patient-specific automatic seizure detection in long-term multi-channel EEG recordings. APPROACH A novel patient-specific seizure detection approach based on a signal-derived empirical mode decomposition (EMD)-based dictionary approach is proposed. For this purpose, we use an empirical framework for EMD-based dictionary creation and learning, inspired by traditional dictionary learning methods, in which the EMD-based dictionary is learned from the multi-channel EEG data being analyzed for automatic seizure detection. We present the algorithm for dictionary creation and learning, whose purpose is to learn dictionaries with a small number of atoms. Using training signals belonging to seizure and non-seizure classes, an initial dictionary, termed as the raw dictionary, is formed. The atoms of the raw dictionary are composed of intrinsic mode functions obtained after decomposition of the training signals using the empirical mode decomposition algorithm. The raw dictionary is then trained using a learning algorithm, resulting in a substantial decrease in the number of atoms in the trained dictionary. The trained dictionary is then used for automatic seizure detection, such that coefficients of orthogonal projections of test signals against the trained dictionary form the features used for classification of test signals into seizure and non-seizure classes. Thus no hand-engineered features have to be extracted from the data as in traditional seizure detection approaches. MAIN RESULTS The performance of the proposed approach is validated using the CHB-MIT benchmark database, and averaged accuracy, sensitivity and specificity values of 92.9%, 94.3% and 91.5%, respectively, are obtained using support vector machine classifier and five-fold cross-validation method. These results are compared with other approaches using the same database, and the suitability of the approach for seizure detection in long-term multi-channel EEG recordings is discussed. SIGNIFICANCE The proposed approach describes a computationally efficient method for automatic seizure detection in long-term multi-channel EEG recordings. The method does not rely on hand-engineered features, as are required in traditional approaches. Furthermore, the approach is suitable for scenarios where the dictionary once formed and trained can be used for automatic seizure detection of newly recorded data, making the approach suitable for long-term multi-channel EEG recordings.
Collapse
Affiliation(s)
- Muhammad Kaleem
- Department of Electrical Engineering, University of Management and Technology, Lahore, Pakistan
| | | | | | | |
Collapse
|
25
|
Perveen S, Shahbaz M, Keshavjee K, Guergachi A. A Systematic Machine Learning Based Approach for the Diagnosis of Non-Alcoholic Fatty Liver Disease Risk and Progression. Sci Rep 2018; 8:2112. [PMID: 29391513 PMCID: PMC5794753 DOI: 10.1038/s41598-018-20166-x] [Citation(s) in RCA: 33] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2017] [Accepted: 01/02/2018] [Indexed: 12/14/2022] Open
Abstract
Prevention and diagnosis of NAFLD is an ongoing area of interest in the healthcare community. Screening is complicated by the fact that the accuracy of noninvasive testing lacks specificity and sensitivity to make and stage the diagnosis. Currently no non-invasive ATP III criteria based prediction method is available to diagnose NAFLD risk. Firstly, the objective of this research is to develop machine learning based method in order to identify individuals at an increased risk of developing NAFLD using risk factors of ATP III clinical criteria updated in 2005 for Metabolic Syndrome (MetS). Secondly, to validate the relative ability of quantitative score defined by Italian Association for the Study of the Liver (IASF) and guideline explicitly defined for the Canadian population based on triglyceride thresholds to predict NAFLD risk. We proposed a Decision Tree based method to evaluate the risk of developing NAFLD and its progression in the Canadian population, using Electronic Medical Records (EMRs) by exploring novel risk factors for NAFLD. Our results show proposed method could potentially help physicians make more informed choices about their management of patients with NAFLD. Employing the proposed application in ordinary medical checkup is expected to lessen healthcare expenditures compared with administering additional complicated test.
Collapse
Affiliation(s)
- Sajida Perveen
- Department of Computer Science & Engineering, University of Engineering & Technology, Lahore, Pakistan.
| | - Muhammad Shahbaz
- Department of Computer Science & Engineering, University of Engineering & Technology, Lahore, Pakistan
- Research Lab for Advanced System Modelling, Ryerson University, Toronto, ON, M5B 2K3, Canada
| | - Karim Keshavjee
- Research Lab for Advanced System Modelling, Ryerson University, Toronto, ON, M5B 2K3, Canada
- Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada
| | - Aziz Guergachi
- Research Lab for Advanced System Modelling, Ryerson University, Toronto, ON, M5B 2K3, Canada
- Ted Rogers School of Information Technology Management, Ryerson University, Toronto, Ontario, Canada
- Department of Mathematics & Statistics, York University, Toronto, Ontario, Canada
| |
Collapse
|
26
|
Abstract
Purpose
Studies have suggested that attributes are dynamic and a life cycle of product and service attributes exists. When an innovative feature is introduced, the feature might attract and delight customers. However, with the passage of time the state of the attractiveness of this feature may change, for better or for worse. The purpose of this paper is to provide a detailed model that shows the factors and related sub-factors that affect the life cycle of a feature and thereby explain the changes that may happen to a feature over time.
Design/methodology/approach
This model provide detailed explanations of the direct and indirect factors that affect the states of a feature, the ones that affect the rate of adoption, and the ones that trigger the changes between states. The model uses a current-market product’s feature to discuss the effects of these factors on the life cycle of this feature in detail.
Findings
This paper extends the theory of attractive quality attributes by identified seven states of the feature in its life cycle. These states are as follows: unknown/unimportant state, honey pot state, racing state, required state, standard state, core state, and dead state. This paper also identified eight major factors that affect the transition of the feature from one state to another. These factors include demographic, socioeconomic, behavioural, psychological, geographical, environmental, organisational, and technological factors.
Originality/value
The findings of this paper provide additional evidence that product and service attributes are dynamic. This paper also increases the validity of the attractive quality attributes theory and the factors that affect the state of the feature in its life cycle. The understanding of the state of the feature in its life cycle, and the factors that influence this change, helps not only in the introduction of completely new features but also in knowing when to remove obsolescent ones.
Collapse
|
27
|
Philpott D, Guergachi A, Keshavjee K. Design and Validation of a Platform to Evaluate mHealth Apps. Stud Health Technol Inform 2017; 235:3-7. [PMID: 28423744] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
Emerging technologies show great potential in the field of patient care. One such technology is mobile heath applications (mhealth apps), which have exploded in number and variety in recent years, and offer great promise in the ability to collect and monitor patient health data. Despite their apparent success in proliferation and user adoption, these applications struggle to integrate into the primary care system and there is scant information regarding their efficacy to effect patient behavior and consequently health outcomes. In this paper we investigate the potential of a promising clinical evaluation methodology, response adaptive randomized clinical trials, to rapidly and effectively evaluate the efficacy and effectiveness of mhealth apps and to personalize mhealth app selection to individualize patient benefit. Diabetes prevention provides the use case for evaluating the case for and against response-adaptive randomized trials.
Collapse
|
28
|
Abid S, Keshavjee K, Karim A, Guergachi A. What We Can Learn from Amazon for Clinical Decision Support Systems. Stud Health Technol Inform 2017; 234:1-5. [PMID: 28186006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
Health care continue to lag behind other industries, such as retail and financial services, in the use of decision-support-like tools. Amazon is particularly prolific in the use of advanced predictive and prescriptive analytics to assist its customers to purchase more, while increasing satisfaction, retention, repeat-purchases and loyalty. How can we do the same in health care? In this paper, we explore various elements of the Amazon website and Amazon's data science and big data practices to gather inspiration for re-designing clinical decision support in the health care sector. For each Amazon element we identified, we present one or more clinical applications to help us better understand where Amazon's.
Collapse
|
29
|
Keshavjee K, Morrison D, Mohammed S, Guergachi A. IT for Bending the Healthcare Cost Curve: The High Needs, High Cost Approach. Stud Health Technol Inform 2017; 234:178-182. [PMID: 28186037] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
Health systems around the world are under tremendous fiscal pressures. Health system inflation continues to outpace GDP growth in most countries. Health system inflation has been resistant to policy measures, to traditional interventions such as productivity enhancing technologies and to optimization of performance metrics such as length of stay (LOS) and wait times. Organizations that are solving the issue are using specific information that individualizes costs per patient, rather than using average costs per case, which is misleading in most important, high cost, situations. In this paper, we propose an architecture for a health information system that not only individualizes costs, but also leverages the learning health system model to drive down costs, while increasing value for patients and the health care system.
Collapse
|
30
|
|
31
|
|
32
|
Mashayekhi M, Prescod F, Shah B, Dong L, Keshavjee K, Guergachi A. Evaluating the performance of the Framingham Diabetes Risk Scoring Model in Canadian electronic medical records. Can J Diabetes 2015; 39:152-6. [PMID: 25577729 DOI: 10.1016/j.jcjd.2014.10.006] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/05/2014] [Revised: 10/06/2014] [Accepted: 10/07/2014] [Indexed: 12/31/2022]
Abstract
OBJECTIVE The objective of this study was to evaluate the performance of the Framingham Diabetes Risk Scoring Model (FDRSM) in a Canadian population, using the Canadian Primary Care Sentinel Surveillance Network (CPCSSN) database. METHODS We analyzed the records of 571 631 patients, between the ages of 45 and 64, between 2002 and 2005, by extracting the most recent laboratory and examination results, including age, sex, body mass index, fasting blood glucose, high-density lipoprotein, triglycerides and blood pressure. We calculated the risk scores of these patients based on the FDRSM. We tracked these patients for 8 years to find out whether or not they were diagnosed with diabetes. We used the area under the receiver operating characteristics curve (AROC) to estimate the discrimination capability of the FDRSM on our study sample and compared it with the AROC reported in the original Framingham diabetes study. RESULTS The AROC for our main research sample of 1970 patients for whom all risk factors and follow-up data were available was 78.6% compared to the AROC of 85% reported in the FDRSM. We found that 70.1% of our main sample had risks lower than 3%; 16.3% had risks between 3% and 10%; and 13.6% had risks greater than 10% for diabetes over the following 8-year period. CONCLUSIONS The discrimination capability of the FDRSM Canadian electronic medical records is fair. However, building a more accurate model for predicting diabetes based on the characteristics of Canadian patients is highly recommended.
Collapse
Affiliation(s)
- Morteza Mashayekhi
- Ted Rogers School of Information Technology Management, Ryerson University, Toronto, Ontario, Canada.
| | - Franklyn Prescod
- Ted Rogers School of Information Technology Management, Ryerson University, Toronto, Ontario, Canada
| | - Bharat Shah
- Ted Rogers School of Information Technology Management, Ryerson University, Toronto, Ontario, Canada
| | - Linying Dong
- Ted Rogers School of Information Technology Management, Ryerson University, Toronto, Ontario, Canada
| | - Karim Keshavjee
- InfoClin Inc, Toronto, Ontario, Canada; University of Victoria, School of Health Informatics, Victoria, British Columbia, Canada
| | - Aziz Guergachi
- Ted Rogers School of Information Technology Management, Ryerson University, Toronto, Ontario, Canada
| |
Collapse
|
33
|
Kaleem M, Guergachi A, Krishnan S. Application of a variation of empirical mode decomposition and Teager energy operator to EEG signals for mental task classification. Annu Int Conf IEEE Eng Med Biol Soc 2013; 2013:965-8. [PMID: 24109850 DOI: 10.1109/embc.2013.6609663] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
This paper presents a simple and effective methodology for mental task classification using a novel variation of the empirical mode decomposition (EMD) algorithm and the Teager energy operator applied to electroencephalography (EEG) signals. EEG signals corresponding to various types of mental tasks performed by human subjects are decomposed using the variation of EMD, called Empirical Mode Decomposition-Modified Peak Selection (EMD-MPS), which allows direct separation of the signals into a de-trended component, and a trend, according to a frequency separation criterion. Teager energy operator is then applied to calculate the average energy values of both components obtained after signal decomposition using EMD-MPS. These energy values are used to construct feature vectors, and one-versus-one classification of mental tasks is performed using a simple classifier, namely the 1-NN classifier. An average correct classification rate of 87% is obtained, improving on previous results and thereby also demonstrating the effectiveness of the methodology.
Collapse
|
34
|
Kaleem M, Ghoraani B, Guergachi A, Krishnan S. Pathological speech signal analysis and classification using empirical mode decomposition. Med Biol Eng Comput 2013; 51:811-21. [PMID: 23460198 DOI: 10.1007/s11517-013-1051-8] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2012] [Accepted: 02/15/2013] [Indexed: 11/28/2022]
Affiliation(s)
- Muhammad Kaleem
- Department of Electrical and Computer Engineering, Ryerson University, Toronto, Canada.
| | | | | | | |
Collapse
|
35
|
|
36
|
Kaleem M, Guergachi A, Krishnan S. EEG seizure detection and epilepsy diagnosis using a novel variation of Empirical Mode Decomposition. Annu Int Conf IEEE Eng Med Biol Soc 2013; 2013:4314-4317. [PMID: 24110687 DOI: 10.1109/embc.2013.6610500] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/02/2023]
Abstract
Epileptic seizure detection and epilepsy diagnosis based on feature extraction and classification using electroencephalography (EEG) signals is an important area of research. In this paper, we present a simple and effective approach based on signal decomposition, using a novel variation of the Empirical Mode Decomposition called Empirical Mode Decomposition-Modified Peak Selection (EMD-MPS). EMD-MPS allows time-scale based de-trending of signals, allowing signals to be separated directly into a de-trended component, and a trend, according to a frequency separation criterion. Features are extracted from the decomposed components, and a simple classifier, namely the 1-NN classifier is used for three classification tasks. The technique is tested on a publicly available EEG database, and a classification accuracy of 99% for epilepsy diagnosis task, and 100% and 98.2% for two seizure detection tasks is obtained. These results are better than, or comparable to previous results using the same EEG database, but have been obtained with a simpler and computationally fast signal analysis and classification method.
Collapse
|
37
|
Kaleem MF, Ghoraani B, Guergachi A, Krishnan S. Telephone-quality pathological speech classification using empirical mode decomposition. Annu Int Conf IEEE Eng Med Biol Soc 2012; 2011:7095-8. [PMID: 22255973 DOI: 10.1109/iembs.2011.6091793] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
This paper presents a computationally simple and effective methodology based on empirical mode decomposition (EMD) for classification of telephone quality normal and pathological speech signals. EMD is used to decompose continuous normal and pathological speech signals into intrinsic mode functions, which are analyzed to extract physically meaningful and unique temporal and spectral features. Using continuous speech samples from a database of 51 normal and 161 pathological speakers, which has been modified to simulate telephone quality speech under different levels of noise, a linear classifier is used with the feature vector thus obtained to obtain a high classification accuracy, thereby demonstrating the effectiveness of the methodology. The classification accuracy reported in this paper (89.7% for signal-to-noise ratio 30 dB) is a significant improvement over previously reported results for the same task, and demonstrates the utility of our methodology for cost-effective remote voice pathology assessment over telephone channels.
Collapse
Affiliation(s)
- M F Kaleem
- Department of Electrical Engineering, Ryerson University, Toronto, Canada.
| | | | | | | |
Collapse
|
38
|
Baskaran V, Guergachi A, Shah B, Sidani S, Bali R, Naguib R, Wickramasinghe N. Information technology-initiated interventions: a case study for the UK National Health Service Breast Screening Programme to improve screening attendance using a new intervention research framework. IJBET 2012. [DOI: 10.1504/ijbet.2012.045354] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
|
39
|
|
40
|
Baskaran V, Guergachi A, Bali RK, Naguib RNG. Predicting Breast Screening Attendance Using Machine Learning Techniques. ACTA ACUST UNITED AC 2011; 15:251-9. [DOI: 10.1109/titb.2010.2103954] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
|
41
|
Kaleem MF, Sugavaneswaran L, Guergachi A, Krishnan S. Application of empirical mode decomposition and Teager energy operator to EEG signals for mental task classification. Annu Int Conf IEEE Eng Med Biol Soc 2010; 2010:4590-4593. [PMID: 21096224 DOI: 10.1109/iembs.2010.5626501] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/30/2023]
Abstract
This paper presents a novel method for mental task classification from EEG signals using Empirical Mode Decomposition and Teager energy operator techniques on EEG data. The efficacy of these techniques for non-stationary and non-linear data has already been demonstrated, which therefore lend themselves well to EEG signals, which are also non-stationary and non-linear in nature. The method described in this paper decomposed the EEG signals (6 EEG signals per task per subject, for a total of 5 tasks over multiple trials) into their constituent oscillatory modes, called intrinsic mode functions, and separated out the trend from the signal. Teager energy operator was used to calculate the average energy of both the detrended signal and the trend. The average energy was used to construct separate feature vectors with a small number of parameters for the detrended signal and the trend. Based on these parameters, one-versus-one classification of mental tasks was performed using Linear Discriminant Analysis. Using both feature vectors, an average correct classification rate of more than 85% was achieved, demonstrating the effectiveness of the method used. Furthermore, this method used all the intrinsic mode functions, as opposed to similar studies, demonstrating that the trend of the EEG signal also contains important discriminatory information.
Collapse
Affiliation(s)
- M F Kaleem
- Department of Electrical Engineering, Ryerson University, Toronto, Canada.
| | | | | | | |
Collapse
|
42
|
Baskaran V, Bali R, Arochena H, Naguib R, Shah B, Guergachi A, Wickramasinghe N. Knowledge management as a holistic tool for superior project management. IJIL 2010. [DOI: 10.1504/ijil.2010.030609] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
|