Priorities for successful use of artificial intelligence by public health organizations: a literature review

Seeing the random forest through the decision trees. Supporting learning health systems from histopathology with machine learning models: Challenges and opportunities

This paper discusses some overlooked challenges faced when working with machine learning models for histopathology and presents a novel opportunity to support "Learning Health Systems" with them. Initially, the authors elaborate on these challenges after separating them according to their mitigation strategies: those that need innovative approaches, time, or future technological capabilities and those that require a conceptual reappraisal from a critical perspective. Then, a novel opportunity to support "Learning Health Systems" by integrating hidden information extracted by ML models from digitalized histopathology slides with other healthcare big data is presented.

Implications of Big Data Analytics, AI, Machine Learning, and Deep Learning in the Health Care System of Bangladesh: Scoping Review

BACKGROUND

The rapid advancement of digital technologies, particularly in big data analytics (BDA), artificial intelligence (AI), machine learning (ML), and deep learning (DL), is reshaping the global health care system, including in Bangladesh. The increased adoption of these technologies in health care delivery within Bangladesh has sparked their integration into health care and public health research, resulting in a noticeable surge in related studies. However, a critical gap exists, as there is a lack of comprehensive evidence regarding the research landscape; regulatory challenges; use cases; and the application and adoption of BDA, AI, ML, and DL in the health care system of Bangladesh. This gap impedes the attainment of optimal results. As Bangladesh is a leading implementer of digital technologies, bridging this gap is urgent for the effective use of these advancing technologies.

OBJECTIVE

This scoping review aims to collate (1) the existing research in Bangladesh's health care system, using the aforementioned technologies and synthesizing their findings, and (2) the limitations faced by researchers in integrating the aforementioned technologies into health care research.

METHODS

MEDLINE (via PubMed), IEEE Xplore, Scopus, and Embase databases were searched to identify published research articles between January 1, 2000, and September 10, 2023, meeting the following inclusion criteria: (1) any study using any of the BDA, AI, ML, and DL technologies and health care and public health datasets for predicting health issues and forecasting any kind of outbreak; (2) studies primarily focusing on health care and public health issues in Bangladesh; and (3) original research articles published in peer-reviewed journals and conference proceedings written in English.

RESULTS

With the initial search, we identified 1653 studies. Following the inclusion and exclusion criteria and full-text review, 4.66% (77/1653) of the articles were finally included in this review. There was a substantial increase in studies over the last 5 years (2017-2023). Among the 77 studies, the majority (n=65, 84%) used ML models. A smaller proportion of studies incorporated AI (4/77, 5%), DL (7/77, 9%), and BDA (1/77, 1%) technologies. Among the reviewed articles, 52% (40/77) relied on primary data, while the remaining 48% (37/77) used secondary data. The primary research areas of focus were infectious diseases (15/77, 19%), noncommunicable diseases (23/77, 30%), child health (11/77, 14%), and mental health (9/77, 12%).

CONCLUSIONS

This scoping review highlights remarkable progress in leveraging BDA, AI, ML, and DL within Bangladesh's health care system. The observed surge in studies over the last 5 years underscores the increasing significance of AI and related technologies in health care research. Notably, most (65/77, 84%) studies focused on ML models, unveiling opportunities for advancements in predictive modeling. This review encapsulates the current state of technological integration and propels us into a promising era for the future of digital Bangladesh.

Data Analytics to Support Policy Making for Noncommunicable Diseases: Scoping Review

BACKGROUND

There is an emerging need for evidence-based approaches harnessing large amounts of health care data and novel technologies (such as artificial intelligence) to optimize public health policy making.

OBJECTIVE

The aim of this review was to explore the data analytics tools designed specifically for policy making in noncommunicable diseases (NCDs) and their implementation.

METHODS

A scoping review was conducted after searching the PubMed and IEEE databases for articles published in the last 10 years.

RESULTS

Nine articles that presented 7 data analytics tools designed to inform policy making for NCDs were reviewed. The tools incorporated descriptive and predictive analytics. Some tools were designed to include recommendations for decision support, but no pilot studies applying prescriptive analytics have been published. The tools were piloted with various conditions, with cancer being the least studied condition. Implementation of the tools included use cases, pilots, or evaluation workshops that involved policy makers. However, our findings demonstrate very limited real-world use of analytics by policy makers, which is in line with previous studies.

CONCLUSIONS

Despite the availability of tools designed for different purposes and conditions, data analytics is not widely used to support policy making for NCDs. However, the review demonstrates the value and potential use of data analytics to support policy making. Based on the findings, we make suggestions for researchers developing digital tools to support public health policy making. The findings will also serve as input for the European Union-funded research project ONCODIR developing a policy analytics dashboard for the prevention of colorectal cancer as part of an integrated platform.

Exploring AI-chatbots' capability to suggest surgical planning in ophthalmology: ChatGPT versus Google Gemini analysis of retinal detachment cases

BACKGROUND

We aimed to define the capability of three different publicly available large language models, Chat Generative Pretrained Transformer (ChatGPT-3.5), ChatGPT-4 and Google Gemini in analysing retinal detachment cases and suggesting the best possible surgical planning.

METHODS

Analysis of 54 retinal detachments records entered into ChatGPT and Gemini's interfaces. After asking 'Specify what kind of surgical planning you would suggest and the eventual intraocular tamponade.' and collecting the given answers, we assessed the level of agreement with the common opinion of three expert vitreoretinal surgeons. Moreover, ChatGPT and Gemini answers were graded 1-5 (from poor to excellent quality), according to the Global Quality Score (GQS).

RESULTS

After excluding 4 controversial cases, 50 cases were included. Overall, ChatGPT-3.5, ChatGPT-4 and Google Gemini surgical choices agreed with those of vitreoretinal surgeons in 40/50 (80%), 42/50 (84%) and 35/50 (70%) of cases. Google Gemini was not able to respond in five cases. Contingency analysis showed significant differences between ChatGPT-4 and Gemini (p=0.03). ChatGPT's GQS were 3.9±0.8 and 4.2±0.7 for versions 3.5 and 4, while Gemini scored 3.5±1.1. There was no statistical difference between the two ChatGPTs (p=0.22), while both outperformed Gemini scores (p=0.03 and p=0.002, respectively). The main source of error was endotamponade choice (14% for ChatGPT-3.5 and 4, and 12% for Google Gemini). Only ChatGPT-4 was able to suggest a combined phacovitrectomy approach.

CONCLUSION

In conclusion, Google Gemini and ChatGPT evaluated vitreoretinal patients' records in a coherent manner, showing a good level of agreement with expert surgeons. According to the GQS, ChatGPT's recommendations were much more accurate and precise.

Large language models as assistance for glaucoma surgical cases: a ChatGPT vs. Google Gemini comparison

PURPOSE

The aim of this study was to define the capability of ChatGPT-4 and Google Gemini in analyzing detailed glaucoma case descriptions and suggesting an accurate surgical plan.

METHODS

Retrospective analysis of 60 medical records of surgical glaucoma was divided into "ordinary" (n = 40) and "challenging" (n = 20) scenarios. Case descriptions were entered into ChatGPT and Bard's interfaces with the question "What kind of surgery would you perform?" and repeated three times to analyze the answers' consistency. After collecting the answers, we assessed the level of agreement with the unified opinion of three glaucoma surgeons. Moreover, we graded the quality of the responses with scores from 1 (poor quality) to 5 (excellent quality), according to the Global Quality Score (GQS) and compared the results.

RESULTS

ChatGPT surgical choice was consistent with those of glaucoma specialists in 35/60 cases (58%), compared to 19/60 (32%) of Gemini (p = 0.0001). Gemini was not able to complete the task in 16 cases (27%). Trabeculectomy was the most frequent choice for both chatbots (53% and 50% for ChatGPT and Gemini, respectively). In "challenging" cases, ChatGPT agreed with specialists in 9/20 choices (45%), outperforming Google Gemini performances (4/20, 20%). Overall, GQS scores were 3.5 ± 1.2 and 2.1 ± 1.5 for ChatGPT and Gemini (p = 0.002). This difference was even more marked if focusing only on "challenging" cases (1.5 ± 1.4 vs. 3.0 ± 1.5, p = 0.001).

CONCLUSION

ChatGPT-4 showed a good analysis performance for glaucoma surgical cases, either ordinary or challenging. On the other side, Google Gemini showed strong limitations in this setting, presenting high rates of unprecise or missed answers.

Artificial intelligence empowering public health education: prospects and challenges

Artificial Intelligence (AI) is revolutionizing public health education through its capacity for intricate analysis of large-scale health datasets and the tailored dissemination of health-related information and interventions. This article conducts a profound exploration into the integration of AI within public health, accentuating its scientific foundations, prospective progress, and practical application scenarios. It underscores the transformative potential of AI in crafting individualized educational programs, developing sophisticated behavioral models, and informing the creation of health policies. The manuscript strives to thoroughly evaluate the extant landscape of AI applications in public health, scrutinizing critical challenges such as the propensity for data bias and the imperative of safeguarding privacy. By dissecting these issues, the article contributes to the conversation on how AI can be harnessed responsibly and effectively, ensuring that its application in public health education is both ethically grounded and equitable. The paper's significance is multifold: it aims to provide a blueprint for policy formulation, offer actionable insights for public health authorities, and catalyze the progression of health interventions toward increasingly sophisticated and precise approaches. Ultimately, this research anticipates fostering an environment where AI not only augments public health education but also does so with a steadfast commitment to the principles of justice and inclusivity, thereby elevating the standard and reach of health education initiatives globally.

Precision public health in the era of genomics and big data

Precision public health (PPH) considers the interplay between genetics, lifestyle and the environment to improve disease prevention, diagnosis and treatment on a population level-thereby delivering the right interventions to the right populations at the right time. In this Review, we explore the concept of PPH as the next generation of public health. We discuss the historical context of using individual-level data in public health interventions and examine recent advancements in how data from human and pathogen genomics and social, behavioral and environmental research, as well as artificial intelligence, have transformed public health. Real-world examples of PPH are discussed, emphasizing how these approaches are becoming a mainstay in public health, as well as outstanding challenges in their development, implementation and sustainability. Data sciences, ethical, legal and social implications research, capacity building, equity research and implementation science will have a crucial role in realizing the potential for 'precision' to enhance traditional public health approaches.

Assessment of Saudi Public Perceptions and Opinions towards Artificial Intelligence in Health Care

Background and Objectives: The healthcare system in Saudi Arabia is growing rapidly with the utilization of advanced technologies. Therefore, this study aimed to assess the Saudi public perceptions and opinions towards artificial intelligence (AI) in health care. Materials and Methods: This cross-sectional web-based questionnaire study was conducted between January and April 2024. Data were analyzed from 830 participants. The perceptions of the public towards AI were assessed using 21-item questionnaires. Results: Among the respondents, 69.4% were males and 46% of them were aged above 41 years old. A total of 84.1% of the participants knew about AI, while 61.1% of them believed that AI is a tool that helps healthcare professionals, and 12.5% of them thought that AI may replace the physician, pharmacist, or nurse in the healthcare system. With regard to opinion on the widespread use of AI, 45.8% of the study population believed that healthcare professionals will be improved with the widespread use of artificial intelligence. The mean perception score of AI among males was 38.4 (SD = 6.1) and this was found to be higher than for females at 37.7 (SD = 5.3); however, no significant difference was observed (p = 0.072). Similarly, the mean perception score was higher among young adults aged between 20 and 25 years at 38.9 (SD = 6.1) compared to other age groups, but indicating no significant association between them (p = 0.198). Conclusions: The results showed that the Saudi public had a favorable opinion and perceptions of AI in health care. This suggests that health management recommendations should be made regarding how to successfully integrate and use medical AI while maintaining patient safety.

Applying Machine Learning Techniques to Implementation Science

Machine learning (ML) approaches could expand the usefulness and application of implementation science methods in clinical medicine and public health settings. The aim of this viewpoint is to introduce a roadmap for applying ML techniques to address implementation science questions, such as predicting what will work best, for whom, under what circumstances, and with what predicted level of support, and what and when adaptation or deimplementation are needed. We describe how ML approaches could be used and discuss challenges that implementation scientists and methodologists will need to consider when using ML throughout the stages of implementation.

Interpretable machine learning in predicting drug-induced liver injury among tuberculosis patients: model development and validation study

BACKGROUND

The objective of this research was to create and validate an interpretable prediction model for drug-induced liver injury (DILI) during tuberculosis (TB) treatment.

METHODS

A dataset of TB patients from Ningbo City was used to develop models employing the eXtreme Gradient Boosting (XGBoost), random forest (RF), and the least absolute shrinkage and selection operator (LASSO) logistic algorithms. The model's performance was evaluated through various metrics, including the area under the receiver operating characteristic curve (AUROC) and the area under the precision recall curve (AUPR) alongside the decision curve. The Shapley Additive exPlanations (SHAP) method was used to interpret the variable contributions of the superior model.

RESULTS

A total of 7,071 TB patients were identified from the regional healthcare dataset. The study cohort consisted of individuals with a median age of 47 years, 68.0% of whom were male, and 16.3% developed DILI. We utilized part of the high dimensional propensity score (HDPS) method to identify relevant variables and obtained a total of 424 variables. From these, 37 variables were selected for inclusion in a logistic model using LASSO. The dataset was then split into training and validation sets according to a 7:3 ratio. In the validation dataset, the XGBoost model displayed improved overall performance, with an AUROC of 0.89, an AUPR of 0.75, an F1 score of 0.57, and a Brier score of 0.07. Both SHAP analysis and XGBoost model highlighted the contribution of baseline liver-related ailments such as DILI, drug-induced hepatitis (DIH), and fatty liver disease (FLD). Age, alanine transaminase (ALT), and total bilirubin (Tbil) were also linked to DILI status.

CONCLUSION

XGBoost demonstrates improved predictive performance compared to RF and LASSO logistic in this study. Moreover, the introduction of the SHAP method enhances the clinical understanding and potential application of the model. For further research, external validation and more detailed feature integration are necessary.

Artificial intelligence in respiratory care: Current scenario and future perspective

BACKGROUND

This narrative review aims to explore the current state and future perspective of artificial intelligence (AI) in respiratory care. The objective is to provide insights into the potential impact of AI in this field.

METHODS

A comprehensive analysis of relevant literature and research studies was conducted to examine the applications of AI in respiratory care and identify areas of advancement. The analysis included studies on remote monitoring, early detection, smart ventilation systems, and collaborative decision-making.

RESULTS

The obtained results highlight the transformative potential of AI in respiratory care. AI algorithms have shown promising capabilities in enabling tailored treatment plans based on patient-specific data. Remote monitoring using AI-powered devices allows for real-time feedback to health-care providers, enhancing patient care. AI algorithms have also demonstrated the ability to detect respiratory conditions at an early stage, leading to timely interventions and improved outcomes. Moreover, AI can optimize mechanical ventilation through continuous monitoring, enhancing patient comfort and reducing complications. Collaborative AI systems have the potential to augment the expertise of health-care professionals, leading to more accurate diagnoses and effective treatment strategies.

CONCLUSION

By improving diagnosis, AI has the potential to revolutionize respiratory care, treatment planning, and patient monitoring. While challenges and ethical considerations remain, the transformative impact of AI in this domain cannot be overstated. By leveraging the advancements and insights from this narrative review, health-care professionals and researchers can continue to harness the power of AI to improve patient outcomes and enhance respiratory care practices.

IMPROVEMENTS

Based on the findings, future research should focus on refining AI algorithms to enhance their accuracy, reliability, and interpretability. In addition, attention should be given to addressing ethical considerations, ensuring data privacy, and establishing regulatory frameworks to govern the responsible implementation of AI in respiratory care.

Revisiting the importance of temperature, weather and air pollution variables in heat-mortality relationships with machine learning

Extreme heat events have significant health impacts that need to be adequately quantified in the context of climate change. Traditionally, heat-health association methods have relied on statistical models using a single air temperature index, without considering other heat-related variables that may influence the relationship and their potentially complex interactions. This study aims to introduce and compare different machine learning (ML) models, which naturally consider interactions between predictors and non-linearities, to re-examine the importance of temperature, weather and air pollution predictors in modeling the heat-mortality relationship. ML approaches based on tree ensembles and neural networks, as well as non-linear statistical models, were used to model the heat-mortality relationship in the two most populated metropolitan areas of the province of Quebec, Canada. The models were calibrated using a comprehensive database of heat-related predictors including various lagged temperature indices, temperature variations, meteorological and air pollution variables. Performance was evaluated based on out-of-sample summer mortality predictions. For the two studied regions, models relying only on lagged temperature indices performed better, or equally well, than models considering more heat-related predictors such as temperature variations, weather and air pollution variables. The temperature index with the best performance differed by region, but both mean temperature and humidex were among the best indices. In terms of modeling approaches, non-linear statistical models were as competent as more advanced ML models for predicting out-of-sample summer mortality. This research validated the current use of non-linear statistical models with the appropriate lagged temperature index to model the heat-mortality relationship. Although ML models have not improved the performance of all-cause mortality modeling, these approaches should continue to be explored, particularly for other health effects that may be more directly linked to heat exposure and, in the future, when more data become available.

Performance of Google bard and ChatGPT in mass casualty incidents triage

AIM

The objective of our research is to evaluate and compare the performance of ChatGPT, Google Bard, and medical students in performing START triage during mass casualty situations.

METHOD

We conducted a cross-sectional analysis to compare ChatGPT, Google Bard, and medical students in mass casualty incident (MCI) triage using the Simple Triage And Rapid Treatment (START) method. A validated questionnaire with 15 diverse MCI scenarios was used to assess triage accuracy and content analysis in four categories: "Walking wounded," "Respiration," "Perfusion," and "Mental Status." Statistical analysis compared the results.

RESULT

Google Bard demonstrated a notably higher accuracy of 60%, while ChatGPT achieved an accuracy of 26.67% (p = 0.002). Comparatively, medical students performed at an accuracy rate of 64.3% in a previous study. However, there was no significant difference observed between Google Bard and medical students (p = 0.211). Qualitative content analysis of 'walking-wounded', 'respiration', 'perfusion', and 'mental status' indicated that Google Bard outperformed ChatGPT.

CONCLUSION

Google Bard was found to be superior to ChatGPT in correctly performing mass casualty incident triage. Google Bard achieved an accuracy of 60%, while chatGPT only achieved an accuracy of 26.67%. This difference was statistically significant (p = 0.002).

Leveraging e-health for enhanced cancer care service models in middle-income contexts: Qualitative insights from oncology care providers

Background

Global cancer research has predominantly favoured high-income countries (HICs). The unique challenges in low- and middle-income countries (LMICs) demand tailored research approaches, accentuated further by the disparities highlighted during the COVID-19 pandemic.

Aim and objectives

This research endeavoured to dissect the intricacies of cancer care in LMICs, with Jordan serving as a case study. Specifically, the study aimed to conduct an in-depth analysis of the prevailing cancer care model and assess the transformative potential of eHealth technologies in bolstering cancer care delivery.

Methods

Utilising a qualitative methodology, in-depth semi-structured interviews with oncology healthcare professionals were executed. Data underwent inductive thematic analysis as per Braun and Clarke's guidelines.

Results

From the analysed data, two dominant themes surfaced. Firstly, "The current state of cancer care delivery" was subdivided into three distinct subthemes. Secondly, "Opportunities for enhanced care delivery via e-health" underscored the urgency of digital health reforms.

Conclusion

The need to restrategise cancer care in LMICs is highlighted by this study, using the Jordanian healthcare context as a reference. The transformative potential of e-health initiatives has been illustrated. However, the relevance of this study might be limited by its region-specific approach. Future research is deemed essential for deeper exploration into the integration of digital health within traditional oncology settings across diverse LMICs, emphasising the significance of telemedicine in digital-assisted care delivery reforms.

Unleashing the global potential of public health: A framework for future pandemic response

Public health emergencies, especially pandemics, need to be managed globally, and on several levels, emphasizing the importance of leadership, communication, and synchronization of measures, data, and management plans in contrast to the management of the Coronavirus-19 pandemic, which illustrated diverse strategies employed by various nations. This paper aims to review and discuss whether globalized diseases in a globalized world should be managed by globalized public health. Using a systematic literature search, followed by a non-systematic literature review, selected studies were grouped into topics, and analyzed, using content analysis to enhance the conclusive results. The results present a roadmap towards a re-envisioned framework highlighting key areas of focus: data-driven decision-making, robust technology infrastructure, global cooperation, and ongoing public health education, as part of a coordinated global response. This article reveals the weaknesses of current pandemic management systems and recommends new steps to further strengthen the management of future pandemics.

Optimizing Digital Tools for the Field of Substance Use and Substance Use Disorders: Backcasting Exercise

BACKGROUND

Substance use trends are complex; they often rapidly evolve and necessitate an intersectional approach in research, service, and policy making. Current and emerging digital tools related to substance use are promising but also create a range of challenges and opportunities.

OBJECTIVE

This paper reports on a backcasting exercise aimed at the development of a roadmap that identifies values, challenges, facilitators, and milestones to achieve optimal use of digital tools in the substance use field by 2030.

METHODS

A backcasting exercise method was adopted, wherein the core elements are identifying key values, challenges, facilitators, milestones, cornerstones and a current, desired, and future scenario. A structured approach was used by means of (1) an Open Science Framework page as a web-based collaborative working space and (2) key stakeholders' collaborative engagement during the 2022 Lisbon Addiction Conference.

RESULTS

The identified key values were digital rights, evidence-based tools, user-friendliness, accessibility and availability, and person-centeredness. The key challenges identified were ethical funding, regulations, commercialization, best practice models, digital literacy, and access or reach. The key facilitators identified were scientific research, interoperable infrastructure and a culture of innovation, expertise, ethical funding, user-friendly designs, and digital rights and regulations. A range of milestones were identified. The overarching identified cornerstones consisted of creating ethical frameworks, increasing access to digital tools, and continuous trend analysis.

CONCLUSIONS

The use of digital tools in the field of substance use is linked to a range of risks and opportunities that need to be managed. The current trajectories of the use of such tools are heavily influenced by large multinational for-profit companies with relatively little involvement of key stakeholders such as people who use drugs, service providers, and researchers. The current funding models are problematic and lack the necessary flexibility associated with best practice business approaches such as lean and agile principles to design and execute customer discovery methods. Accessibility and availability, digital rights, user-friendly design, and person-focused approaches should be at the forefront in the further development of digital tools. Global legislative and technical infrastructures by means of a global action plan and strategy are necessary and should include ethical frameworks, accessibility of digital tools for substance use, and continuous trend analysis as cornerstones.

Using artificial intelligence to improve public health: a narrative review

Artificial intelligence (AI) is a rapidly evolving tool revolutionizing many aspects of healthcare. AI has been predominantly employed in medicine and healthcare administration. However, in public health, the widespread employment of AI only began recently, with the advent of COVID-19. This review examines the advances of AI in public health and the potential challenges that lie ahead. Some of the ways AI has aided public health delivery are via spatial modeling, risk prediction, misinformation control, public health surveillance, disease forecasting, pandemic/epidemic modeling, and health diagnosis. However, the implementation of AI in public health is not universal due to factors including limited infrastructure, lack of technical understanding, data paucity, and ethical/privacy issues.