1
|
Leiva-Araos A, Contreras C, Kaushal H, Prodanoff Z. Predictive Optimization of Patient No-Show Management in Primary Healthcare Using Machine Learning. J Med Syst 2025; 49:7. [PMID: 39808378 DOI: 10.1007/s10916-025-02143-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2024] [Accepted: 01/07/2025] [Indexed: 01/16/2025]
Abstract
The "no-show" problem in healthcare refers to the prevalent phenomenon where patients schedule appointments with healthcare providers but fail to attend them without prior cancellation or rescheduling. In addressing this issue, our study delves into a multivariate analysis over a five-year period involving 21,969 patients. Our study introduces a predictive model framework that offers a holistic approach to managing the no-show problem in healthcare, incorporating elements into the objective function that address not only the accurate prediction of no-shows but also the management of service capacity, overbooking, and idle resource allocation resulting from mispredictions. Our approach simplifies preprocessing and eliminates the need for expert judgment in variable selection, thereby enhancing the model's usability in routine healthcare operations. Our research revealed that key predictors of no-shows are consistent across various studies. We employed semi-automatic feature selection techniques, achieving results comparable to state-of-the-art approaches but with significantly reduced complexity in their selection. This method not only streamlines the feature selection process but also enhances the overall efficiency and scalability of our predictive models, making them more adaptable to diverse healthcare settings. This comprehensive strategy enables healthcare providers to optimize resource allocation and improve service delivery, making our findings relevant for healthcare systems globally facing similar challenges. Future work aims to expand the analysis by incorporating additional third-party data sources, such as weather and commuting activities, to explore the broader impacts of external factors on patient no-show behavior. To the best of our knowledge, this innovative approach is expected to provide deeper insights and further enhance the predictability and effectiveness of no-show mitigation strategies in healthcare systems.
Collapse
Affiliation(s)
- Andrés Leiva-Araos
- Department of Computing, University of North Florida, 1 UNF Dr., Jacksonville, 32246, FL, USA.
- Instituto Data Science, Universidad del Desarrollo, Av. La Plaza 680, 7610658, RM, Las Condes, Chile.
| | - Cristián Contreras
- Centro de Investigación en Ciberseguridad, Universidad Mayor, San Pío X 2422, 7510041, RM, Santiago, Chile
| | - Hemani Kaushal
- Department of Electrical Engineering, University of North Florida, 1 UNF Dr., Jacksonville, 32246, FL, USA.
| | - Zornitza Prodanoff
- Department of Computing, University of North Florida, 1 UNF Dr., Jacksonville, 32246, FL, USA
| |
Collapse
|
2
|
Predicting no-show appointments in a pediatric hospital in Chile using machine learning. Health Care Manag Sci 2023:10.1007/s10729-022-09626-z. [PMID: 36707485 DOI: 10.1007/s10729-022-09626-z] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2021] [Accepted: 12/13/2022] [Indexed: 01/29/2023]
Abstract
The Chilean public health system serves 74% of the country's population, and 19% of medical appointments are missed on average because of no-shows. The national goal is 15%, which coincides with the average no-show rate reported in the private healthcare system. Our case study, Doctor Luis Calvo Mackenna Hospital, is a public high-complexity pediatric hospital and teaching center in Santiago, Chile. Historically, it has had high no-show rates, up to 29% in certain medical specialties. Using machine learning algorithms to predict no-shows of pediatric patients in terms of demographic, social, and historical variables. To propose and evaluate metrics to assess these models, accounting for the cost-effective impact of possible intervention strategies to reduce no-shows. We analyze the relationship between a no-show and demographic, social, and historical variables, between 2015 and 2018, through the following traditional machine learning algorithms: Random Forest, Logistic Regression, Support Vector Machines, AdaBoost and algorithms to alleviate the problem of class imbalance, such as RUS Boost, Balanced Random Forest, Balanced Bagging and Easy Ensemble. These class imbalances arise from the relatively low number of no-shows to the total number of appointments. Instead of the default thresholds used by each method, we computed alternative ones via the minimization of a weighted average of type I and II errors based on cost-effectiveness criteria. 20.4% of the 395,963 appointments considered presented no-shows, with ophthalmology showing the highest rate among specialties at 29.1%. Patients in the most deprived socioeconomic group according to their insurance type and commune of residence and those in their second infancy had the highest no-show rate. The history of non-attendance is strongly related to future no-shows. An 8-week experimental design measured a decrease in no-shows of 10.3 percentage points when using our reminder strategy compared to a control group. Among the variables analyzed, those related to patients' historical behavior, the reservation delay from the creation of the appointment, and variables that can be associated with the most disadvantaged socioeconomic group, are the most relevant to predict a no-show. Moreover, the introduction of new cost-effective metrics significantly impacts the validity of our prediction models. Using a prototype to call patients with the highest risk of no-shows resulted in a noticeable decrease in the overall no-show rate.
Collapse
|
3
|
Weber K, DaSilva AF, Dault JT, Eber R, Huner K, Jones D, Kornman K, Ramaswamy V, Snyder M, Ward BB, Nalliah RP. Using business intelligence and data visualization to understand the characteristics of failed appointments in dental school clinics. J Dent Educ 2021; 85:521-530. [PMID: 33508149 DOI: 10.1002/jdd.12538] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2020] [Revised: 10/19/2020] [Accepted: 10/23/2020] [Indexed: 11/08/2022]
Abstract
PURPOSE/OBJECTIVES Broken appointments are an important cause of waste in health care. Patients who fail to attend incur costs to providers, deny trainees learning opportunities, and impact their own health as well as that of other patients who are waiting for care. METHODS A total of 410,000 appointment records over 3 years were extracted from our electronic health record. We conducted exploratory data analysis and assessed correlations between appointment no-shows and other attributes of the appointment and the patient. The University of Michigan Medical School's Committee on Human Research reviewed the study and deemed that no Institutional Review Board oversight was necessary for this quality improvement project that was, retrospectively, turned into a study with previously de-identified data. RESULTS The patient's previous attendance record is the single most significant correlation with attendance. We found that patients who said they are "scared" of dental visits were 62% as likely to attend as someone reporting "no problem." Patients over 65 years of age have better attendance rates. There was a positive association between receiving email/text confirmation and attendance. A total of 94.9% of those emailed a reminder and 92.2% of those who were texted attended their appointment. CONCLUSION(S) We were able to identify relationships of several variables to failed and attended appointments that we were previously unknown to us. This knowledge enabled us to implement interventions to support better attendance at Dental Clinics at the University of Michigan, improving patient health, student training, and efficient use of resources.
Collapse
Affiliation(s)
- Kate Weber
- Health Infrastructures and Learning Health Sciences, University of Michigan, Ann Arbor, Michigan, USA
| | - Alexandre F DaSilva
- Dental, University of Michigan School of Dentistry, Ann Arbor, Michigan, USA
| | - Jean T Dault
- University of Michigan School of Dentistry, Ann Arbor, Michigan, USA
| | - Robert Eber
- Dental, University of Michigan School of Dentistry, Ann Arbor, Michigan, USA
| | - Kim Huner
- University of Michigan School of Dentistry, Ann Arbor, Michigan, USA
| | - Darlene Jones
- Dental Hygiene, University of Michigan School of Dentistry, Ann Arbor, Michigan, USA
| | - Kenneth Kornman
- Dental, University of Michigan School of Dentistry, Ann Arbor, Michigan, USA
| | - Vidya Ramaswamy
- Assessment, University of Michigan School of Dentistry, Ann Arbor, Michigan, USA
| | - Mark Snyder
- Vertically Integrated Clinic, University of Michigan School of Dentistry, Ann Arbor, Michigan, USA
| | - Brent B Ward
- Oral Maxillofacial Surgery, University of Michigan School of Dentistry, Ann Arbor, Michigan, USA
| | - Romesh P Nalliah
- Patient Services, University of Michigan School of Dentistry, Ann Arbor, Michigan, USA
| |
Collapse
|
4
|
Vaeggemose U, Blaehr EE, Thomsen AML, Burau V, Ankersen PV, Lou S. Fine for non-attendance in public hospitals in Denmark: A survey of non-attenders' reasons and attitudes. Int J Health Plann Manage 2020; 35:1055-1064. [PMID: 32323896 DOI: 10.1002/hpm.2980] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/10/2019] [Revised: 01/27/2020] [Accepted: 03/26/2020] [Indexed: 11/11/2022] Open
Abstract
OBJECTIVE To investigate non-attending patients' reasons for non-attendance and their general and specific attitudes towards a non-attendance fine. DATA SOURCES Non-attenders at two hospital departments participating in a trial of fine for non-attendance from May 2015 to January 2017. DESIGN A quantitative questionnaire study was conducted among non-attenders. DATA COLLECTION Non-attending patients in the intervention group were invited to complete the questionnaire. The response rate was 39% and the total number of respondents was 71 individuals. PRINCIPAL FINDINGS The main reason for non-attendance was technical challenges with the digital appointment and with cancelation. The main part of the respondents was generally positive towards a fine for non-attendance. However, approximately the half had a negative attitude towards the actual fine issued. CONCLUSIONS Technical challenges with appointments and cancelation should get special attention when addressing non-attendance. Danish non-attending patients are primarily positive towards the general principle of issuing a fine for non-attendance. However, a significant proportion of the generally positive, reported a negative specific attitude to the specific fine issued to them. This, however, did not affect their general attitude.
Collapse
Affiliation(s)
- Ulla Vaeggemose
- DEFACTUM - Public Health & Health Services Research, Central Denmark Region, Aarhus, Denmark.,Prehospital Emergency Medical Services, Central Denmark Region, Aarhus, Denmark
| | - Emely Ek Blaehr
- DEFACTUM - Public Health & Health Services Research, Central Denmark Region, Aarhus, Denmark
| | - Anne Marie L Thomsen
- DEFACTUM - Public Health & Health Services Research, Central Denmark Region, Aarhus, Denmark
| | - Viola Burau
- Department of Public Health, University of Aarhus, Aarhus, Denmark.,Department of Political Science, University of Aarhus, Aarhus, Denmark
| | - Pia Vedel Ankersen
- DEFACTUM - Public Health & Health Services Research, Central Denmark Region, Aarhus, Denmark
| | - Stina Lou
- DEFACTUM - Public Health & Health Services Research, Central Denmark Region, Aarhus, Denmark
| |
Collapse
|
5
|
Dantas LF, Hamacher S, Cyrino Oliveira FL, Barbosa SDJ, Viegas F. Predicting Patient No-show Behavior: a Study in a Bariatric Clinic. Obes Surg 2020; 29:40-47. [PMID: 30209668 DOI: 10.1007/s11695-018-3480-9] [Citation(s) in RCA: 17] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/20/2022]
Abstract
PURPOSE No-shows of patients to their scheduled appointments have a significant impact on healthcare systems, including lower clinical efficiency and higher costs. The purpose of this study was to investigate the factors associated with patient no-shows in a bariatric surgery clinic. MATERIALS AND METHODS We performed a retrospective study of 13,230 records for 2660 patients in a clinic located in Rio de Janeiro, Brazil, over a 17-month period (January 2015-May 2016). Logistic regression analyses were conducted to explore and model the influence of certain variables on no-show rates. This work also developed a predictive model stratified for each medical specialty. RESULTS The overall proportion of no-shows was 21.9%. According to multiple logistic regression, there is a significant association between the patient no-shows and eight variables examined. This association revealed a pattern in the increase of patient no-shows: appointment in the later hours of the day, appointments not in the summer months, post-surgery appointment, high lead time, higher no-show history, fewer numbers of previous appointments, home address 20 to 50 km away from the clinic, or scheduled for another specialty other than a bariatric surgeon. Age group, forms of payment, gender, and weekday were not significant predictors. Predictive models were developed with an accuracy of 71%. CONCLUSION Understanding the characteristics of patient no-shows allows making improvements in management practice, and the predictive models can be incorporated into the clinic dynamic scheduling system, allowing the use of a new appointment policy that takes into account each patient's no-show probability.
Collapse
Affiliation(s)
- Leila F Dantas
- Department of Industrial Engineering, Pontifical Catholic University of Rio de Janeiro, Rua Marquês de São Vicente, 225, Rio de Janeiro, RJ, 22451-900, Brazil
| | - Silvio Hamacher
- Department of Industrial Engineering, Pontifical Catholic University of Rio de Janeiro, Rua Marquês de São Vicente, 225, Rio de Janeiro, RJ, 22451-900, Brazil
| | - Fernando L Cyrino Oliveira
- Department of Industrial Engineering, Pontifical Catholic University of Rio de Janeiro, Rua Marquês de São Vicente, 225, Rio de Janeiro, RJ, 22451-900, Brazil
| | - Simone D J Barbosa
- Department of Informatics, Pontifical Catholic University of Rio de Janeiro, Rua Marquês de São Vicente, 225, Rio de Janeiro, RJ, 22451-900, Brazil
| | - Fábio Viegas
- Institute of Gastro and Obesity Surgery, Rua Paulo Barreto, 73, Rio de Janeiro, RJ, 22280-010, Brazil.
| |
Collapse
|
6
|
Millhiser WP, Veral EA. A decision support system for real-time scheduling of multiple patient classes in outpatient services. Health Care Manag Sci 2018; 22:180-195. [PMID: 29396748 DOI: 10.1007/s10729-018-9430-1] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2017] [Accepted: 01/09/2018] [Indexed: 11/29/2022]
Abstract
We propose a methodology to provide real-time assistance for outpatient scheduling involving multiple patient types. Schedulers are shown how each prospective placement in the appointment book would impact a day's operational performance for patients and providers. Rooted in prior literature and analytical findings, the information provided to schedulers about vacant slots is based on the probabilities that the calling patient, the already-existing appointments, and the session-end time will be unduly delayed. The information is updated in real-time before and after every new booking; calculations are driven by each patient type's historical consultation times and no-show data, and implemented via a simulation tool based on the underlying analytical methodology. Our findings lead to practical guidelines for dynamically constructing templates that provide allowances for different consultation durations, service time variability, no-show rates, and provider-driven performance targets for patient waiting and provider overtime. Extensions to healthcare batch scheduling applications such as radiology, surgery, or chemotherapy-where patient mixes may be known in advance-are suggested as future research opportunities since avoiding session overtime and procedures' completion time delays involve similar considerations.
Collapse
Affiliation(s)
- William P Millhiser
- Department of Management, Zicklin School of Business Baruch College, The City University of New York, One Bernard Baruch Way, Box B9-240, New York, NY, 10010, USA.
| | - Emre A Veral
- Department of Management, Zicklin School of Business Baruch College, The City University of New York, One Bernard Baruch Way, Box B9-240, New York, NY, 10010, USA
| |
Collapse
|