1
|
Chu J, Hsieh CH, Shih YN, Wu CC, Singaravelan A, Hung LP, Hsu JL. Operating Room Usage Time Estimation with Machine Learning Models. Healthcare (Basel) 2022; 10:healthcare10081518. [PMID: 36011177 PMCID: PMC9408683 DOI: 10.3390/healthcare10081518] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2022] [Revised: 08/07/2022] [Accepted: 08/10/2022] [Indexed: 11/16/2022] Open
Abstract
Effectively handling the limited number of surgery operating rooms equipped with expensive equipment is a challenging task for hospital management such as reducing the case-time duration and reducing idle time. Improving the efficiency of operating room usage via reducing the idle time with better scheduling would rely on accurate estimation of surgery duration. Our model can achieve a good prediction result on surgery duration with a dozen of features. We have found the result of our best performing department-specific XGBoost model with the values 31.6 min, 18.71 min, 0.71, 28% and 27% for the metrics of root-mean-square error (RMSE), mean absolute error (MAE), coefficient of determination (R2), mean absolute percentage error (MAPE) and proportion of estimated result within 10% variation, respectively. We have presented each department-specific result with our estimated results between 5 and 10 min deviation would be more informative to the users in the real application. Our study shows comparable performance with previous studies, and the machine learning methods use fewer features that are better suited for universal usability.
Collapse
Affiliation(s)
- Justin Chu
- Department of Computer Science and Information Engineering, Fu Jen Catholic University, New Taipei City 242062, Taiwan
| | - Chung-Ho Hsieh
- Department of General Surgery, Shin Kong Wu Ho Su Memorial Hospital, Taipei 111045, Taiwan
| | - Yi-Nuo Shih
- Department of Computer Science and Information Engineering, Fu Jen Catholic University, New Taipei City 242062, Taiwan
| | - Chia-Chun Wu
- Graduate Institute of Applied Science and Engineering, Fu Jen Catholic University, New Taipei City 242062, Taiwan
| | - Anandakumar Singaravelan
- Graduate Institute of Applied Science and Engineering, Fu Jen Catholic University, New Taipei City 242062, Taiwan
| | - Lun-Ping Hung
- National Taipei University of Nursing and Health Sciences, Taipei City 112, Taiwan
| | - Jia-Lien Hsu
- Department of Computer Science and Information Engineering, Fu Jen Catholic University, New Taipei City 242062, Taiwan
- Correspondence:
| |
Collapse
|
2
|
Dexter F, Epstein RH, Ledolter J, Pearson AC, Maga J, Fahy BG. Benchmarking Surgeons’ Gender and Year of Medical School Graduation Associated With Monthly Operative Workdays for Multispecialty Groups. Cureus 2022; 14:e25054. [PMID: 35719789 PMCID: PMC9200471 DOI: 10.7759/cureus.25054] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/16/2022] [Indexed: 11/09/2022] Open
Abstract
Background Female surgeons reportedly receive less surgical block time and fewer procedural referrals than male surgeons. In this study, we compared operative days between female and male surgeons throughout Florida. Our objective was to facilitate benchmarking by multispecialty groups, both the endpoint to use for statistically reliable results and expected differences. Methodology The historical cohort study included all 4,060,070 ambulatory procedural encounters and inpatient elective surgical states performed between January 2017 and December 2019 by 8,472 surgeons at 609 facilities. Surgeons’ gender, year of medical school graduation, and surgical specialty were obtained from their National Provider Identifiers. Results Female surgeons operated an average of 1.0 fewer days per month than matched male surgeons (99% confidence interval 0.8 to 1.2 fewer days, P < 0.0001). The mean differences were 0.8 to 1.4 fewer days per month among each of the five quintiles of years of graduation from medical school (all P ≤ 0.0050). Results were comparable when repeated using the number of monthly cases the surgeons performed. Conclusions An average difference of ≤1.4 days per month is a conservative estimate for the current status quo of the workload difference in Florida. Suppose that a group’s female surgeons average more than two fewer operative days per month than the group’s male surgeons of the same specialty. Such a large average difference would call for investigation of what might reflect systematic bias. While such a difference may reflect good flexibility of the organization, it may show a lack of responsiveness (e.g., fewer referrals of procedural patients to female surgeons or bias when apportioning allocated operating room time).
Collapse
|
3
|
Epstein RH, Dexter F, Diez C, Fahy BG. Similarities Between Pediatric and General Hospitals Based on Fundamental Attributes of Surgery Including Cases Per Surgeon Per Workday. Cureus 2022; 14:e21736. [PMID: 35251808 PMCID: PMC8887872 DOI: 10.7759/cureus.21736] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 01/30/2022] [Indexed: 11/30/2022] Open
Abstract
Introduction Operating room (OR) management decision-making at both pediatric and adult hospitals is determined, in large part, by the same fundamental attributes of surgery and other considerations related to case duration prediction. These include the non-preemptive nature of surgeries, wide prediction limits for case duration, and constraints to moving or resequencing cases on the day of surgery. Another attribute fundamentally affecting OR management is the median number of cases a surgeon performs on their OR days. Most adult surgeons have short lists of cases (i.e., one or two cases per day). Similarly, at adult hospitals, growth in caseloads is mostly due to the subset of those surgeons who also operate just once or twice per week. It is unknown if these characteristics of surgery apply to pediatric surgeons and pediatric hospitals as well. Methods Our retrospective cohort study included all elective surgical cases performed at the six pediatric hospitals in Florida during 2018 and 2019 (n = 71,340 cases). We calculated the percentages of combinations of surgeon, date, and hospital (lists) comprising one or two cases, or just one case, and determined if the values were statistically >50% (i.e., indicative of “most”). We determined if most of the growth in caseload and intraoperative work relative value units (wRVUs) at the pediatric hospitals between 2018 and 2019 accrued from low-caseload surgeons. Results are reported as mean ± standard error of the mean. Results Averaging among the six pediatric hospitals, the non-holiday weekday lists of most surgeons at each facility had just one or two elective cases, inpatient and/or ambulatory (68.1%; p = 0.016 vs. 50%, n = 27,557 lists). Growth in surgical caseloads from 2018 to 2019 was mostly attributable to surgeons who in 2018 averaged ≤2.0 cases per week (76.3% ± 5.4%, p = 0.0085 vs. 50%). Similarly, growth in wRVUs was mostly attributable to these low-caseload surgeons (73.8% ± 5.4%, p = 0.017 vs. 50%). Conclusions Like adult hospitals, most pediatric surgeons’ lists of cases consist of only one or two cases per day, with many lists containing a single case. Similarly, growth at pediatric hospitals accrued from low-caseload surgeons who performed one or two cases per week in the preceding year. These findings indicate that hospitals desiring to increase their surgical caseload should ensure that low-caseload surgeons are provided access to the OR schedule. Additionally, since percent-adjusted utilization and raw utilization cannot be accurately measured for low-caseload surgeons, neither metric should be used to allocate OR time to individual surgeons. Since most adult and pediatric surgeons have low caseloads, this is a fundamental attribute of surgery.
Collapse
Affiliation(s)
- Richard H Epstein
- Anesthesiology, University of Miami Miller School of Medicine, Miami, USA
| | | | - Christian Diez
- Anesthesiology, University of Miami Miller School of Medicine, Miami, USA
| | - Brenda G Fahy
- Anesthesiology, University of Florida, Gainesville, USA
| |
Collapse
|
4
|
Schoenfelder J, Kohl S, Glaser M, McRae S, Brunner JO, Koperna T. Simulation-based evaluation of operating room management policies. BMC Health Serv Res 2021; 21:271. [PMID: 33761931 PMCID: PMC7992985 DOI: 10.1186/s12913-021-06234-5] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2020] [Accepted: 03/02/2021] [Indexed: 11/25/2022] Open
Abstract
Background Since operating rooms are a major bottleneck resource and an important revenue driver in hospitals, it is important to use these resources efficiently. Studies estimate that between 60 and 70% of hospital admissions are due to surgeries. Furthermore, staffing cannot be changed daily to respond to changing demands. The resulting high complexity in operating room management necessitates perpetual process evaluation and the use of decision support tools. In this study, we evaluate several management policies and their consequences for the operating theater of the University Hospital Augsburg. Methods Based on a data set with 12,946 surgeries, we evaluate management policies such as parallel induction of anesthesia with varying levels of staff support, the use of a dedicated emergency room, extending operating room hours reserved as buffer capacity, and different elective patient sequencing policies. We develop a detailed simulation model that serves to capture the process flow in the entire operating theater: scheduling surgeries from a dynamically managed waiting list, handling various types of schedule disruptions, rescheduling and prioritizing postponed and deferred surgeries, and reallocating operating room capacity. The system performance is measured by indicators such as patient waiting time, idle time, staff overtime, and the number of deferred surgeries. Results We identify significant trade-offs between expected waiting times for different patient urgency categories when operating rooms are opened longer to serve as end-of-day buffers. The introduction of parallel induction of anesthesia allows for additional patients to be scheduled and operated on during regular hours. However, this comes with a higher number of expected deferrals, which can be partially mitigated by employing additional anesthesia teams. Changes to the sequencing of elective patients according to their expected surgery duration cause expectable outcomes for a multitude of performance indicators. Conclusions Our simulation-based approach allows operating theater managers to test a multitude of potential changes in operating room management without disrupting the ongoing workflow. The close collaboration between management and researchers in the design of the simulation framework and the data analysis has yielded immediate benefits for the scheduling policies and data collection efforts at our practice partner. Supplementary Information The online version contains supplementary material available at 10.1186/s12913-021-06234-5.
Collapse
Affiliation(s)
- Jan Schoenfelder
- Chair of Health Care Operations/Health Information Management, Faculty of Business and Economics, University of Augsburg, Universitätsstraße 16, 86159, Augsburg, Germany. .,University Center of Health Sciences at Klinikum Augsburg (UNIKA-T), Neusässer Straße 47, 86156, Augsburg, Germany.
| | - Sebastian Kohl
- Chair of Health Care Operations/Health Information Management, Faculty of Business and Economics, University of Augsburg, Universitätsstraße 16, 86159, Augsburg, Germany.,University Center of Health Sciences at Klinikum Augsburg (UNIKA-T), Neusässer Straße 47, 86156, Augsburg, Germany
| | - Manuel Glaser
- Chair of Health Care Operations/Health Information Management, Faculty of Business and Economics, University of Augsburg, Universitätsstraße 16, 86159, Augsburg, Germany.,University Center of Health Sciences at Klinikum Augsburg (UNIKA-T), Neusässer Straße 47, 86156, Augsburg, Germany
| | - Sebastian McRae
- Chair of Health Care Operations/Health Information Management, Faculty of Business and Economics, University of Augsburg, Universitätsstraße 16, 86159, Augsburg, Germany.,University Center of Health Sciences at Klinikum Augsburg (UNIKA-T), Neusässer Straße 47, 86156, Augsburg, Germany
| | - Jens O Brunner
- Chair of Health Care Operations/Health Information Management, Faculty of Business and Economics, University of Augsburg, Universitätsstraße 16, 86159, Augsburg, Germany.,University Center of Health Sciences at Klinikum Augsburg (UNIKA-T), Neusässer Straße 47, 86156, Augsburg, Germany
| | - Thomas Koperna
- Associate Professor of Surgery, Head OR-Management, University Hospital Augsburg, Stenglinstraße 2, 86156, Augsburg, Germany
| |
Collapse
|
5
|
Wang Z, Dexter F, Zenios SA. Caseload is increased by resequencing cases before and on the day of surgery at ambulatory surgery centers where initial patient recovery is in operating rooms and cleanup times are longer than typical. J Clin Anesth 2020; 67:110024. [PMID: 32805684 PMCID: PMC7418695 DOI: 10.1016/j.jclinane.2020.110024] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2020] [Revised: 08/03/2020] [Accepted: 08/07/2020] [Indexed: 12/12/2022]
Abstract
Study objective The coronavirus disease 2019 (COVID-19) pandemic impacts operating room (OR) management in regions with high prevalence (e.g., >1.0% of asymptomatic patients testing positive). Cases with aerosol producing procedures are isolated to a few ORs, initial phase I recovery of those patients is in the ORs, and multimodal environmental decontamination applied. We quantified the potential increase in productivity from also resequencing these cases among those 2 or 3 ORs. Design Computer simulation provided sample sizes requiring >100 years experimentally. Resequencing was limited to changes in the start times of surgeons' lists of cases. Setting Ambulatory surgery center or hospital outpatient department. Main results With case resequencing applied before and on the day of surgery, there were 5.6% and 5.5% more cases per OR per day for the 2 ORs and 3 ORs, respectively, both standard errors (SE) < 0.1%. Resequencing cases among ORs to start cases earlier permitted increases in the hours into which cases could be scheduled from 10.5 to 11.0 h, while assuring >90% probability of each OR finishing within the prespecified 12-h shift. Thus, the additional cases were all scheduled before the day of surgery. The greater allocated time also resulted in less overutilized time, a mean of 4.2 min per OR per day for 2 ORs (SE 0.5) and 6.3 min per OR per day for 3 ORs (SE 0.4). The benefit could be achieved while limiting application of resequencing to days when the OR with the fewest estimated hours of cases has ≤8 h. Conclusions Some ambulatory surgery ORs have unusually long OR times and/or room cleanup times (e.g., infection control efforts because of the pandemic). Resequencing cases before and on the day of surgery should be considered, because moving 1 or 2 cases occasionally has little to no cost with substantive benefit. COVID-19 influences management for aerosol producing procedures. Simulation studied case resequencing applied before and on the day of surgery. >5% more queued cases can be done per OR per day with practical heuristic.
Collapse
Affiliation(s)
- Zhengli Wang
- Stanford Graduate School of Business, United States of America
| | | | | |
Collapse
|
6
|
Eun J, Tiwari V, Sandberg WS. Predicting Daily Surgical Volumes Using Probabilistic Estimates of Providers’ Future Availability. DECISION SCIENCES 2020. [DOI: 10.1111/deci.12478] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
Affiliation(s)
- Joonyup Eun
- Graduate School of Management of TechnologyKorea University Seoul 02841 South Korea
| | - Vikram Tiwari
- Departments of Anesthesiology, Biomedical Informatics, and Biostatistics, School of MedicineVanderbilt University Medical Center Nashville TN 37212 USA
- Owen Graduate School of ManagementVanderbilt University Nashville TN 37212 USA
| | - Warren S. Sandberg
- Departments of Anesthesiology, Surgery, and Biomedical Informatics, School of MedicineVanderbilt University Medical Center Nashville TN 37212 USA
| |
Collapse
|
7
|
Dexter F, Ledolter J, Wall RT, Datta S, Loftus RW. Sample sizes for surveillance of S. aureus transmission to monitor effectiveness and provide feedback on intraoperative infection control including for COVID-19. ACTA ACUST UNITED AC 2020; 20:100115. [PMID: 32501426 PMCID: PMC7240254 DOI: 10.1016/j.pcorm.2020.100115] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2020] [Revised: 05/12/2020] [Accepted: 05/17/2020] [Indexed: 12/19/2022]
Abstract
Reductions in perioperative surgical site infections are obtained by a multifaceted approach including patient decolonization, hand hygiene, and hub disinfection, and environmental cleaning. Associated surveillance of S. aureus transmission quantifies the effectiveness of the basic measures to prevent the transmission to patients and clinicians of pathogenic bacteria and viruses, including Coronavirus Disease 2019 (COVID-19). To measure transmission, the observational units are pairs of successive surgical cases in the same operating room on the same day. We evaluated appropriate sample sizes and strategies for measuring transmission. There was absence of serial correlation among observed counts of transmitted isolates within each of several periods (all P ≥.18). Similarly, observing transmission within or between cases of a pair did not increase the probability that the next sampled pair of cases also had observed transmission (all P ≥.23). Most pairs of cases had no detected transmitted isolates. Also, although transmission (yes/no) was associated with surgical site infection (P =.004), among cases with transmission, there was no detected dose response between counts of transmitted isolates and probability of infection (P =.25). The first of a fixed series of tests is to use the binomial test to compare the proportion of pairs of cases with S. aureus transmission to an acceptable threshold. An appropriate sample size for this screening is N =25 pairs. If significant, more samples are obtained while additional measures are implemented to reduce transmission and infections. Subsequent sampling is done to evaluate effectiveness. The two independent binomial proportions are compared using Boschloo's exact test. The total sample size for the 1st and 2nd stage is N =100 pairs. Because S. aureus transmission is invisible without testing, when choosing what population(s) to screen for surveillance, another endpoint needs to be used (e.g., infections). Only 10/298 combinations of specialty and operating room were relatively common (≥1.0% of cases) and had expected incidence ≥0.20 infections per 8 hours of sampled cases. The 10 combinations encompassed ≅17% of cases, showing the value of targeting surveillance of transmission to a few combinations of specialties and rooms. In conclusion, we created a sampling protocol and appropriate sample sizes for using S. aureus transmission within and between pairs of successive cases in the same operating room, the purpose being to monitor the quality of prevention of intraoperative spread of pathogenic bacteria and viruses.
Collapse
|
8
|
Ali HH, Lamsali H, Othman SN. Operating Rooms Scheduling for Elective Surgeries in a Hospital Affected by War-Related Incidents. J Med Syst 2019; 43:139. [PMID: 30972511 DOI: 10.1007/s10916-019-1263-z] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2018] [Accepted: 03/27/2019] [Indexed: 10/27/2022]
Abstract
Hospital scheduling presents huge challenges for the healthcare industry. Various studies have been conducted in many different countries with focus on both elective and non-elective surgeries. There are important variables and factors that need to be taken into considerations. Different methods and approaches have also been used to examine hospital scheduling. Notwithstanding the continuous changes in modern healthcare services and, in particular, hospital operations, consistent reviews and further studies are still required. The importance of hospital scheduling, particularly, has become more critical as the trade-off between limited resources and overwhelming demand is becoming more evident. This situation is even more pressing in a volatile country where shootings and bombings in public areas happened. Hospital scheduling for elective surgeries in volatile country such as Iraq is therefore often interrupted by non-elective surgeries due to war-related incidents. Hence, this paper intends to address this issue by proposing a hospital scheduling model with focus on neuro-surgery department. The aim of the model is to maximize utilization of operating room while concurrently minimizing idle time of surgery. The study focused on neurosurgery department in Al-Shahid Ghazi Al-Hariri hospital in Baghdad, Iraq. In doing so, a Mixed-integer linear programming (MILP) model is formulated where interruptions of non-elective surgery are incorporated into the main elective surgery based model. Computational experiment is then carried out to test the model. The result indicates that the model is feasible and can be solved in reasonable times. Nonetheless, its feasibility is further tested as the problems size and the computation times is getting bigger and longer. Application of heuristic methods is the way forward to ensure better practicality of the proposed model. In the end, the potential benefit of this study and the proposed model is discussed.
Collapse
Affiliation(s)
- Hussein Hasan Ali
- Business Administration Department, Middle Technical University Baghdad, Baghdad, Iraq. .,School of Technology Management and Logistics UUM, Kedah, Malaysia.
| | - Hendrik Lamsali
- School of Technology Management and Logistics UUM, Kedah, Malaysia
| | | |
Collapse
|
9
|
A Machine Learning Approach to Predicting Case Duration for Robot-Assisted Surgery. J Med Syst 2019; 43:32. [PMID: 30612192 DOI: 10.1007/s10916-018-1151-y] [Citation(s) in RCA: 34] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2018] [Accepted: 12/25/2018] [Indexed: 01/22/2023]
Abstract
Robot-assisted surgery (RAS) requires a large capital investment by healthcare organizations. The cost of a robotic unit is fixed, so institutions must maximize use of each unit by utilizing all available operating room block time. One way to increase utilization is to accurately predict case durations. In this study, we sought to use machine learning to develop an accurate predictive model for RAS case duration. We analyzed a random sample of robotic cases at our institution from January 2014 to June 2017. We compared the machine learning models to the baseline model, which is the scheduled case duration (determined by previous case duration averages and surgeon adjustments). Specifically, we used: 1) multivariable linear regression, 2) ridge regression, 3) lasso regression, 4) random forest, 5) boosted regression tree, and 6) neural network. We found that all machine learning models decreased the average root-mean-squared error (RMSE) as compared to the baseline model. The average RMSE was lowest with the boosted regression tree (80.2 min, 95% CI 74.0-86.4), which was significantly lower than the baseline model (100.4 min, 95% CI 90.5-110.3). Using boosted regression tree, we can increase the number of accurately booked cases from 148 to 219 (34.9% to 51.7%, p < 0.001). This study shows that using various machine learning approaches can improve the accuracy of RAS case length predictions, which will increase utilization of this limited resource. Further work is needed to operationalize these findings.
Collapse
|
10
|
Theoretical bounds and approximation of the probability mass function of future hospital bed demand. Health Care Manag Sci 2018; 23:20-33. [PMID: 30397818 PMCID: PMC7223092 DOI: 10.1007/s10729-018-9461-7] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2018] [Accepted: 10/19/2018] [Indexed: 11/25/2022]
Abstract
Failing to match the supply of resources to the demand for resources in a hospital can cause non-clinical transfers, diversions, safety risks, and expensive under-utilized resource capacity. Forecasting bed demand helps achieve appropriate safety standards and cost management by proactively adjusting staffing levels and patient flow protocols. This paper defines the theoretical bounds on optimal bed demand prediction accuracy and develops a flexible statistical model to approximate the probability mass function of future bed demand. A case study validates the model using blinded data from a mid-sized Massachusetts community hospital. This approach expands upon similar work by forecasting multiple days in advance instead of a single day, providing a probability mass function of demand instead of a point estimate, using the exact surgery schedule instead of assuming a cyclic schedule, and using patient-level duration-varying length-of-stay distributions instead of assuming patient homogeneity and exponential length of stay distributions. The primary results of this work are an accurate and lengthy forecast, which provides managers better information and more time to optimize short-term staffing adaptations to stochastic bed demand, and a derivation of the minimum mean absolute error of an ideal forecast.
Collapse
|
11
|
Sauer BG, Singh KP, Wagner BL, Vanden Hoek MS, Twilley K, Cohn SM, Shami VM, Wang AY. Efficiency of endoscopy units can be improved with use of discrete event simulation modeling. Endosc Int Open 2016; 4:E1140-E1145. [PMID: 27853739 PMCID: PMC5110334 DOI: 10.1055/s-0042-117217] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/30/2016] [Accepted: 08/22/2016] [Indexed: 11/29/2022] Open
Abstract
Background and study aims: The projected increased demand for health services obligates healthcare organizations to operate efficiently. Discrete event simulation (DES) is a modeling method that allows for optimization of systems through virtual testing of different configurations before implementation. The objective of this study was to identify strategies to improve the daily efficiencies of an endoscopy center with the use of DES. Methods: We built a DES model of a five procedure room endoscopy unit at a tertiary-care university medical center. After validating the baseline model, we tested alternate configurations to run the endoscopy suite and evaluated outcomes associated with each change. The main outcome measures included adequate number of preparation and recovery rooms, blocked inflow, delay times, blocked outflows, and patient cycle time. Results: Based on a sensitivity analysis, the adequate number of preparation rooms is eight and recovery rooms is nine for a five procedure room unit (total 3.4 preparation and recovery rooms per procedure room). Simple changes to procedure scheduling and patient arrival times led to a modest improvement in efficiency. Increasing the preparation/recovery rooms based on the sensitivity analysis led to significant improvements in efficiency. Conclusions: By applying tools such as DES, we can model changes in an environment with complex interactions and find ways to improve the medical care we provide. DES is applicable to any endoscopy unit and would be particularly valuable to those who are trying to improve on the efficiency of care and patient experience.
Collapse
Affiliation(s)
- Bryan G. Sauer
- Division of Gastroenterology and Hepatology, University of Virginia, Charlottesville, VA, USA
| | - Kanwar P. Singh
- University of Virginia Health System, Charlottesville, VA, USA
| | - Barry L. Wagner
- University of Virginia Health System, Charlottesville, VA, USA
| | - Matthew S. Vanden Hoek
- Division of Gastroenterology and Hepatology, University of Virginia, Charlottesville, VA, USA
| | | | - Steven M. Cohn
- Division of Gastroenterology and Hepatology, University of Virginia, Charlottesville, VA, USA
| | - Vanessa M. Shami
- Division of Gastroenterology and Hepatology, University of Virginia, Charlottesville, VA, USA
| | - Andrew Y. Wang
- Division of Gastroenterology and Hepatology, University of Virginia, Charlottesville, VA, USA
| |
Collapse
|
12
|
Huang YL, Bach SM. Appointment Lead Time Policy Development to Improve Patient Access to Care. Appl Clin Inform 2016; 7:954-968. [PMID: 27757471 DOI: 10.4338/aci-2016-03-ra-0044] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2016] [Accepted: 09/10/2016] [Indexed: 11/23/2022] Open
Abstract
BACKGROUND Patient access to care has been a known and continuing struggle for many health care providers. In spite of appointment lead time policies set by government or clinics, the problem persists. Justification for how lead time policies are determined is lacking. OBJECTIVES This paper proposed a data-driven approach for how to best set feasible appointment target lead times given a clinic's capacity and appointment requests. METHODS The proposed approach reallocates patient visits to minimize the deviation between actual appointment lead time and a feasible target lead time. A step-by-step algorithm was presented and demonstrated for return visit (RV) and new patient (NP) types from a Pediatric clinic excluding planned visits such as well-child exam and the same day urgent appointments. The steps are: 1. Obtain appointment requests; 2. Initialize a target lead time; 3. Set up an initial schedule; 4. Check the feasibility based on appointment availability; 5. Adjust schedule backward to fill appointment slots earlier than the target; 6. Adjust schedule forward for appointments not able to be scheduled earlier or on target to the later slots; 7. Trial different target lead times until the difference between earlier and later lead time is minimized. RESULTS The results indicated a 59% lead time reduction for RVs and a 45% reduction for NPs. The lead time variation was reduced by 75% for both patient types. Additionally, the opportunity for the participating clinic to achieve their organization's goal of a two-week lead time for RVs and a two-day lead time for NPs is discussed by adjusting capacity to increase one slot for NP and reduce one slot for RV. CONCLUSIONS The proposed approach and study findings may help clinics identify feasible appointment lead times.
Collapse
Affiliation(s)
- Yu-Li Huang
- Dr. Yu-Li Huang, Mayo Clinic, College of Medicine, Rochester, Minnesota, United States,
| | | |
Collapse
|
13
|
Elective change of surgeon during the OR day has an operationally negligible impact on turnover time. J Clin Anesth 2014; 26:343-9. [PMID: 25074630 DOI: 10.1016/j.jclinane.2014.02.008] [Citation(s) in RCA: 33] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2013] [Revised: 02/28/2014] [Accepted: 02/28/2014] [Indexed: 11/22/2022]
Abstract
STUDY OBJECTIVE To compare turnover times for a series of elective cases with surgeons following themselves with turnover times for a series of previously scheduled elective procedures for which the succeeding surgeon differed from the preceding surgeon. DESIGN Retrospective cohort study. SETTING University-affiliated teaching hospital. MEASUREMENTS The operating room (OR) statistical database was accessed to gather 32 months of turnover data from a large academic institution. Turnover time data for the same-surgeon and surgeon-swap groups were batched by month to minimize autocorrelation and achieve data normalization. Two-way analysis of variance (ANOVA) using the monthly batched data was performed with surgeon swapping and changes in procedure category as variables of turnover time. Similar analyses were performed using individual surgical services, hourly time intervals during the surgical day, and turnover frequency per OR as additional covariates to surgeon swapping. MAIN RESULTS The mean (95% confidence interval [CI]) same-surgeon turnover time was 43.6 (43.2 - 44.0) minutes versus 51.0 (50.5 - 51.6) minutes for a planned surgeon swap (P < 0.0001). This resulted in a difference (95% CI) of 7.4 (6.8 - 8.1) minutes. The exact increase in turnover time was dependent on surgical service, change in subsequent procedure type, time of day when the turnover occurred, and turnover frequency. CONCLUSIONS The investigated institution averages 2.5 cases per OR per day. The cumulative additional turnover time (far less than one hour per OR per day) for switching surgeons definitely does not allow the addition of another elective procedure if the difference could be eliminated. A flexible scheduling policy allowing surgeon swapping rather than requiring full blocks incurs minimal additional staffed time during the OR day while allowing the schedule to be filled with available elective cases.
Collapse
|
14
|
Azari-Rad S, Yontef AL, Aleman DM, Urbach DR. Reducing elective general surgery cancellations at a Canadian hospital. Can J Surg 2013; 56:113-8. [PMID: 23351498 DOI: 10.1503/cjs.018411] [Citation(s) in RCA: 24] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/01/2022] Open
Abstract
BACKGROUND In Canadian hospitals, which are typically financed by global annual budgets, overuse of operating rooms is a financial risk that is frequently managed by cancelling elective surgical procedures. It is uncertain how different scheduling rules affect the rate of elective surgery cancellations. METHODS We used discrete event simulation modelling to represent perioperative processes at a hospital in Toronto, Canada. We tested the effects of the following 3 scenarios on the number of surgical cancellations: scheduling surgeons' operating days based on their patients' average length of stay in hospital, sequencing surgical procedures by average duration and variance, and increasing the number of postsurgical ward beds. RESULTS The number of elective cancellations was reduced by scheduling surgeons whose patients had shorter average lengths of stay in hospital earlier in the week, sequencing shorter surgeries and those with less variance in duration earlier in the day, and by adding up to 2 additional beds to the postsurgical ward. CONCLUSION Discrete event simulation modelling can be used to develop strategies for improving efficiency in operating rooms.
Collapse
Affiliation(s)
- Solmaz Azari-Rad
- The Department of Mechanical and Industrial Engineering, University of Toronto, Toronto, Ont
| | | | | | | |
Collapse
|
15
|
Berg BP, Murr M, Chermak D, Woodall J, Pignone M, Sandler RS, Denton BT. Estimating the cost of no-shows and evaluating the effects of mitigation strategies. Med Decis Making 2013; 33:976-85. [PMID: 23515215 DOI: 10.1177/0272989x13478194] [Citation(s) in RCA: 62] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/25/2022]
Abstract
OBJECTIVE To measure the cost of nonattendance ("no-shows") and benefit of overbooking and interventions to reduce no-shows for an outpatient endoscopy suite. METHODS We used a discrete-event simulation model to determine improved overbooking scheduling policies and examine the effect of no-shows on procedure utilization and expected net gain, defined as the difference in expected revenue based on Centers for Medicare & Medicaid Services reimbursement rates and variable costs based on the sum of patient waiting time and provider and staff overtime. No-show rates were estimated from historical attendance (18% on average, with a sensitivity range of 12%-24%). We then evaluated the effectiveness of scheduling additional patients and the effect of no-show reduction interventions on the expected net gain. RESULTS The base schedule booked 24 patients per day. The daily expected net gain with perfect attendance is $4433.32. The daily loss attributed to the base case no-show rate of 18% is $725.42 (16.4% of net gain), ranging from $472.14 to $1019.29 (10.7%-23.0% of net gain). Implementing no-show interventions reduced net loss by $166.61 to $463.09 (3.8%-10.5% of net gain). The overbooking policy of 9 additional patients per day resulted in no loss in expected net gain when compared with the reference scenario. CONCLUSIONS No-shows can significantly decrease the expected net gain of outpatient procedure centers. Overbooking can help mitigate the impact of no-shows on a suite's expected net gain and has a lower expected cost of implementation to the provider than intervention strategies.
Collapse
Affiliation(s)
- Bjorn P Berg
- Department of Systems Engineering & Operations Research, George Mason University, Fairfax, Virginia (BPB)
| | - Michael Murr
- Edward P. Fitts Department of Industrial & Systems Engineering, North Carolina State University, Raleigh, North Carolina (MM)
| | - David Chermak
- Performance Services, Duke University Medical Center, Durham, North Carolina (DC, JW)
| | - Jonathan Woodall
- Performance Services, Duke University Medical Center, Durham, North Carolina (DC, JW)
| | - Michael Pignone
- Division of General Medicine and Clinical Epidemiology (MP) University of North Carolina, Chapel Hil
| | - Robert S Sandler
- Division of Gastroenterology and Hepatology (RSS), University of North Carolina, Chapel Hil
| | - Brian T Denton
- Department of Industrial & Operations Engineering, University of Michigan, Ann Arbor (BTD)
| |
Collapse
|
16
|
Guerriero F, Guido R. Operational research in the management of the operating theatre: a survey. Health Care Manag Sci 2010; 14:89-114. [PMID: 21103939 DOI: 10.1007/s10729-010-9143-6] [Citation(s) in RCA: 323] [Impact Index Per Article: 23.1] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2010] [Accepted: 11/03/2010] [Indexed: 11/28/2022]
Affiliation(s)
- Francesca Guerriero
- Laboratory of Decisions Engineering for Health Care Delivery, Department of Electronics, Computer Science and Systems, University of Calabria, Calabria, Italy.
| | | |
Collapse
|
17
|
Dexter F, O'Neill L. Previous research in operating room scheduling and staffing. Health Care Manag Sci 2010; 13:280. [PMID: 20715310 DOI: 10.1007/s10729-010-9130-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/01/2022]
|
18
|
Pandit JJ, Pandit M, Reynard JM. Understanding waiting lists as the matching of surgical capacity to demand: are we wasting enough surgical time? Anaesthesia 2010; 65:625-640. [PMID: 20565395 DOI: 10.1111/j.1365-2044.2010.06278.x] [Citation(s) in RCA: 32] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
Abstract
If surgical 'capacity' always matched or exceeded 'demand' then there should be no waiting lists for surgery. However, understanding what is meant by 'demand', 'capacity' and 'matched' requires some mathematical concepts that we outline in this paper. 'Time' is the relevant measure: 'demand' for a surgical team is best understood as the total min required for the surgery booked from outpatient clinics every week; and 'capacity' is the weekly operating time available. We explain how the variation in demand (not just the mean demand) influences the analysis of optimum capacity. However, any capacity chosen in this way is associated with only a likelihood (that is, a probability rather than certainty) of absorbing the prevailing demand. A capacity that suitably absorbs the demand most of the time (for example, > 80% of weeks) will inevitably also involve considerable waste (that is, many weeks in which there is spare, unused capacity). Conversely, a level of capacity chosen to minimise wasted time will inevitably cause an increase in size of the waiting list. Thus the question of how to balance demand and capacity is intimately related to the question of how to balance utilisation and waste. These mathematical considerations enable us to consider objectively how to manage the waiting list. They also enable us critically to analyse the extent to which philosophies adopted by the National Health Service (such as 'Lean' or 'Six Sigma') will be successful in matching surgical capacity to demand.
Collapse
Affiliation(s)
- J J Pandit
- Nuffield Department of Anaesthetics, John Radcliffe Hospital, Oxford, UK.
| | | | | |
Collapse
|
19
|
Macario A. The limitations of using operating room utilisation to allocate surgeons more or less surgical block time in the USA. Anaesthesia 2010; 65:548-552. [DOI: 10.1111/j.1365-2044.2010.06374.x] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
20
|
van Sambeek J, Cornelissen F, Bakker P, Krabbendam J. Models as instruments for optimizing hospital processes: a systematic review. Int J Health Care Qual Assur 2010; 23:356-77. [DOI: 10.1108/09526861011037434] [Citation(s) in RCA: 31] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
|
21
|
Hunziker S, Baumgart A, Denz C, Schüpfer G. [Economic benefits of overlapping induction: investigation using a computer simulation model]. Anaesthesist 2009; 58:623-32. [PMID: 19562399 DOI: 10.1007/s00101-009-1551-y] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
Abstract
The aim of this study was to investigate the potential economic benefit of overlapping anaesthesia induction given that all patient diagnosis-related groups (AP DRG) are used as the model for hospital reimbursement. A computer simulation model was used for this purpose. Due to the resource-intensive production process, the operating room (OR) environment is the most expensive part of the supply chain for surgical disciplines. The economical benefit of a parallel production process (additional personnel, adaptation of the process) as compared to a conventional serial layout was assessed. A computer-based simulation method was used with commercially available simulation software. Assumptions for revenues were made by reimbursement based on AP DRG. Based on a system analysis a model for the computer simulation was designed on a step-by-step abstraction process. In the model two operating rooms were used for parallel processing and two operating rooms for a serial production process. Six different types of surgical procedures based on historical case durations were investigated. The contribution margin was calculated based on the increased revenues minus the cost for the additional anaesthesia personnel. Over a period of 5 weeks 41 additional surgical cases were operated under the assumption of duration of surgery of 89+/-4 min (mean+/-SD). The additional contribution margin was CHF 104,588. In the case of longer surgical procedures with 103+/-25 min duration (mean+/-SD), an increase of 36 cases was possible in the same time period and the contribution margin was increased by CHF 384,836. When surgical cases with a mean procedural time of 243+/-55 min were simulated, 15 additional cases were possible. Therefore, the additional contribution margin was CHF 321,278. Although costs increased in this simulation when a serial production process was changed to a parallel system layout due to more personnel, an increase of the contribution margin was possible, especially with procedures of shorter duration (<120 min). For longer surgical times, the additional costs for the workforce result in a reduced contribution margin depending on the models chosen to handle overtime of the technical OR personnel. Important advantages of this approach for simulation are the use of the historical production data and the reflection of the specificities of the local situation. Computer simulation is an ideal tool to support operation room management, particularly regarding the planning of resource allocation and the coordination of workflow.
Collapse
Affiliation(s)
- S Hunziker
- Medizinischer Stab, Luzerner Kantonsspital, 6000, Luzern, Schweiz.
| | | | | | | |
Collapse
|
22
|
The anesthesia information management system for electronic documentation: what are we waiting for? J Anesth 2008; 22:404-11. [DOI: 10.1007/s00540-008-0643-1] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2007] [Accepted: 05/01/2008] [Indexed: 11/26/2022]
|
23
|
Lamiri M, Xie X, Zhang S. Column generation approach to operating theater planning with elective and emergency patients. ACTA ACUST UNITED AC 2008. [DOI: 10.1080/07408170802165831] [Citation(s) in RCA: 51] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
|
24
|
|
25
|
Schuster M, Wicha LL, Fiege M. [Key performance indicators of OR efficiency. Myths and evidence of key performance indicators in OR management]. Anaesthesist 2007; 56:259-71. [PMID: 17333035 DOI: 10.1007/s00101-006-1126-0] [Citation(s) in RCA: 14] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
Abstract
A variety of different key performance indicators, both for process and financial performance, are used to evaluate OR efficiency. Certain indicators like OR utilization and turnover times seem to become common standard in many hospitals to evaluate OR process performance. Despite the general use and availability of these indicators in OR management, the scientific evidence behind these data is relatively low. These process indicators are strongly influenced by artefacts and depend on planning process, resource allocation and documentation. Direct financial indicators become more important with increasing autonomy of OR management. Besides budgetary compliance the focus is set on the net results of internal transfer pricing systems. By taking part in an internal transfer pricing system, OR management develops from a mere passive cost center to an active shaper of perioperative processes. However, detailed knowledge of the origin of costs and pitfalls of internal transfer pricing systems is crucial. The increased transparency due to the free accessibility of diagnosis-related-groups (DRG) cost breakdown data can help to develop tools for economic analysis of OR efficiency.
Collapse
Affiliation(s)
- M Schuster
- Klinik und Poliklinik für Anästhesiologie, Universitätsklinikum Hamburg-Eppendorf , Martinistrasse 52, 20246 Hamburg, Deutschland.
| | | | | |
Collapse
|
26
|
Lehtonen J, Kujala J, Kouri J, Hippeläinen M. Cardiac surgery productivity and throughput improvements. Int J Health Care Qual Assur 2007; 20:40-52. [DOI: 10.1108/09526860710721213] [Citation(s) in RCA: 22] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
|
27
|
Abstract
This paper analyzes the impact of sequencing rules on the phase I post anesthesia care unit (PACU) staffing and over-utilized operating room (OR) time resulting from delays in PACU admission. The sequencing rules are applied to each surgeon's list of cases independently. Discrete event simulation shows the importance of having a sufficient number of PACU nurses. Sequencing rules have a large impact on the maximum number of patients receiving care in the PACU (i.e., peak of activity). Seven sequencing rules are tested, over a wide range of scenarios. The largest effect of sequencing was on the percentage of days with at least one delay in PACU admission. The best rules are those that smooth the flow of patients entering in the PACU (HIHD (Half Increase in OR time and Half Decrease in OR time) and MIX (MIX OR time)). We advise against using the LCF (Longest Cases First) and equivalent sequencing methods. They generate more over-utilized OR time, require more PACU nurses during the workday, and result in more days with at least one delay in PACU admission.
Collapse
Affiliation(s)
- Eric Marcon
- Laboratory of Signal and Manufacturing Systems Analysis, Department Manufacturing System Management and Maintenance, Jean Monnet University of Saint Etienne, France.
| | | |
Collapse
|
28
|
Moser B, von Goedecke A, Chemelli A, Keller C, Voelckel W, Lindner KH, Wenzel V. [Analgesia with remifentanil in spontaneously breathing patients undergoing brief but painful radiological procedures]. Anaesthesist 2006; 54:1089-93. [PMID: 16044232 DOI: 10.1007/s00101-005-0899-x] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
Abstract
INTRODUCTION Percutaneous transhepatic biliary drainage (PTBD) and stenting are very painful procedures in interventional radiology and require potent analgesia; employing remifentanil in spontaneously breathing patients may be one possible strategy. PATIENTS AND METHODS The study group was composed of 18 men and 2 women with a mean age of 63+/-10 (mean+/-SD) years. Pain intensity was measured with a VAS score before the procedure, after local anesthesia on the rib cage, after stenting and after the radiology procedure. RESULTS Remifentanil infusion (dosage: 0.12-0.30 microg/kg body weight/min) was infused throughout the entire radiology procedure according to physical status, past medical history, individual pain, and clinical assessment. During insufflation of 10l O(2)/min via a venturi mask, oxygen saturation did not fall below 96% at any time-point during the procedure. In the VAS score, we noted a decrease after starting the remifentanil infusion towards the end of procedure. All patients were able to move into bed without help. Postoperatively, no analgesics and no antiemetics were needed. CONCLUSIONS Employing a remifentanil infusion for brief interventional radiology procedures in palliative treatment of patients resulted in high patient and radiologist comfort.
Collapse
Affiliation(s)
- B Moser
- Univ.-Klinik für Anästhesie und Allgemeine Intensivmedizin, Medizinische Universität, Innsbruck, Osterreich.
| | | | | | | | | | | | | |
Collapse
|
29
|
Abstract
Keeping the OR scheduled to satisfy all the various constituents is a complex dynamic process. The health care environment needs to be carefully analyzed to ensure that the services the OR offers are appropriate. OR utilization is not simply ensuring that the greatest number of cases are done. The cost of doing these cases must be considered and, in order to do so, compromises must be made. Creating information systems that track all aspects of utilization, including costs and revenues, will be vital for the future management of operating rooms.
Collapse
Affiliation(s)
- J Viapiano
- Department of Anesthesiology, University of Rochester, NY 14642, USA
| | | |
Collapse
|
30
|
Dexter F, Traub RD. Sequencing Cases in the Operating Room: Predicting Whether One Surgical Case will Last Longer than Another. Anesth Analg 2000. [DOI: 10.1213/00000539-200004000-00037] [Citation(s) in RCA: 24] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
|
31
|
Scheduling Surgical Cases into Overflow Block Time— Computer Simulation of the Effects of Scheduling Strategies on Operating Room Labor Costs. Anesth Analg 2000. [DOI: 10.1213/00000539-200004000-00038] [Citation(s) in RCA: 64] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
|
32
|
Chapter 6. The Future (2000–2025). Int Anesthesiol Clin 2000. [DOI: 10.1097/00004311-200004000-00009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|