1
|
Milders J, Ramspek CL, Janse RJ, Bos WJW, Rotmans JI, Dekker FW, van Diepen M. Prognostic Models in Nephrology: Where Do We Stand and Where Do We Go from Here? Mapping Out the Evidence in a Scoping Review. J Am Soc Nephrol 2024; 35:367-380. [PMID: 38082484 PMCID: PMC10914213 DOI: 10.1681/asn.0000000000000285] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/05/2024] Open
Abstract
Prognostic models can strongly support individualized care provision and well-informed shared decision making. There has been an upsurge of prognostic research in the field of nephrology, but the uptake of prognostic models in clinical practice remains limited. Therefore, we map out the research field of prognostic models for kidney patients and provide directions on how to proceed from here. We performed a scoping review of studies developing, validating, or updating a prognostic model for patients with CKD. We searched all published models in PubMed and Embase and report predicted outcomes, methodological quality, and validation and/or updating efforts. We found 602 studies, of which 30.1% concerned CKD populations, 31.6% dialysis populations, and 38.4% kidney transplantation populations. The most frequently predicted outcomes were mortality ( n =129), kidney disease progression ( n =75), and kidney graft survival ( n =54). Most studies provided discrimination measures (80.4%), but much less showed calibration results (43.4%). Of the 415 development studies, 28.0% did not perform any validation and 57.6% performed only internal validation. Moreover, only 111 models (26.7%) were externally validated either in the development study itself or in an independent external validation study. Finally, in 45.8% of development studies no useable version of the model was reported. To conclude, many prognostic models have been developed for patients with CKD, mainly for outcomes related to kidney disease progression and patient/graft survival. To bridge the gap between prediction research and kidney patient care, patient-reported outcomes, methodological rigor, complete reporting of prognostic models, external validation, updating, and impact assessment urgently need more attention.
Collapse
Affiliation(s)
- Jet Milders
- Department of Clinical Epidemiology, Leiden University Medical Center, Leiden, The Netherlands
| | - Chava L. Ramspek
- Department of Clinical Epidemiology, Leiden University Medical Center, Leiden, The Netherlands
| | - Roemer J. Janse
- Department of Clinical Epidemiology, Leiden University Medical Center, Leiden, The Netherlands
| | - Willem Jan W. Bos
- Department of Internal Medicine, Leiden University Medical Center, Leiden, The Netherlands
- Santeon, Utrecht, The Netherlands
- Department of Internal Medicine, St. Antonius Hospital, Nieuwegein, The Netherlands
| | - Joris I. Rotmans
- Department of Internal Medicine, Leiden University Medical Center, Leiden, The Netherlands
| | - Friedo W. Dekker
- Department of Clinical Epidemiology, Leiden University Medical Center, Leiden, The Netherlands
| | - Merel van Diepen
- Department of Clinical Epidemiology, Leiden University Medical Center, Leiden, The Netherlands
| |
Collapse
|
2
|
Zhang Y, Hu A, Lin Y, Cao Y, Muller S, Wong G, Yang JYH. simKAP: simulation framework for the kidney allocation process with decision making model. Sci Rep 2023; 13:16367. [PMID: 37773250 PMCID: PMC10541869 DOI: 10.1038/s41598-023-41162-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2023] [Accepted: 08/23/2023] [Indexed: 10/01/2023] Open
Abstract
Organ shortage is a major barrier in transplantation and rules guarding organ allocation decisions should be robust, transparent, ethical and fair. Whilst numerous allocation strategies have been proposed, it is often unrealistic to evaluate all of them in real-life settings. Hence, the capability of conducting simulations prior to deployment is important. Here, we developed a kidney allocation simulation framework (simKAP) that aims to evaluate the allocation process and the complex clinical decision-making process of organ acceptance in kidney transplantation. Our findings have shown that incorporation of both the clinical decision-making and a dynamic wait-listing process resulted in the best agreement between the actual and simulated data in almost all scenarios. Additionally, several hypothetical risk-based allocation strategies were generated, and we found that these strategies improved recipients' long-term post-transplant patient survival and reduced wait time for transplantation. The importance of simKAP lies in its ability for policymakers in any transplant community to evaluate any proposed allocation algorithm using in-silico simulation.
Collapse
Affiliation(s)
- Yunwei Zhang
- School of Mathematics and Statistics, The University of Sydney, F07- Carslaw Building, Sydney, NSW, Australia
- Charles Perkins Centre, The University of Sydney, Sydney, NSW, Australia
| | - Anne Hu
- School of Mathematics and Statistics, The University of Sydney, F07- Carslaw Building, Sydney, NSW, Australia
- Sydney Law School, The University of Sydney, Sydney, NSW, Australia
| | - Yingxin Lin
- School of Mathematics and Statistics, The University of Sydney, F07- Carslaw Building, Sydney, NSW, Australia
- Charles Perkins Centre, The University of Sydney, Sydney, NSW, Australia
| | - Yue Cao
- School of Mathematics and Statistics, The University of Sydney, F07- Carslaw Building, Sydney, NSW, Australia
- Charles Perkins Centre, The University of Sydney, Sydney, NSW, Australia
| | - Samuel Muller
- School of Mathematics and Statistics, The University of Sydney, F07- Carslaw Building, Sydney, NSW, Australia
- School of Mathematical and Physical Sciences, Macquarie University, Sydney, NSW, Australia
| | - Germaine Wong
- Sydney School of Public Health, The University of Sydney, Sydney, NSW, Australia
- Centre for Kidney Research, Kids Research Institute, The Children's Hospital at Westmead, Sydney, NSW, Australia
- Centre for Transplant and Renal Research, Westmead Hospital, Sydney, NSW, Australia
| | - Jean Yee Hwa Yang
- School of Mathematics and Statistics, The University of Sydney, F07- Carslaw Building, Sydney, NSW, Australia.
- Charles Perkins Centre, The University of Sydney, Sydney, NSW, Australia.
| |
Collapse
|
3
|
Nino-Torres L, García-Lopez A, Patino-Jaramillo N, Giron-Luque F, Nino-Murcia A. Predicting 5-year survival after kidney transplantation in Colombia using the survival benefit estimator tool. PLoS One 2023; 18:e0290162. [PMID: 37624758 PMCID: PMC10456165 DOI: 10.1371/journal.pone.0290162] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2023] [Accepted: 08/03/2023] [Indexed: 08/27/2023] Open
Abstract
INTRODUCTION A complex relationship between donor and recipient characteristics influences kidney transplant (KT) success. A tool developed by Bae S. et al. (Survival Benefit Estimator, SBE) helps estimate post-KT survival. We aim to evaluate the predictive performance of the SBE tool in terms of 5-year patient survival after a kidney transplant. METHODS A retrospective cohort study of all deceased-donor KT recipients between January 2009 to December 2021. A descriptive analysis of clinical and sociodemographic characteristics was performed. The SBE online tool was used to calculate the predicted patient survival (PPS) and the survival benefit at five years post-KT. Comparisons between predictive vs. actual patient survival were made using quintile subgroups. Three Cox regression models were built using PPS, EPTS, and KDPI. RESULTS A total of 1145 recipients were evaluated. Mortality occurred in 157 patients. Patient survival was 86.2%. Predictive survival for patients if they remained on the waiting list was 70.6%. The PPS was 89.3%, which results in a survival benefit (SB) of 18.7% for our population. Actual survival rates were lower than the predicted ones across all the quintiles. In unadjusted analysis, PPS was a significant protective factor for mortality (HR 0.66), whereas EPTS (HR 8.9) and KDPI (HR 3.25) scores were significant risk factors. The discrimination of KDPI, PPS, and EPTS scores models were 0.59, 0.65, and 0.66, respectively. CONCLUSION SBE score overestimated actual survival rates in our sample. The discrimination power of the score was moderate, although the utility of this tool may be limited in this specific population.
Collapse
Affiliation(s)
- Laura Nino-Torres
- Department of Transplant Surgery, Colombiana de Trasplantes, Bogotá, Colombia
| | - Andrea García-Lopez
- Department of Transplant Research, Colombiana de Trasplantes, Bogotá, Colombia
| | | | | | | |
Collapse
|
4
|
Hu A, Stewart C, Craig JC, Wyburn K, Pleass H, Kanellis J, Lim WH, Yang J, Wong G. Jurisdictional inequalities in deceased donor kidney allocation in Australia. Kidney Int 2021; 100:49-54. [PMID: 33961869 DOI: 10.1016/j.kint.2021.04.028] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2021] [Revised: 03/28/2021] [Accepted: 04/20/2021] [Indexed: 10/21/2022]
Affiliation(s)
- Anne Hu
- Faculty of Science, School of Mathematics and Science, University of Sydney, Sydney, Australia
| | - Cameron Stewart
- Sydney Law School, University of Sydney, Camperdown, Sydney, New South Wales, Australia
| | - Jonathan C Craig
- College of Medicine and Public Health, Flinders University, Adelaide, Australia
| | - Kate Wyburn
- Department of Renal and Transplantation Medicine, Royal Prince Alfred Hospital, Sydney, New South Wales, Australia
| | - Henry Pleass
- Faculty of Health and Medical Science, University of Western Australia, Perth, Australia
| | - John Kanellis
- Department of Nephrology, Monash Health and Centre for Inflammatory Diseases, Melbourne, Australia; Department of Medicine, Monash University, Clayton, Victoria, Australia
| | - Wai H Lim
- Specialty of Surgery, University of Sydney, Camperdown, Sydney, New South Wales, Australia
| | - Jean Yang
- Faculty of Science, School of Mathematics and Science, University of Sydney, Sydney, Australia
| | - Germaine Wong
- Sydney School of Public Health, University of Sydney, Camperdown, New South Wales, Australia; Centre for Kidney Research, Kids Research Institute, The Children's Hospital at Westmead, Sydney, New South Wales, Australia; Centre for Transplant and Renal Research, Westmead Hospital, Sydney, New South Wales, Australia.
| |
Collapse
|
5
|
Senanayake S, Graves N, Healy H, Baboolal K, Barnett A, Sypek MP, Kularatna S. Deceased donor kidney allocation: an economic evaluation of contemporary longevity matching practices. BMC Health Serv Res 2020; 20:931. [PMID: 33036621 PMCID: PMC7547436 DOI: 10.1186/s12913-020-05736-y] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2020] [Accepted: 09/15/2020] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Matching survival of a donor kidney with that of the recipient (longevity matching), is used in some kidney allocation systems to maximize graft-life years. It is not part of the allocation algorithm for Australia. Given the growing evidence of survival benefit due to longevity matching based allocation algorithms, development of a similar kidney allocation system for Australia is currently underway. The aim of this research is to estimate the impact that changes to costs and health outcomes arising from 'longevity matching' on the Australian healthcare system. METHODS A decision analytic model to estimate cost-effectiveness was developed using a Markov process. Four plausible competing allocation options were compared to the current kidney allocation practice. Models were simulated in one-year cycles for a 20-year time horizon, with transitions through distinct health states relevant to the kidney recipient. Willingness to pay was considered as AUD 28000. RESULTS Base case analysis indicated that allocating the worst 20% of Kidney Donor Risk Index (KDRI) donor kidneys to the worst 20% of estimated post-transplant survival (EPTS) recipients (option 2) and allocating the oldest 25% of donor kidneys to the oldest 25% of recipients are both cost saving and more effective compared to the current Australian allocation practice. Option 2, returned the lowest costs, greatest health benefits and largest gain to net monetary benefits (NMB). Allocating the best 20% of KDRI donor kidneys to the best 20% of EPTS recipients had the lowest expected incremental NMB. CONCLUSION Of the four longevity-based kidney allocation practices considered, transplanting the lowest quality kidneys to the worst kidney recipients (option 2), was estimated to return the best value for money for the Australian health system.
Collapse
Affiliation(s)
- Sameera Senanayake
- Australian Center for Health Service Innovation, Queensland University of Technology, 60 Musk Ave, Kelvin Grove, QLD, 4059, Australia.
| | - Nicholas Graves
- Australian Center for Health Service Innovation, Queensland University of Technology, 60 Musk Ave, Kelvin Grove, QLD, 4059, Australia
| | - Helen Healy
- Royal Brisbane Hospital for Women, Brisbane, Australia
- School of Medicine, University of Queensland, Brisbane, Australia
| | - Keshwar Baboolal
- Royal Brisbane Hospital for Women, Brisbane, Australia
- School of Medicine, University of Queensland, Brisbane, Australia
| | - Adrian Barnett
- Australian Center for Health Service Innovation, Queensland University of Technology, 60 Musk Ave, Kelvin Grove, QLD, 4059, Australia
| | - Matthew P Sypek
- Australia and New Zealand Dialysis and Transplant (ANZDATA) Registry, Adelaide, SA, Australia
| | - Sanjeewa Kularatna
- Australian Center for Health Service Innovation, Queensland University of Technology, 60 Musk Ave, Kelvin Grove, QLD, 4059, Australia
| |
Collapse
|
6
|
Risk Indices in Deceased-donor Organ Allocation for Transplantation: Review From an Australian Perspective. Transplantation 2019; 103:875-889. [PMID: 30801513 DOI: 10.1097/tp.0000000000002613] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
Abstract
Over the last decade, organ donation and transplantation rates have increased in Australia and worldwide. Donor and recipient characteristics for most organ types have generally broadened, resulting in the need to consider more complex data in transplant decision-making. As a result of some of these pressures, the Australian software used for donor and recipient data management is currently being updated. Because of the in-built capacity for improved data management, organ allocation processes will have the opportunity to be significantly reviewed, in particular the possible use of risk indices (RIs) to guide organ allocation and transplantation decisions. We aimed to review RIs used in organ allocation policies worldwide and to compare their use to current Australian protocols. Significant donor, recipient, and transplant variables in the indices were summarized. We conclude that Australia has the opportunity to incorporate greater use of RIs in its allocation policies and in transplant decision-making processes. However, while RIs can assist with organ allocation and help guide prognosis, they often have significant limitations which need to be properly appreciated when deciding how to best use them to guide clinical decisions.
Collapse
|
7
|
Lee D, Kanellis J, Mulley WR. Allocation of deceased donor kidneys: A review of international practices. Nephrology (Carlton) 2019; 24:591-598. [DOI: 10.1111/nep.13548] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/04/2018] [Indexed: 12/20/2022]
Affiliation(s)
- Darren Lee
- Department of Renal MedicineEastern Health Melbourne Victoria Australia
- Eastern Health Clinical SchoolMonash University Melbourne Victoria Australia
- Department of NephrologyAustin Health Melbourne Victoria Australia
| | - John Kanellis
- Department of NephrologyMonash Medical Centre Melbourne Victoria Australia
- Centre for Inflammatory Diseases, Department of MedicineMonash University Melbourne Victoria Australia
| | - William R Mulley
- Department of NephrologyMonash Medical Centre Melbourne Victoria Australia
- Centre for Inflammatory Diseases, Department of MedicineMonash University Melbourne Victoria Australia
| |
Collapse
|
8
|
Chapman JR, Kanellis J. Kidney donation and transplantation in Australia: more than a supply and demand equation. Med J Aust 2018; 209:242-243. [DOI: 10.5694/mja18.00617] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2018] [Accepted: 07/24/2018] [Indexed: 11/17/2022]
|