{"id":50132,"date":"2025-07-09T01:14:10","date_gmt":"2025-07-09T01:14:10","guid":{"rendered":"https:\/\/www.europesays.com\/us\/50132\/"},"modified":"2025-07-09T01:14:10","modified_gmt":"2025-07-09T01:14:10","slug":"validation-of-the-toronto-recurrence-inference-using-machine-learning-for-post-transplant-hepatocellular-carcinoma-model","status":"publish","type":"post","link":"https:\/\/www.europesays.com\/us\/50132\/","title":{"rendered":"Validation of the Toronto recurrence inference using machine-learning for post-transplant hepatocellular carcinoma model"},"content":{"rendered":"<p>We validated our TRIUMPH model, developed using a machine learning approach, in an international multicenter external cohort. The model showed numerically superior discrimination compared to the HALT-HCC, MORAL, and AFP models and had greater clinical utility in the net benefit analysis. These findings support the use of machine learning to create more precise risk prediction models.<\/p>\n<p>The TRIUMPH model\u2019s strength comes from two key factors. First, it was developed using a large LT cohort from the University Health Network, which included nearly 20% LDLT<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 15\" title=\"Li, Z. et al. Living Donor Availability Improves Patient Survival in a North American Center: An Intention-to-treat Analysis. Ann. Surg. &#010;                  https:\/\/doi.org\/10.1097\/SLA.0000000000006451&#010;                  &#010;                .\" href=\"http:\/\/www.nature.com\/articles\/s43856-025-00994-5#ref-CR15\" id=\"ref-link-section-d48624483e3321\" target=\"_blank\" rel=\"noopener\">15<\/a>. In contrast, the HALT-HCC, MORAL, and AFP models were based solely on deceased donor LT cohorts. Incorporating a large LDLT population in model development supports a more balanced evaluation of LT recipients and enhances generalizability. This is reflected in TRIUMPH\u2019s numerically higher performance in both the LDLT subgroup and the Kaohsiung Chang Gung Memorial Hospital subgroup. Second, the machine learning approach used in the TRIUMPH model identified more associations and incorporated a broader range of risk factors. It included not only morphological factors like the size and number of lesions but also biomarkers such as AFP levels and neutrophil counts. Additionally, it accounted for dynamic changes occurring during bridging therapies on the waitlist. Incorporating multiple aspects of HCC is crucial for establishing effective selection criteria<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 16\" title=\"Lozanovski, V. J. et al. Prognostic role of selection criteria for liver transplantation in patients with hepatocellular carcinoma: a network meta-analysis. BJS Open 6, zrab130 (2022).\" href=\"http:\/\/www.nature.com\/articles\/s43856-025-00994-5#ref-CR16\" id=\"ref-link-section-d48624483e3325\" target=\"_blank\" rel=\"noopener\">16<\/a>. Compared to the TRIUMPH model, only HALT-HCC<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 7\" title=\"Sasaki, K. et al. Development and validation of the HALT-HCC score to predict mortality in liver transplant recipients with hepatocellular carcinoma: a retrospective cohort analysis. Lancet Gastroenterol. Hepatol. 2, 595&#x2013;603 (2017).\" href=\"http:\/\/www.nature.com\/articles\/s43856-025-00994-5#ref-CR7\" id=\"ref-link-section-d48624483e3329\" target=\"_blank\" rel=\"noopener\">7<\/a> achieved statistically noninferior performance, consistent with the original development cohort findings. Although this difference wasn\u2019t statistically significant, subgroup analysis showed a numerical advantage for TRIUMPH, particularly among LDLT recipients and non-US cohorts. HALT-HCC, developed at a US center (Cleveland Clinic), performed best in US validation centers (UCSF, UCLA). This highlights the influence of regional practices and patient characteristics on the model\u2019s performance. Despite both models originating from North American centers, TRIUMPH\u2019s superior performance outside North America may stem from its more diverse development cohort and machine learning approach incorporating more predictors.<\/p>\n<p>The TRIUMPH model also showed better clinical utility in the net benefit decision analysis which balanced the true positive rate (preventing futile liver transplants in patients likely to experience recurrence) against the false positive rate (denying transplants to patients who could potentially be cured). Across various risk thresholds (reflecting the probability of LT based on waitlist status and organ availability), the TRIUMPH model achieved a higher net benefit than other models, particularly from thresholds 0.0 to 0.6. This range is realistic given that the literature reports a 1-year probability of 54% and an overall probability of 60\u201373% for LT in patients with HCC on the UNOS waitlist<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" title=\"Yang, J. D. et al. Hepatocellular Carcinoma is the Most Common Indication for Liver Transplantation and Placement on the Waitlist in the United States. Clin. Gastroenterol. Hepatol. Off. Clin. Pract. J. Am. Gastroenterol. Assoc. 15, 767&#x2013;775.e3 (2017).\" href=\"#ref-CR18\" id=\"ref-link-section-d48624483e3336\">18<\/a>,<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" title=\"Kwong, A. J. et al. National Trends and Waitlist Outcomes of Locoregional Therapy Among Liver Transplant Candidates With Hepatocellular Carcinoma in the United States. Clin. Gastroenterol. Hepatol. Off. Clin. Pract. J. Am. Gastroenterol. Assoc. 20, 1142&#x2013;1150.e4 (2022).\" href=\"#ref-CR19\" id=\"ref-link-section-d48624483e3336_1\">19<\/a>,<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 20\" title=\"Akabane, M. et al. Continuous Risk Score Predicts Waitlist and Post-transplant Outcomes in Hepatocellular Carcinoma Despite Exception Changes. Clin. Gastroenterol. Hepatol. &#010;                  https:\/\/doi.org\/10.1016\/j.cgh.2024.05.046&#010;                  &#010;                 (2024).\" href=\"http:\/\/www.nature.com\/articles\/s43856-025-00994-5#ref-CR20\" id=\"ref-link-section-d48624483e3339\" target=\"_blank\" rel=\"noopener\">20<\/a>.<\/p>\n<p>One example of machine learning implemented in organ allocation is the Optimized Prediction of Mortality (OPOM), evaluated by OPTN\/UNOS<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 21\" title=\"Bertsimas, D. et al. Development and validation of an optimized prediction of mortality for candidates awaiting liver transplantation. Am. J. Transplant. Off. J. Am. Soc. Transplant. Am. Soc. Transpl. Surg. 19, 1109&#x2013;1118 (2019).\" href=\"http:\/\/www.nature.com\/articles\/s43856-025-00994-5#ref-CR21\" id=\"ref-link-section-d48624483e3346\" target=\"_blank\" rel=\"noopener\">21<\/a>. While OPOM was designed to improve risk stratification for HCC patients with exception points<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 22\" title=\"Ioannou, G. N., Perkins, J. D. &amp; Carithers, R. L. Liver transplantation for hepatocellular carcinoma: impact of the MELD allocation system and predictors of survival. Gastroenterology 134, 1342&#x2013;1351 (2008).\" href=\"http:\/\/www.nature.com\/articles\/s43856-025-00994-5#ref-CR22\" id=\"ref-link-section-d48624483e3350\" target=\"_blank\" rel=\"noopener\">22<\/a>,<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 23\" title=\"Heimbach, J. K. Evolution of Liver Transplant Selection Criteria and U.S. Allocation Policy for Patients with Hepatocellular Carcinoma. Semin. Liver Dis. 40, 358&#x2013;364 (2020).\" href=\"http:\/\/www.nature.com\/articles\/s43856-025-00994-5#ref-CR23\" id=\"ref-link-section-d48624483e3353\" target=\"_blank\" rel=\"noopener\">23<\/a>, it only predicts waitlist dropout, neglecting the critical prognostic factor of post-transplant survival. The TRIUMPH model, however, shows strong performance and utility in predicting post-transplant recurrence. Therefore, TRIUMPH could serve as a complementary tool, integrating this crucial post-transplant survival aspect into the organ allocation system. Nevertheless, incorporating any new model like TRIUMPH into allocation policy is a major undertaking that remains a future goal, requiring extensive validation, logistical considerations, and consensus within the transplant community.<\/p>\n<p>Apart from the TRIUMPH model, three other machine learning-based models have been developed to predict post-transplant HCC recurrence: MoRAL-AI<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 24\" title=\"Nam, J. Y. et al. Novel Model to Predict HCC Recurrence after Liver Transplantation Obtained Using Deep Learning: A Multicenter Study. Cancers 12, 2791 (2020).\" href=\"http:\/\/www.nature.com\/articles\/s43856-025-00994-5#ref-CR24\" id=\"ref-link-section-d48624483e3361\" target=\"_blank\" rel=\"noopener\">24<\/a>, RELAPSE<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 25\" title=\"Tran, B. V. et al. Development and validation of a REcurrent Liver cAncer Prediction ScorE (RELAPSE) following liver transplantation in patients with hepatocellular carcinoma: Analysis of the US Multicenter HCC Transplant Consortium. Liver Transplant. Off. Publ. Am. Assoc. Study Liver Dis. Int. Liver Transplant. Soc. 29, 683&#x2013;697 (2023).\" href=\"http:\/\/www.nature.com\/articles\/s43856-025-00994-5#ref-CR25\" id=\"ref-link-section-d48624483e3365\" target=\"_blank\" rel=\"noopener\">25<\/a>, and TRAIN-AI<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 26\" title=\"Lai, Q. et al. Development and validation of an artificial intelligence model for predicting post-transplant hepatocellular cancer recurrence. Cancer Commun. 43, 1381&#x2013;1385 (2023).\" href=\"http:\/\/www.nature.com\/articles\/s43856-025-00994-5#ref-CR26\" id=\"ref-link-section-d48624483e3369\" target=\"_blank\" rel=\"noopener\">26<\/a>. The MoRAL-AI model, which uses a deep neural network, incorporates variables such as tumor diameter, AFP, and PIVKA-II. It demonstrated improved discrimination compared to the conventional MoRAL model, however, its generalizability is limited due to its focus on LDLT recipients in South Korea and the requirement for PIVKA-II, which is not routinely analyzed. The RELAPSE model, which employs random survival forests and classification techniques, achieved a higher c-index compared to the TRIUMPH model, although this advantage likely stems from its inclusion of post-transplant variables. However, pre-transplant variables are crucial for decision-making regarding organ allocation, as they are the only factors available before surgery. TRAIN-AI, developed on a large international cohort and validated on a smaller North American cohort, followed the opposite approach of the TRIUMPH model. While TRIUMPH captured dynamic changes in tumor lesions during bridging therapy using objective data, TRAIN-AI relied on the modified Response Evaluation Criteria in Solid Tumors (mRECIST). This criterion, which can vary between institutions and radiologists<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 27\" title=\"Tovoli, F. et al. Inter-operator variability and source of errors in tumour response assessment for hepatocellular carcinoma treated with sorafenib. Eur. Radiol. 28, 3611&#x2013;3620 (2018).\" href=\"http:\/\/www.nature.com\/articles\/s43856-025-00994-5#ref-CR27\" id=\"ref-link-section-d48624483e3373\" target=\"_blank\" rel=\"noopener\">27<\/a>,<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 28\" title=\"Jeon, M. Y. et al. Reproducibility of European Association for the Study of the Liver criteria and modified Response Evaluation Criteria in Solid Tumors in patients treated with sorafenib. Liver Int. Off. J. Int. Assoc. Study Liver 38, 1655&#x2013;1663 (2018).\" href=\"http:\/\/www.nature.com\/articles\/s43856-025-00994-5#ref-CR28\" id=\"ref-link-section-d48624483e3376\" target=\"_blank\" rel=\"noopener\">28<\/a>, may introduce bias. Nevertheless, TRAIN-AI achieved a high c-index of 0.77 in both internal and external validations, outperforming other pre-existing models. The DeepSurv methodology, used by TRAIN-AI, was also considered for our development cohort. However, the TRIUMPH approach\u2014enhancing the traditional Cox model with elastic net regularization\u2014was preferred due to its superior performance. While DeepSurv is well-suited for large development cohorts like that used in TRAIN-AI, its complexity poses a risk of overfitting in smaller datasets. Given our relatively small sample size, we selected the TRIUMPH model as a more appropriate approach to mitigate this risk.<\/p>\n<p>This study faces several limitations that impact its findings. Firstly, its design as a retrospective and multicentric study introduces the possibility of selection biases which may arise due to the varied approaches to management across different centers. Additionally, the development cohort from Toronto differed significantly from the validation cohort, which had a higher HBV prevalence and lower proportion of locally advanced HCC. This discrepancy may have negatively impacted the model\u2019s validation performance and highlighted potential regional biases that affected the model\u2019s performance. Future work incorporating data from diverse international centers during model development would help refine the model and improve its generalizability. While the inclusion of both living and deceased donor grafts in the TRIUMPH model could be viewed as a commingling of data, this approach was intentional. Donor-specific models may better capture differences in transplant settings or graft characteristics, but the TRIUMPH model was designed to reflect the reality of centers offering both types of transplantation. It provides a unified tool to guide decision-making for patients eligible for either pathway. Notably, there is no evidence to date that graft quality directly influences oncologic outcomes in an as-treated analysis. Given that models specific to LDLT or DDLT already exist, the strength of TRIUMPH lies in its validated performance across a mixed-donor cohort\u2014reflecting real-world practice and enhancing generalizability across diverse transplant programs. Finally, while other frequently used models, such as Metroticket 2.0<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 29\" title=\"Mazzaferro, V. et al. Metroticket 2.0 Model for Analysis of Competing Risks of Death After Liver Transplantation for Hepatocellular Carcinoma. Gastroenterology 154, 128&#x2013;139 (2018).\" href=\"http:\/\/www.nature.com\/articles\/s43856-025-00994-5#ref-CR29\" id=\"ref-link-section-d48624483e3383\" target=\"_blank\" rel=\"noopener\">29<\/a> (based on competing risk analysis) and RETREAT<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 14\" title=\"Mehta, N. et al. Validation of a Risk Estimation of Tumor Recurrence After Transplant (RETREAT) Score for Hepatocellular Carcinoma Recurrence After Liver Transplant. JAMA Oncol. 3, 493&#x2013;500 (2017).\" href=\"http:\/\/www.nature.com\/articles\/s43856-025-00994-5#ref-CR14\" id=\"ref-link-section-d48624483e3387\" target=\"_blank\" rel=\"noopener\">14<\/a> (which incorporates pathological predictors), could have been included as comparators, their inclusion was not feasible due to unmet model requirements.<\/p>\n<p>In conclusion, the TRIUMPH model outperforms other commonly used scores in predicting post-transplant HCC recurrence, offering both higher accuracy and greater clinical utility. This suggests that integrating the TRIUMPH model into future organ allocation strategies for HCC patients could enhance the overall benefit of liver transplantation. Our study highlights the potential of machine learning approaches to advance organ allocation in transplant medicine. However, despite technological advancements, it remains essential to develop robust machine learning models with large, diverse cohorts to ensure generalizability and avoid overfitting. This will require ongoing collaboration within the international transplant community and a commitment to incorporating machine learning innovations into transplant practices.<\/p>\n","protected":false},"excerpt":{"rendered":"We validated our TRIUMPH model, developed using a machine learning approach, in an international multicenter external cohort. The&hellip;\n","protected":false},"author":3,"featured_media":50133,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[21],"tags":[691,738,834,37902,3209,37097,158,67,132,68],"class_list":{"0":"post-50132","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-artificial-intelligence","8":"tag-ai","9":"tag-artificial-intelligence","10":"tag-general","11":"tag-hepatocellular-carcinoma","12":"tag-medicine-public-health","13":"tag-surgical-oncology","14":"tag-technology","15":"tag-united-states","16":"tag-unitedstates","17":"tag-us"},"share_on_mastodon":{"url":"https:\/\/pubeurope.com\/@us\/114820629436491980","error":""},"_links":{"self":[{"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/posts\/50132","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/comments?post=50132"}],"version-history":[{"count":0,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/posts\/50132\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/media\/50133"}],"wp:attachment":[{"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/media?parent=50132"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/categories?post=50132"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/tags?post=50132"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}