An international, interdisciplinary research team led by Prof. Jakob N. Kather from the Else Kröner Fresenius Center (EKFZ) for Digital Health at TUD Dresden University of Technology analyzed seven independent patient cohorts from Europe and the USA using their newly developed AI model. The model detects genetic alterations and resulting tissue changes in colorectal cancer directly from tissue section images. This could enable faster and more cost-effective diagnostics in the future. For the development, validation, and data analysis of the model, experts in data and computer science, epidemiology, pathology, and oncology worked closely together. The study has been published in the journal “The Lancet Digital Health”.

The multicenter study analyzed nearly 2,000 digitized tissue slides from colon cancer patients across seven independent cohorts in Europe and the US. The samples included both whole-slide images of tissue samples and clinical, demographic, and lifestyle data. The researchers developed a novel “multi-target transformer model” to predict a wide range of genetic alterations directly from routinely stained histological colon cancer tissue sections. Previous studies were typically limited to predicting single genetic alterations and did not account for co-occurring mutations or shared morphological patterns.

Earlier deep learning models and analyses of the underlying tissue alterations have generally focused on only a single mutation at a time. Our new model, however, can identify many biomarkers simultaneously, including some not yet considered clinically relevant. We were able to demonstrate this in several independent cohorts. We also observed that many mutations occur more frequently in microsatellite-instable tumors (MSI).” 


Marco Gustav, M.Sc., first author of the study and researcher at EKFZ for Digital Health at TU Dresden

Certain types of colorectal cancer can be classified based on microsatellite instability (MSI). Microsatellites are short, repetitive DNA sequences spread throughout the genome. In cancer, MSI can occur when these sequences become unstable due to defects in the DNA repair system. MSI is an important biomarker for identifying patients who may benefit from immunotherapy. “This suggests that different mutations collectively contribute to changes in tissue morphology. The model recognizes shared visual patterns, rather than independently identifying individual genetic alterations,” he adds.

The researchers demonstrated that their model matched and partly exceeded established single-target models in predicting numerous biomarkers, such as BRAF or RNF43 mutations, and microsatellite instability (MSI) directly from pathology slides. The pathological expertise required to assess tissue changes from histological slides was provided by experienced medical specialists. Dr. Nic Reitsam from the University Hospital Augsburg played a key role in the study.

Highlighting the study’s significance, Jakob N. Kather, Professor of Clinical Artificial Intelligence at the EKFZ for Digital Health at TU Dresden and senior oncologist at the NCT/UCC of the University Hospital Carl Gustav Carus Dresden, says: “Our research shows that AI models can significantly accelerate diagnostic workflows. At the same time, these methods provide new insights into the relationship between molecular and morphological changes in colorectal cancer. In the future, this technology could be used as an effective pre-screening tool to help clinicians select patients for further molecular testing and guide personalized treatment decisions.”

The research team now plans to extend this approach to other types of cancer as well.

The study was conducted through interdisciplinary collaboration among numerous scientists at leading research institutions in Europe and the United States. In addition to TUD and Dresden University Hospital, partners included the Medical Faculty of the University of Augsburg, the National Center for Tumor Diseases (NCT) in Heidelberg, the Fred Hutchinson Cancer Center in Seattle (USA), the Medical University of Vienna (Austria), and the Mayo Clinic (USA).

Source:

Technische Universität Dresden

Journal reference:

Gustav, M., et al. (2025). Assessing genotype−phenotype correlations in colorectal cancer with deep learning: a multicentre cohort study. The Lancet Digital Health. doi.org/10.1016/j.landig.2025.100891.