{"id":56699,"date":"2025-09-11T06:19:10","date_gmt":"2025-09-11T06:19:10","guid":{"rendered":"https:\/\/www.europesays.com\/ie\/56699\/"},"modified":"2025-09-11T06:19:10","modified_gmt":"2025-09-11T06:19:10","slug":"transparency-of-medical-artificial-intelligence-systems","status":"publish","type":"post","link":"https:\/\/www.europesays.com\/ie\/56699\/","title":{"rendered":"Transparency of medical artificial intelligence systems"},"content":{"rendered":"
  • \n

    Rajpurkar, P. & Lungren, M. P. The current and future state of AI interpretation of medical images. N. Engl. J. Med. 388<\/b>, 1981\u20131990 (2023).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Song, A. H. et al. Artificial intelligence for digital and computational pathology. Nat. Rev. Bioeng. 1<\/b>, 930\u2013949 (2023).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Jones, O. T. et al. Artificial intelligence and machine learning algorithms for early detection of skin cancer in community and primary care settings: a systematic review. Lancet Digit. Health 4<\/b>, e466\u2013e476 (2022).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Esteva, A. et al. Dermatologist-level classification of skin cancer with deep neural networks. Nature 542<\/b>, 115\u2013118 (2017).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Ouyang, D. et al. Video-based AI for beat-to-beat assessment of cardiac function. Nature 580<\/b>, 252\u2013256 (2020).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Christensen, M., Vukadinovic, M., Yuan, N. & Ouyang, D. Vision\u2013language foundation model for echocardiogram interpretation. Nat. Med. 30<\/b>, 1481\u20131488 (2024).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Arnold, C. Inside the nascent industry of AI-designed drugs. Nat. Med. 29<\/b>, 1292\u20131295 (2023).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Rakers, M. M. et al. Availability of evidence for predictive machine learning algorithms in primary care: a systematic review. JAMA Netw. Open 7<\/b>, e2432990\u2013e2432990 (2024).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Wu, E. et al. How medical AI devices are evaluated: limitations and recommendations from an analysis of FDA approvals. Nat. Med. 27<\/b>, 582\u2013584 (2021).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Dorr, D. A., Adams, L. & Emb\u00ed, P. Harnessing the promise of artificial intelligence responsibly. JAMA 329<\/b>, 1347\u20131348 (2023).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Muehlematter, U. J., Daniore, P. & Vokinger, K. N. Approval of artificial intelligence and machine learning-based medical devices in the USA and Europe (2015\u201320): a comparative analysis. Lancet Digit. Health 3<\/b>, e195\u2013e203 (2021).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    US Food and Drug Administration. Artificial Intelligence and Machine learning (AI\/ML)-Enabled Medical Devices (2024).<\/p>\n<\/li>\n

  • \n

    Smak Gregoor, A. M. et al. An artificial intelligence based app for skin cancer detection evaluated in a population based setting. npj Digit. Med. 6<\/b>, 90 (2023).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Chen, W. et al. Early detection of visual impairment in young children using a smartphone-based deep learning system. Nat. Med. 29<\/b>, 493\u2013503 (2023).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Temple, S. W. P. & Rowbottom, C. G. Gross failure rates and failure modes for a commercial AI-based auto-segmentation algorithm in head and neck cancer patients. J. Appl. Clin. Med. Phys. 25<\/b>, e14273 (2024).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Daneshjou, R. et al. Disparities in dermatology AI performance on a diverse, curated clinical image set. Sci. Adv. 8<\/b>, eabq6147 (2022).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Chen, R. J. et al. Algorithmic fairness in artificial intelligence for medicine and healthcare. Nat. Biomed. Eng. 7<\/b>, 719\u2013742 (2023).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Maleki, F. et al. Generalizability of machine learning models: quantitative evaluation of three methodological pitfalls. Radiol. Artif. Intell. 5<\/b>, e220028 (2023).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Yang, J. et al. Generalizability assessment of AI models across hospitals in a low\u2013middle and high income country. Nat. Commun. 15<\/b>, 8270 (2024).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Ong Ly, C. et al. Shortcut learning in medical AI hinders generalization: method for estimating AI model generalization without external data. npj Digit. Med. 7<\/b>, 124 (2024).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    DeGrave, A. J., Janizek, J. D. & Lee, S.-I. AI for radiographic COVID-19 detection selects shortcuts over signal. Nat. Mach. Intell. 3<\/b>, 610\u2013619 (2021). This article reports that deep-learning models for COVID-19 detection from radiographs rely on confounding shortcuts rather than pathology, and emphasizes the importance of explainable AI for model auditing.<\/b><\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Laghi, A. Cautions about radiologic diagnosis of COVID-19 infection driven by artificial intelligence. Lancet Digit. Health 2<\/b>, e225 (2020).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Wang, L., Lin, Z. Q. & Wong, A. COVID-Net: a tailored deep convolutional neural network design for detection of COVID-19 cases from chest X-ray images. Sci. Rep. 10<\/b>, 19549 (2020).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Marey, A. et al. Explainability, transparency and black box challenges of AI in radiology: impact on patient care in cardiovascular radiology. Egypt J. Radiol. Nucl. Med. 55<\/b>, 183 (2024).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Poon, A. I. F. & Sung, J. J. Y. Opening the black box of AI-medicine. J. Gastroenterol. Hepatol. 36<\/b>, 581\u2013584 (2021).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Saw, S. N. & Ng, K. H. Current challenges of implementing artificial intelligence in medical imaging. Phys. Med. 100<\/b>, 12\u201317 (2022).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Singhal, K. et al. Large language models encode clinical knowledge. Nature 620<\/b>, 172\u2013180 (2023).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Jiang, L. Y. et al. Health system-scale language models are all-purpose prediction engines. Nature 619<\/b>, 357\u2013362 (2023).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Tiu, E. et al. Expert-level detection of pathologies from unannotated chest X-ray images via self-supervised learning. Nat. Biomed. Eng. 6<\/b>, 1399\u20131406 (2022).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Krishnan, R., Rajpurkar, P. & Topol, E. J. Self-supervised learning in medicine and healthcare. Nat. Biomed. Eng. 6<\/b>, 1346\u20131352 (2022).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Shick, A. A. et al. Transparency of artificial intelligence\/machine learning-enabled medical devices. npj Digit. Med. 7<\/b>, 21 (2024). This article presents key takeaways from an FDA-hosted workshop on the transparency of AI\/ML-enabled medical devices, emphasizing the need for clear and accessible communication about device development, performance, intended use and potential limitations.<\/b><\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Chen, H., Gomez, C., Huang, C.-M. & Unberath, M. Explainable medical imaging AI needs human-centered design: guidelines and evidence from a systematic review. npj Digit. Med. 5<\/b>, 156 (2022).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Cadario, R., Longoni, C. & Morewedge, C. K. Understanding, explaining, and utilizing medical artificial intelligence. Nat. Hum. Behav. 5<\/b>, 1636\u20131642 (2021).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    He, B. et al. Blinded, randomized trial of sonographer versus AI cardiac function assessment. Nature 616<\/b>, 520\u2013524 (2023).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Cruz Rivera, S. et al. Guidelines for clinical trial protocols for interventions involving artificial intelligence: the SPIRIT-AI extension. Nat. Med. 26<\/b>, 1351\u20131363 (2020).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Zhou, Y., Shi, Y., Lu, W. & Wan, F. Did artificial intelligence invade humans? The study on the mechanism of patients\u2019 willingness to accept artificial intelligence medical care: from the perspective of intergroup threat theory. Front. Psychol. 13<\/b>, 866124 (2022).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Shevtsova, D. et al. Trust in and acceptance of artificial intelligence applications in medicine: mixed methods study. JMIR Hum. Factors 11<\/b>, e47031 (2024).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Dean, T. B., Seecheran, R., Badgett, R. G., Zackula, R. & Symons, J. Perceptions and attitudes toward artificial intelligence among frontline physicians and physicians\u2019 assistants in Kansas: a cross-sectional survey. JAMIA Open 7<\/b>, ooae100 (2024).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Daneshjou, R., Smith, M. P., Sun, M. D., Rotemberg, V. & Zou, J. Lack of transparency and potential bias in artificial intelligence data sets and algorithms: a scoping review. JAMA Dermatol. 157<\/b>, 1362\u20131369 (2021). This article discusses the widespread lack of dataset characterization, labelling quality and demographic reporting in diagnostic AI studies for skin disease.<\/b><\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Groh, M. et al. Evaluating deep neural networks trained on clinical images in dermatology with the Fitzpatrick 17k dataset. In IEEE Conference on Computer Vision and Pattern Recognition Workshop (eds Forsyth, D. et al.) 1820\u20131828 (IEEE, 2021).<\/p>\n<\/li>\n

  • \n

    Saenz, A., Chen, E., Marklund, H. & Rajpurkar, P. The MAIDA initiative: establishing a framework for global medical-imaging data sharing. Lancet Digit. Health 6<\/b>, e6\u2013e8 (2024). This article introduces the MAIDA initiative, a global collaborative framework for assembling and sharing diverse medical imaging datasets to improve the generalizability and evaluation of AI models.<\/b><\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Bak, M., Madai, V. I., Fritzsche, M.-C., Mayrhofer, M. T. & McLennan, S. You can\u2019t have AI both ways: balancing health data privacy and access fairly. Front. Genet. 13<\/b>, 929453 (2022).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Koetzier, L. R. et al. Generating synthetic data for medical imaging. Radiology 312<\/b>, e232471 (2024).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Groh, M., Harris, C., Daneshjou, R., Badri, O. & Koochek, A. Towards transparency in dermatology image datasets with skin tone annotations by experts, crowds, and an algorithm. In Proc. ACM on Human\u2013Computer Interaction (ed. Nichols, J.) 6<\/b>, 521 (ACM, 2022).<\/p>\n<\/li>\n

  • \n

    Goldberg, C. B. et al. To do no harm \u2014 and the most good \u2014 with AI in health care. Nat. Med. 30<\/b>, 623\u2013627 (2024).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Liu, X. et al. Reporting guidelines for clinical trial reports for interventions involving artificial intelligence: the CONSORT-AI extension. Nat. Med. 26<\/b>, 1364\u20131374 (2020).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Bluemke, D. A. et al. Assessing radiology research on artificial intelligence: a brief guide for authors, reviewers, and readers \u2014 from the radiology editorial board. Radiology 294<\/b>, 487\u2013489 (2020).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    US Centers for Disease Control and Prevention. Health Insurance Portability and Accountability Act of 1996 (1996).<\/p>\n<\/li>\n

  • \n

    Carvalho, T., Antunes, L., Costa Santos, C. & Moniz, N. Empowering open data sharing for social good: a privacy-aware approach. Sci. Data 12<\/b>, 248 (2025).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Andrus, M. & Villeneuve, S. Demographic-reliant algorithmic fairness: characterizing the risks of demographic data collection in the pursuit of fairness. In Proc. ACM Conference on Fairness Accountability and Transparency (eds Isbell, C. et al.) 1709\u20131721 (ACM, 2022).<\/p>\n<\/li>\n

  • \n

    Wang, A., Ramaswamy, V. V. & Russakovsky, O. Towards intersectionality in machine learning: including more identities, handling underrepresentation, and performing evaluation. In Proc. ACM Conference on Fairness, Accountability and Transparency (eds Isbell, C. et al.) 336\u2013349 (ACM, 2022).<\/p>\n<\/li>\n

  • \n

    Tomasev, N., McKee, K. R., Kay, J. & Mohamed, S. Fairness for unobserved characteristics: insights from technological impacts on queer communities. In Proc. AAAI\/ACM Conference on AI, Ethics and Society (eds Das, S. et al.) 254\u2013265 (ACM, 2021).<\/p>\n<\/li>\n

  • \n

    Bowker, G. C. & Star, S. L. Sorting Things Out: Classification and its Consequences (MIT Press, 2000).<\/p>\n<\/li>\n

  • \n

    Hanna, A., Denton, R., Smart, A. & Smith-Loud, J. Towards a critical race methodology in algorithmic fairness. In Proc. ACM Conference on Fairness, Accountability and Transparency (eds Hildebrandt, M. et al.) 501\u2013512 (ACM, 2020).<\/p>\n<\/li>\n

  • \n

    Muntner, P. et al. Potential US population impact of the 2017 ACC\/AHA high blood pressure guideline. Circulation 137<\/b>, 109\u2013118 (2018).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Davatchi, F. et al. The saga of diagnostic\/classification criteria in Behcet\u2019s disease. Int. J. Rheum. Dis. 18<\/b>, 594\u2013605 (2015).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Winkler, J. K. et al. Association between surgical skin markings in dermoscopic images and diagnostic performance of a deep learning convolutional neural network for melanoma recognition. JAMA Dermatol. 155<\/b>, 1135\u20131141 (2019).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Bissoto, A., Fornaciali, M., Valle, E. & Avila, S. (De)constructing bias on skin lesion datasets. In Conference on Computer Vision and Pattern Recognition Workshop (eds Gupta, A. et al.) 2766\u20132774 (IEEE, 2019).<\/p>\n<\/li>\n

  • \n

    Norgeot, B. et al. Minimum information about clinical artificial intelligence modeling: the MI-CLAIM checklist. Nat. Med. 26<\/b>, 1320\u20131324 (2020).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Hernandez-Boussard, T., Bozkurt, S., Ioannidis, J. P. A. & Shah, N. H. MINIMAR (MINimum Information for Medical AI Reporting): developing reporting standards for artificial intelligence in health care. J. Am. Med. Inform. Assoc. 27<\/b>, 2011\u20132015 (2020).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Ganapathi, S. et al. Tackling bias in AI health datasets through the STANDING Together initiative. Nat. Med. 28<\/b>, 2232\u20132233 (2022).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Collins, G. S. et al. TRIPOD+ AI statement: updated guidance for reporting clinical prediction models that use regression or machine learning methods. BMJ 385<\/b>, q902 (2024).<\/p>\n


    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Pushkarna, M., Zaldivar, A. & Kjartansson, O. Data cards: purposeful and transparent dataset documentation for responsible AI. In Proc. ACM Conference on Fairness, Accountability and Transparency (eds Isbell, C. et al.) 1776\u20131826 (ACM, 2022).<\/p>\n<\/li>\n

  • \n

    Gebru, T. et al. Datasheets for datasets. Commun. ACM 64<\/b>, 86\u201392 (2021).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Mitchell, M. et al. Model cards for model reporting. In Proc. ACM Conference on Fairness, Accountability and Transparency (eds Chouldechovam, A. et al.) 220\u2013229 (ACM, 2019).<\/p>\n<\/li>\n

  • \n

    Janizek, J. D., Erion, G. G., DeGrave, A. J. & Lee, S.-I. An adversarial approach for the robust classification of pneumonia from chest radiographs. In Proc. ACM Conference on Health, Inference and Learning (ed. Ghassemi, M.) 69\u201379 (ACM, 2020).<\/p>\n<\/li>\n

  • \n

    Chen, F., Wang, L., Hong, J., Jiang, J. & Zhou, L. Unmasking bias in artificial intelligence: a systematic review of bias detection and mitigation strategies in electronic health record-based models. J. Am. Med. Inform. Assoc. 31<\/b>, 1172\u20131183 (2024).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Wu, J. et al. Clinical text datasets for medical artificial intelligence and large language models \u2014 a systematic review. NEJM AI 1<\/b>, AIra2400012 (2024).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    US White House. Blueprint for an AI Bill of Rights; https:\/\/bidenwhitehouse.archives.gov\/ostp\/ai-bill-of-rights\/<\/a> (2022)<\/p>\n<\/li>\n

  • \n

    US Government Accountability Office. Artificial intelligence in health care: benefits and challenges of machine learning technologies for medical diagnostics; https:\/\/www.gao.gov\/products\/gao-22-104629<\/a> (2022).<\/p>\n<\/li>\n

  • \n

    Raab, R. et al. Federated electronic health records for the European health data space. Lancet Digit. Health 5<\/b>, e840\u2013e847 (2023).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Gutman, D. et al. Skin lesion analysis toward melanoma detection: a challenge at the International Symposium on Biomedical Imaging (ISBI) 2016, hosted by the International Skin Imaging Collaboration (ISIC). Preprint at https:\/\/doi.org\/10.48550\/arXiv.1605.01397<\/a> (2016).<\/p>\n<\/li>\n

  • \n

    Codella, N. C. F. et al. Skin lesion analysis toward melanoma detection: a challenge at the 2017 International symposium on Biomedical Imaging (ISBI), hosted by the International Skin Imaging Collaboration (ISIC). In Proc. 15th International Symposium on Biomedical Imaging (eds Erik, M. et al.) 168\u2013172 (IEEE, 2018).<\/p>\n<\/li>\n

  • \n

    Codella, N. et al. Skin lesion analysis toward melanoma detection 2018: a challenge hosted by the International Skin Imaging Collaboration (ISIC). Preprint at https:\/\/doi.org\/10.48550\/arXiv.1902.03368<\/a> (2019).<\/p>\n<\/li>\n

  • \n

    Gonzales, S., Carson, M. B. & Holmes, K. Ten simple rules for maximizing the recommendations of the NIH data management and sharing plan. PLoS Comput. Biol. 18<\/b>, e1010397 (2022).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Bianchi, D. W. et al. The All Of Us research program is an opportunity to enhance the diversity of US biomedical research. Nat. Med. 30<\/b>, 330\u2013333 (2024).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Hope Watson et al. Delivering on NIH data sharing requirements: avoiding open data in appearance only. BMJ Health Care Inf. 30<\/b>, e100771 (2023).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    van der Haak, M. et al. Data security and protection in cross-institutional electronic patient records. Int. J. Med. Inf. 70<\/b>, 117\u2013130 (2003).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Price, W. N. & Cohen, I. G. Privacy in the age of medical big data. Nat. Med. 25<\/b>, 37\u201343 (2019).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Johnson, A. E. W. et al. MIMIC-III, a freely accessible critical care database. Sci. Data 3<\/b>, 160035 (2016).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Johnson, A. E. W. et al. MIMIC-IV, a freely accessible electronic health record dataset. Sci. Data 10<\/b>, 1 (2023).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Labkoff, S. E., Quintana, Y. & Rozenblit, L. Identifying the capabilities for creating next-generation registries: a guide for data leaders and a case for \u201cregistry science\u201d. J. Am. Med. Inform. Assoc. 31<\/b>, 1001\u20131008 (2024).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Rieke, N. et al. The future of digital health with federated learning. npj Digit. Med. 3<\/b>, 119 (2020).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Kushida, C. A. et al. Strategies for de-identification and anonymization of electronic health record data for use in multicenter research studies. Med. Care 50<\/b>, S82\u2013S101 (2012).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Sadilek, A. et al. Privacy-first health research with federated learning. npj Digit. Med. 4<\/b>, 132 (2021).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Sheller, M. J. et al. Federated learning in medicine: facilitating multi-institutional collaborations without sharing patient data. Sci. Rep. 10<\/b>, 12598 (2020).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Sarma, K. V. et al. Federated learning improves site performance in multicenter deep learning without data sharing. J. Am. Med. Inform. Assoc. 28<\/b>, 1259\u20131264 (2021).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Lu, M. Y. et al. Federated learning for computational pathology on gigapixel whole slide images. Med. Image Anal. 76<\/b>, 102298 (2022).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    van Breugel, B., Liu, T., Oglic, D. & van der Schaar, M. Synthetic data in biomedicine via generative artificial intelligence. Nat. Rev. Bioeng. 2<\/b>, 991\u20131004 (2024). This article provides an overview of generative AI methods for biomedical synthetic data generation and highlights their applications, including privacy preservation and data augmentation.<\/b><\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    D\u2019Amico, S. et al. Synthetic data generation by artificial intelligence to accelerate research and precision medicine in hematology. JCO Clin. Cancer Inform. 7<\/b>, e2300021 (2023).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Dahan, C., Christodoulidis, S., Vakalopoulou, M. & Boyd, J. Artifact removal in histopathology images. Preprint at https:\/\/doi.org\/10.48550\/arXiv.2211.16161<\/a> (2022).<\/p>\n<\/li>\n

  • \n

    Jim\u00e9nez-S\u00e1nchez, A., Juodelyte, D., Chamberlain, B. & Cheplygina, V. Detecting shortcuts in medical images \u2014 a case study in chest X-rays. In Proc. 20th International Symposium on Biomedical Imaging (eds Salvado, O. et al.) (IEEE, 2023).<\/p>\n<\/li>\n

  • \n

    Bluethgen, C. et al. A vision\u2013language foundation model for the generation of realistic chest X-ray images. Nat. Biomed. Eng. 9<\/b>, 494\u2013506 (2025).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Chen, R. J., Lu, M. Y., Chen, T. Y., Williamson, D. F. K. & Mahmood, F. Synthetic data in machine learning for medicine and healthcare. Nat. Biomed. Eng. 5<\/b>, 493\u2013497 (2021).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Shaban, M. T., Baur, C., Navab, N. & Albarqouni, S. Staingan: stain style transfer for digital histological images. In Proc. 16th International Symposium on Biomedical Imaging (eds Carbayo, M. et al.) 953\u2013956 (IEEE, 2019).<\/p>\n<\/li>\n

  • \n

    Ktena, I. et al. Generative models improve fairness of medical classifiers under distribution shifts. Nat. Med. 30<\/b>, 1166\u20131173 (2024).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Sagers, L. W. et al. Augmenting medical image classifiers with synthetic data from latent diffusion models. Preprint at https:\/\/doi.org\/10.48550\/arXiv.2308.12453<\/a> (2023).<\/p>\n<\/li>\n

  • \n

    Salimans, T. et al. Improved techniques for training GANs. In Advances in Neural Information Processing Systems (eds Lee, D. et al.) Vol. 29, 2234\u20132242 (Curran Associates, 2016).<\/p>\n<\/li>\n

  • \n

    Naeem, M. F., Oh, S. J., Uh, Y., Choi, Y. & Yoo, J. Reliable fidelity and diversity metrics for generative models. In Proc. 37th International Conference on Machine Learning (eds Daume, H. et al.) Vol. 119, 7176\u20137185 (PMLR, 2020).<\/p>\n<\/li>\n

  • \n

    Jordon, J. et al. Synthetic data \u2014 what, why and how? Preprint at https:\/\/doi.org\/10.48550\/arXiv.2205.03257<\/a> (2022).<\/p>\n<\/li>\n

  • \n

    Lee, J. & Clifton, C. in Information Security (eds Lai, X. et al.) 325\u2013340 (Springer, 2011).<\/p>\n<\/li>\n

  • \n

    Esteban, C., Hyland, S. L. & R\u00e4tsch, G. Real-valued (medical) time series generation with recurrent conditional GANs. Preprint at https:\/\/doi.org\/10.48550\/arXiv.1706.02633<\/a> (2017).<\/p>\n<\/li>\n

  • \n

    Chefer, H. et al. The hidden language of diffusion models. In Proc. 12th International Conference on Learning Representations (eds Kim, B. et al.) 52637\u201352669 (ICLR, 2024).<\/p>\n<\/li>\n

  • \n

    Shen, Y., Gu, J., Tang, X. & Zhou, B. Interpreting the latent space of GANs for semantic face editing. In Proc. IEEE\/CVF Conference on Computer Vision and Pattern Recognition (eds Liu, C. et al.) 9243\u20139252 (IEEE, 2020).<\/p>\n<\/li>\n

  • \n

    Lu, M., Lin, C., Kim, C. & Lee, S.-I. An efficient framework for crediting data contributors of diffusion models. In Proc. 13th International Conference on Learning Representations (eds Yue, Y. et al.) 10072\u201310105 (ICLR, 2025).<\/p>\n<\/li>\n

  • \n

    Zheng, X., Pang, T., Du, C., Jiang, J. & Lin, M. Intriguing properties of data attribution on diffusion models. In Proc 12th International Conference Learning Representations (eds Kim, B. et al.) 18417\u201318452 (ICLR, 2024).<\/p>\n<\/li>\n

  • \n

    Kim, E., Kim, S., Park, M., Entezari, R. & Yoon, S. Rethinking training for de-biasing text-to-image generation: unlocking the potential of stable diffusion. In IEEE\/CVF Conference on Computer Vision and Pattern Recognition Conference 13361\u201313370 (IEEE, 2025).<\/p>\n<\/li>\n

  • \n

    Shrikumar, A., Greenside, P. & Kundaje, A. Learning important features through propagating activation differences. In Proc. 34th International Conference on Machine Learning Vol. 70, 3145\u20133153 (ACM, 2017).<\/p>\n<\/li>\n

  • \n

    Selvaraju, R. R. et al. Grad-CAM: visual explanations from deep networks via gradient-based localization. Int. J. Comput. Vis. 128<\/b>, 336\u2013359 (2020).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Wang, H. et al. Score-CAM: score-weighted visual explanations for convolutional neural networks. In Proc. IEEE\/CVF Conference Computer Vision and Pattern Recognition Workshops (eds Liu, C. et al.) 24\u201325 (IEEE, 2020).<\/p>\n<\/li>\n

  • \n

    Sundararajan, M., Taly, A. & Yan, Q. Axiomatic attribution for deep networks. In International Conference on Machine Learning 3319\u20133328 (PMLR, 2017).<\/p>\n<\/li>\n

  • \n

    Covert, I., Lundberg, S. M. & Lee, S.-I. Explaining by removing: a unified framework for model explanation. J. Mach. Learn. Res. 22<\/b>, 1\u201390 (2021).<\/p>\n

    MathSciNet<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Petsiuk, V., Das, A. & Saenko, K. RISE: randomized input sampling for explanation of black-box models. In British Machine Vision Conference (eds Shum, H. et al.) 151 (BMVA Press, 2018).<\/p>\n<\/li>\n

  • \n

    Fong, R. C. & Vedaldi, A. Interpretable explanations of black boxes by meaningful perturbation. In Proc. IEEE International Conference Computer Vision (Cucchiara, R. et al.) 3449\u20133457 (IEEE, 2017).<\/p>\n<\/li>\n

  • \n

    Ribeiro, M. T., Singh, S. & Guestrin, C. \u2018 Why should I trust you?\u2019 Explaining the predictions of any classifier. In Proc. 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (eds Krishnapuram, B. et al.) 1135\u20131144 (ACM, 2016).<\/p>\n<\/li>\n

  • \n

    Lundberg, S. M. & Lee, S.-I. A unified approach to interpreting model predictions. In Advances in Neural Information Processing Systems (eds Guyon, I. et al.) Vol. 30, 4765\u20134774 (Curran Associates, 2017). This article introduces SHAP, a unified framework that leverages game theory to provide accurate and theoretically grounded feature attributions for interpreting predictions of any machine learning model.<\/b><\/p>\n<\/li>\n

  • \n

    Loh, H. W. et al. Application of explainable artificial intelligence for healthcare: a systematic review of the last decade (2011\u20132022). Comput. Methods Prog. Biomed. 226<\/b>, 107161 (2022).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Jahmunah, V., Ng, E. Y., Tan, R.-S., Oh, S. L. & Acharya, U. R. Explainable detection of myocardial infarction using deep learning models with Grad-CAM technique on ECG signals. Comput. Biol. Med. 146<\/b>, 105550 (2022).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Wu, Y., Zhang, L., Bhatti, U. A. & Huang, M. Interpretable machine learning for personalized medical recommendations: a LIME-based approach. Diagnostics 13<\/b>, 2681 (2023).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Vimbi, V., Shaffi, N. & Mahmud, M. Interpreting artificial intelligence models: a systematic review on the application of LIME and SHAP in Alzheimer\u2019s disease detection. Brain Inf. 11<\/b>, 10 (2024).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Aldughayfiq, B., Ashfaq, F., Jhanjhi, N. & Humayun, M. Explainable AI for retinoblastoma diagnosis: interpreting deep learning models with LIME and SHAP. Diagnostics 13<\/b>, 1932 (2023).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Wang, X. et al. A radiomics model combined with XGBoost may improve the accuracy of distinguishing between mediastinal cysts and tumors: a multicenter validation analysis. Ann. Transl. Med. 9<\/b>, 1737 (2021).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Lundberg, S. M. et al. Explainable machine-learning predictions for the prevention of hypoxaemia during surgery. Nat. Biomed. Eng. 2<\/b>, 749\u2013760 (2018).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Beebe-Wang, N. et al. Unified AI framework to uncover deep interrelationships between gene expression and Alzheimer\u2019s disease neuropathologies. Nat. Commun. 12<\/b>, 5369 (2021).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Qiu, W., Chen, H., Kaeberlein, M. & Lee, S.-I. ExplaiNAble BioLogical Age (ENABL Age): an artificial intelligence framework for interpretable biological age. Lancet Healthy Longev. 4<\/b>, e711\u2013e723 (2023).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Dombrowski, A.-K. et al. Explanations can be manipulated and geometry is to blame. In Advances in Neural Information Processing Systems (eds Larochelle, H. et al.) Vol. 32 (Curran Associates, 2019).<\/p>\n<\/li>\n

  • \n

    Adebayo, J. et al. Sanity checks for saliency maps. In Advances in Neural Information Processing Systems (eds Bengio, S. et al.) Vol. 31, 9525\u20139536 (Curran Associates, 2018).<\/p>\n<\/li>\n

  • \n

    Jethani, N., Sudarshan, M., Covert, I. C., Lee, S.-I. & Ranganath, R. FastShap: real-time Shapley value estimation. In Proc. International Conference on Learning Representations (ICLR, 2021).<\/p>\n<\/li>\n

  • \n

    Covert, I. & Lee, S.-I. Improving KernelShap: practical Shapley value estimation using linear regression. In International Conference on Artificial Intelligence and Statistics (eds Banerjee, A. et al.) 3457\u20133465 (PMLR, 2021).<\/p>\n<\/li>\n

  • \n

    Lundberg, S. M. et al. From local explanations to global understanding with explainable AI for trees. Nat. Mach. Intell. 2<\/b>, 56\u201367 (2020).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Covert, I. C., Kim, C. & Lee, S.-I. Learning to estimate Shapley values with vision transformers. In Proc. 11th International Conference on Learning Representations (eds Wang, M. et al.) (ICLR, 2023).<\/p>\n<\/li>\n

  • \n

    Lipton, Z. C. The mythos of model interpretability: in machine learning, the concept of interpretability is both important and slippery. Queue 16<\/b>, 31\u201357 (2018).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Ghassemi, M., Oakden-Rayner, L. & Beam, A. L. The false hope of current approaches to explainable artificial intelligence in health care. Lancet Digit. Health 3<\/b>, e745\u2013e750 (2021).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Daneshjou, R., Yuksekgonul, M., Cai, Z. R., Novoa, R. A. & Zou, J. SkinCon: a skin disease dataset densely annotated by domain experts for fine-grained debugging and analysis. In Advances in Neural Information Processing Systems (eds Koyejo, S. et al.) Vol. 35, 18157\u201318167 (Curran Associates, 2022).<\/p>\n<\/li>\n

  • \n

    Tsao, H. et al. Early detection of melanoma: reviewing the ABCDEs. J. Am. Acad. Dermatol. 72<\/b>, 717\u2013723 (2015).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Chen, Z., Bei, Y. & Rudin, C. Concept whitening for interpretable image recognition. Nat. Mach. Intell. 2<\/b>, 772\u2013782 (2020).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Crabb\u00e9, J. & van der Schaar, M. Concept activation regions: a generalized framework for concept-based explanations. In Advances in Neural Information Processing Systems (eds Koyejo, S. et al.) Vol. 35 (Curran Associates, 2022).<\/p>\n<\/li>\n

  • \n

    Kim, B. et al. Interpretability beyond feature attribution: quantitative testing with concept activation vectors (TCAV). In Proc. 35th International Conference on Machine Learning (Dy, J. et al.) 2668\u20132677 (PMLR, 2018). This article introduces the TCAV method to interpret an AI model\u2019s behaviour in terms of high-level, human-friendly concepts using directional derivatives.<\/b><\/p>\n<\/li>\n

  • \n

    Janik, A., Dodd, J., Ifrim, G., Sankaran, K. & Curran, K. Interpretability of a deep learning model in the application of cardiac MRI segmentation with an ACDC challenge dataset. In Medical Imaging 2021: Image Processing (eds Isgum, I. & Landman, B.) Vol. 11596, 861\u2013872 (SPIE, 2021).<\/p>\n<\/li>\n

  • \n

    Mincu, D. et al. Concept-based model explanations for electronic health records. In Proc. Conference on Health, Inference and Learning (eds Naumann, T. & Pierson, E.) 36\u201346 (PMLR, 2021).<\/p>\n<\/li>\n

  • \n

    Ghorbani, A., Wexler, J., Zou, J. Y. & Kim, B. Towards automatic concept-based explanations. In Advances in Neural Information Processing Systems (ed. Larochelle, H.) Vol. 32 (Curran Associates, 2019).<\/p>\n<\/li>\n

  • \n

    Radford, A. et al. Learning transferable visual models from natural language supervision. In International Conference on Machine Learning (eds Meila, M. & Zhang T.) 8748\u20138763 (PMLR, 2021).<\/p>\n<\/li>\n

  • \n

    Kim, C. et al. Transparent medical image AI via an image\u2013text foundation model grounded in medical literature. Nat. Med. 30<\/b>, 1154\u20131165 (2024).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Lu, M. Y. et al. A visual-language foundation model for computational pathology. Nat. Med. 30<\/b>, 863\u2013874 (2024).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Zhang Sheng et al. A multimodal biomedical foundation model trained from fifteen million image\u2013text pairs. NEJM AI 2<\/b>, AIoa2400640 (2025).<\/p>\n


    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Huang, Z., Bianchi, F., Yuksekgonul, M., Montine, T. J. & Zou, J. A visual\u2013language foundation model for pathology image analysis using medical twitter. Nat. Med. 29<\/b>, 2307\u20132316 (2023).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Ikezogwo, W. et al. Quilt-1m: One million image-text pairs for histopathology. In Advances in Neural Information Processing Systems (eds Fan, A. et al.) Vol. 36 (Curran Associates, 2023).<\/p>\n<\/li>\n

  • \n

    Dunlap, L. et al. Describing differences in image sets with natural language. In Proc. IEEE\/CVF Conference on Computer Vision and Pattern Recognition (eds Akata, Z. et al.) 24199\u201324208 (IEEE, 2024).<\/p>\n<\/li>\n

  • \n

    Li, J., Li, D., Savarese, S. & Hoi, S. Blip-2: bootstrapping language-image pre-training with frozen image encoders and large language models. In International Conference on Machine Learning (eds Brunskill, E. et al.) 19730\u201319742 (PMLR, 2023).<\/p>\n<\/li>\n

  • \n

    Verma, S., Dickerson, J. & Hines, K. Counterfactual explanations for machine learning: a review. In ACM Computing Surveys (eds Atienza, D & Milano M.) Vol. 56 (2024). This article reviews counterfactual explanation methods, highlighting their utility and key challenges.<\/b><\/p>\n<\/li>\n

  • \n

    Lang, O. et al. Explaining in style: training a GAN to explain a classifier in stylespace. In Proc. IEEE\/CVF International Conference on Computer Vision (eds Hassner, T. et al.) 693\u2013702 (IEEE, 2021).<\/p>\n<\/li>\n

  • \n

    Singla, S., Pollack, B., Chen, J. & Batmanghelich, K. Explanation by progressive exaggeration. In Proc. International Conference on Learning Representations (eds Song, D. et al.) (PMLR,2020).<\/p>\n<\/li>\n

  • \n

    DeGrave, A. J., Cai, Z. R., Janizek, J. D., Daneshjou, R. & Lee, S.-I. Auditing the inference processes of medical-image classifiers by leveraging generative AI and the expertise of physicians. Nat. Biomed. Eng. 9<\/b>, 294\u2013306 (2023).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Gadgil, S. U., DeGrave, A. J., Daneshjou, R. & Lee, S.-I. Discovering mechanisms underlying medical AI prediction of protected attributes. Preprint at medRxiv https:\/\/doi.org\/10.1101\/2024.04.09.24305289<\/a> (2024).<\/p>\n<\/li>\n

  • \n

    Lang, O. et al. Using generative AI to investigate medical imagery models and datasets. eBioMedicine 102<\/b>, 105075 (2024).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Molnar, C. A guide for making black box models explainable. Github https:\/\/christophm.github.io\/interpretable-ml-book\/<\/a> (2018).<\/p>\n<\/li>\n

  • \n

    Quinlan, J. R. Induction of decision trees. Mach. Learn. 1<\/b>, 81\u2013106 (1986).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Bennett, K. P. & Blue, J. A. Optimal decision trees. Rensselaer Polytech. Inst. Math. Rep. 214<\/b>, 128 (1996).<\/p>\n


    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Hastie, T. J. Generalized additive models. In Statistical Models in S 249\u2013307 (Routledge. 2017).<\/p>\n<\/li>\n

  • \n

    Lou, Y., Caruana, R., Gehrke, J. & Hooker, G. Accurate intelligible models with pairwise interactions. In Proc. 19th ACM SIGKDD International Conference Knowledge Discovery and Data Mining 623\u2013631 (ACM, 2013).<\/p>\n<\/li>\n

  • \n

    Semenova, L., Rudin, C. & Parr, R. On the existence of simpler machine learning models. In Proc. ACM Conference on Fairness, Accountability and Transparency (eds Borgesius, F. et al.) 1827\u20131858 (ACM, 2022).<\/p>\n<\/li>\n

  • \n

    Mohammadjafari, S., Cevik, M., Thanabalasingam, M., Basar, A. & Alzheimer\u2019s Disease Neuroimaging Initiative. Using ProtoPNet for interpretable Alzheimer\u2019s disease classification. In Proc. 34th Canadian Conference on Artificial Intelligence (CAIAC, 2021).<\/p>\n<\/li>\n

  • \n

    Barnett, A. J. et al. A case-based interpretable deep learning model for classification of mass lesions in digital mammography. Nat. Mach. Intell. 3<\/b>, 1061\u20131070 (2021).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Koh, P. W. et al. Concept bottleneck models. In International Conference on Machine Learning (eds Daume, H. & Singh, A.) 5338\u20135348 (PMLR, 2020). This article introduces a class of interpretable models that first predict human-understandable concepts before making final predictions, allowing users to inspect, intervene on and debug model output through these intermediate concepts.<\/b><\/p>\n<\/li>\n

  • \n

    Lanchantin, J., Wang, T., Ordonez, V. & Qi, Y. General multi-label image classification with transformers. In Proc. IEEE\/CVF Conference on Computer Vision and Pattern Recognition (eds Forsyth, D. et al.) 16478\u201316488 (IEEE, 2021).<\/p>\n<\/li>\n

  • \n

    Jeyakumar, J. V. et al. Automatic concept extraction for concept bottleneck-based video classification. Preprint at https:\/\/doi.org\/10.48550\/arXiv.2206.10129<\/a> (2022).<\/p>\n<\/li>\n

  • \n

    Sun, X. et al. Interpreting deep learning models in natural language processing: a review. Preprint at https:\/\/doi.org\/10.48550\/arXiv.2110.10470<\/a> (2021).<\/p>\n<\/li>\n

  • \n

    Klimiene, U. et al. Multiview concept bottleneck models applied to diagnosing pediatric appendicitis. In 2nd Workshop on Interpretable Machine Learning in Healthcare (eds Jin, W. et al.) (ICML, 2022).<\/p>\n<\/li>\n

  • \n

    Wu, C., Parbhoo, S., Havasi, M. & Doshi-Velez, F. Learning optimal summaries of clinical time-series with concept bottleneck models. In Machine Learning for Healthcare Conference 648\u2013672 (PMLR, 2022).<\/p>\n<\/li>\n

  • \n

    Y\u00fcksekg\u00f6n\u00fcl, M., Wang, M. & Zou, J. Post-hoc concept bottleneck models. In Proc. 11th International Conference on Learning Representations (eds Nickel, M. et al.) (PMLR, 2023).<\/p>\n<\/li>\n

  • \n

    Yang, X. et al. A large language model for electronic health records. npj Digit. Med. 5<\/b>, 194 (2022).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Li, C. et al. LLaVA-med: training a large language-and-vision assistant for biomedicine in one day. In Advances in Neural Information Processing Systems (Fan, A. et al.) Vol. 37 (Curran Associates, 2024).<\/p>\n<\/li>\n

  • \n

    Jin, D. et al. What disease does this patient have? A large-scale open domain question answering dataset from medical exams. Appl. Sci. 11<\/b>, 6421 (2021).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Singhal, K. et al. Toward expert-level medical question answering with large language models. Nat. Med. 31<\/b>, 943\u2013950 (2025).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Gilbert, S., Harvey, H., Melvin, T., Vollebregt, E. & Wicks, P. Large language model AI chatbots require approval as medical devices. Nat. Med. 29<\/b>, 2396\u20132398 (2023).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Moor, M. et al. Foundation models for generalist medical artificial intelligence. Nature 616<\/b>, 259\u2013265 (2023). This article introduces a paradigm for medical AI, referred to as generalist medical AI, which encompasses models trained using self-supervision that can carry out a diverse set of tasks using little or no task-specific labelled data.<\/b><\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Chowdhery, A. et al. PaLM: scaling language modeling with pathways. J. Mach. Learn. Res. 24<\/b>, 1\u2013113 (2023).<\/p>\n


    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Huang, S., Mamidanna, S., Jangam, S., Zhou, Y. & Gilpin, L. H. Can large language models explain themselves? A study of LLM-generated self-explanations. Preprint at https:\/\/doi.org\/10.48550\/arXiv.2310.11207<\/a> (2023).<\/p>\n<\/li>\n

  • \n

    Wei, J. et al. Chain-of-thought prompting elicits reasoning in large language models. In Advances in Neural Information Processing Systems (eds Koyejo, S. et al.) Vol. 35, 24824\u201324837 (Curran Associates, 2022).<\/p>\n<\/li>\n

  • \n

    Madsen, A., Chandar, S. & Reddy, S. Are self-explanations from large language models faithful? In Findings of the Association for Computational Linguistics (eds Ku, L.-W. et al.) 295\u2013337 (ACL, 2024).<\/p>\n<\/li>\n

  • \n

    Turpin, M., Michael, J., Perez, E. & Bowman, S. R. Language models don\u2019t always say what they think: unfaithful explanations in chain-of-thought prompting. In Advances in Neural Information Processing Systems (eds Oh, A. et al.) Vol. 36, 74952\u201374965 (Curran Associates, 2023).<\/p>\n<\/li>\n

  • \n

    Agarwal, C., Tanneru, S. H. & Lakkaraju, H. Faithfulness vs. plausibility: on the (un)reliability of explanations from large language models. Preprint at https:\/\/doi.org\/10.48550\/arXiv.2402.04614<\/a> (2024).<\/p>\n<\/li>\n

  • \n

    Madsen, A., Lakkaraju, H., Reddy, S. & Chandar, S. Interpretability needs a new paradigm. Preprint at https:\/\/doi.org\/10.48550\/arXiv.2405.05386<\/a> (2024).<\/p>\n<\/li>\n

  • \n

    Peng, Z. et al. Grounding multimodal large language models to the world. In International Conference on Representation Learning (eds Kim, B. et al.) 51575\u201351598 (ICLR, 2024).<\/p>\n<\/li>\n

  • \n

    Huben, R., Cunningham, H., Smith, L., Ewart, A. & Sharkey, L. Sparse autoencoders find highly interpretable features ln Language models. In International Conference on Representation Learning (eds Kim, B. et al.) 7827\u20137845 (ICLR, 2024).<\/p>\n<\/li>\n

  • \n

    Bills, S. et al. Language models can explain neurons in language models. OpenAI https:\/\/openaipublic.blob.core.windows.net\/neuron-explainer\/paper\/index.html<\/a> (2023).<\/p>\n<\/li>\n

  • \n

    Templeton, A. et al. Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnet (Transformer Circuit, 2024).<\/p>\n<\/li>\n

  • \n

    Conmy, A., Mavor-Parker, A. N., Lynch, A., Heimersheim, S. & Garriga-Alonso, A. Towards automated circuit discovery for mechanistic interpretability. In Proc. 37th International Conference on Neural Information Processing Systems (eds Globerson, A. et al.) 16318\u201316352 (Curran Associates, 2023).<\/p>\n<\/li>\n

  • \n

    Simon, E. & Zou, J. InterPLM: discovering interpretable features in protein language models via sparse autoencoders. Preprint at bioRxiv https:\/\/doi.org\/10.1101\/2024.11.14.623630<\/a> (2024).<\/p>\n<\/li>\n

  • \n

    Zhong, H. et al. Copyright protection and accountability of generative AI: attack, watermarking and attribution. In Companion Proc. ACM Web Conference (eds Aroyo, L. et al.) 94\u201398 (ACM, 2023).<\/p>\n<\/li>\n

  • \n

    Liu, Y. et al. Trustworthy LLMs: a survey and guideline for evaluating large language models\u2019 alignment. Preprint at https:\/\/doi.org\/10.48550\/arXiv.2308.05374<\/a> (2024).<\/p>\n<\/li>\n

  • \n

    Huang, Y. et al. Position: TRUSTLLM: trustworthiness in large language models. In Proc. 41st International Conference on Machine Learning (eds Heller, K. et al.) 20166\u201320270 (PMLR, 2024).<\/p>\n<\/li>\n

  • \n

    Li, D. et al. A survey of large language models attribution. Preprint at https:\/\/doi.org\/10.48550\/arXiv.2311.03731<\/a> (2023).<\/p>\n<\/li>\n

  • \n

    Gao, L. et al. RARR: researching and revising what language models say, using language models. In Proc. 61st Annual Meeting of the Association for Computational Linguistics Vol. 1, 16477\u201316508 (ACL, 2023).<\/p>\n<\/li>\n

  • \n

    Guu, K. et al. Simfluence: modeling the influence of individual training examples by simulating training runs. Preprint at https:\/\/doi.org\/10.48550\/arXiv.2303.08114<\/a> (2023).<\/p>\n<\/li>\n

  • \n

    Gao, Y. et al. Retrieval-augmented generation for large language models: a survey. Preprint at https:\/\/doi.org\/10.48550\/arXiv.2312.10997<\/a> (2024).<\/p>\n<\/li>\n

  • \n

    Lewis, P. et al. Retrieval-augmented generation for knowledge-intensive NLP 1144 tasks. In Advances in Neural Information Processing Systems (ed Ranzato, M.) Vol. 33, 9459\u20139474 (Curran Associates, 2020).<\/p>\n<\/li>\n

  • \n

    Ancona, M., Ceolini, E., \u00d6ztireli, C. & Gross, M. Towards better understanding of gradient-based attribution methods for deep neural networks. In Proc. 6th International Conference on Learning Representations (eds Murray, I. et al.) (PMLR, 2018).<\/p>\n<\/li>\n

  • \n

    Hooker, S., Erhan, D., Kindermans, P.-J. & Kim, B. A benchmark for interpretability methods in deep neural networks. In Proc. 33rd International Conference on Neural Information Processing Systems (ed. Larochelle, H.) 9737\u20139748 (Curran Associates, 2019).<\/p>\n<\/li>\n

  • \n

    Zhang, J., Lin, Z., Brandt, J., Shen, X. & Sclaroff, S. Top-down neural attention by excitation backprop. In Computer Vision 14th European Conference Proc. IV (eds Leibe, B. et al.) 543\u2013559 (Springer, 2016).<\/p>\n<\/li>\n

  • \n

    Beede, E. et al. A human-centered evaluation of a deep learning system deployed in clinics for the detection of diabetic retinopathy. In Proc. 2020 CHI Conference on Human Factors in Computing Systems (eds Bernhaupt, R. et al.) (ACM, 2020).<\/p>\n<\/li>\n

  • \n

    Wang, B. et al. AI-assisted CT imaging analysis for COVID-19 screening: Building and deploying a medical AI system. Appl. Soft. Comput. 98<\/b>, 106897 (2021).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Jotterand, F. & Bosco, C. Keeping the \u201chuman in the loop\u201d in the age of artificial intelligence: accompanying commentary for \u201ccorrecting the brain?\u201d by Rainey and Erden. Sci. Eng. Ethics 26<\/b>, 2455\u20132460 (2020).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Bakken, S. AI in health: keeping the human in the loop. J. Am. Med. Inform. Assoc. 30<\/b>, 1225\u20131226 (2023).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Kostick-Quenet, K. M. & Gerke, S. AI in the hands of imperfect users. npj Digit. Med. 5<\/b>, 197 (2022).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Wu, J. T. et al. AI accelerated human-in-the-loop structuring of radiology reports. In AMIA Annual Symposium Proc. (eds Wilcox, A. et al.) 1305\u20131314 (AMIA, 2021).<\/p>\n<\/li>\n

  • \n

    US Food and Drug Administration. Transparency for Machine Learning-Enabled Medical Devices: Guiding Principles (2021). These guidelines outline principles jointly developed by multiple regulatory agencies to promote transparency, explainability and human-centred design in machine-learning-enabled medical devices.<\/b><\/p>\n<\/li>\n

  • \n

    Marchetti, M. A. et al. Prospective validation of dermoscopy-based open-source artificial intelligence for melanoma diagnosis (PROVE-AI study). npj Digit. Med. 6<\/b>, 127 (2023).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Dembrower, K., Crippa, A., Col\u00f3n, E., Eklund, M. & Strand, F. Artificial intelligence for breast cancer detection in screening mammography in Sweden: a prospective, population-based, paired-reader, non-inferiority study. Lancet Digit. Health 5<\/b>, e703\u2013e711 (2023).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Elhakim, M. T. et al. AI-integrated screening to replace double reading of mammograms: a population-wide accuracy and feasibility study. Radiol. Artif. Intell. 6<\/b>, e230529 (2024).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Sridharan, S. et al. Real-world evaluation of an AI triaging system for chest X-rays: a prospective clinical study. Eur. J. Radiol. 181<\/b>, 111783 (2024).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Patel, M. R., Balu, S. & Pencina, M. J. Translating AI for the clinician. JAMA 332<\/b>, 1701\u20131702 (2024).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Steidl, M., Felderer, M. & Ramler, R. The pipeline for the continuous development of artificial intelligence models \u2014 current state of research and practice. J. Syst. Softw. 199<\/b>, 111615 (2023).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Feng, J. et al. Clinical artificial intelligence quality improvement: towards continual monitoring and updating of AI algorithms in healthcare. npj Digit. Med. 5<\/b>, 66 (2022).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Shah, N. H., Pfeffer, M. A. & Ghassemi, M. The need for continuous evaluation of artificial intelligence prediction algorithms. JAMA Netw. Open. 7<\/b>, e2433009 (2024).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Vokinger, K. N., Feuerriegel, S. & Kesselheim, A. S. Continual learning in medical devices: FDA\u2019s action plan and beyond. Lancet Digit. Health 3<\/b>, e337\u2013e338 (2021).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Bouderhem, R. Shaping the future of AI in healthcare through ethics and governance. Human. Soc. Sci. Commun. 11<\/b>, 416 (2024).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Joshi, G. et al. FDA-approved artificial intelligence and machine learning (AI\/ML)-enabled medical devices: an updated landscape. Electronics 13<\/b>, 498 (2024).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    US Food and Drug Administration. Artificial Intelligence and Machine Learning in Software as a Medical Device (2021).<\/p>\n<\/li>\n

  • \n

    US Food and Drug Administration. Total Product Life Cycle for Medical Device (2023).<\/p>\n<\/li>\n

  • \n

    US Food and Drug Administration. Proposed Regulatory Framework for Modifications to Artificial Intelligence\/Machine Learning (AI\/ML)-based Software as a Medical Device (SaMD) \u2014 Discussion Paper and Request for Feedback (2019).<\/p>\n<\/li>\n

  • \n

    US Food and Drug Administration. Good Machine Learning Practice for Medical Device Development: Guiding Principles (2025).<\/p>\n<\/li>\n

  • \n

    Mesk\u00f3, B. & Topol, E. J. The imperative for regulatory oversight of large language models (or generative AI) in healthcare. npj Digit. Med. 6<\/b>, 120 (2023).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Minssen, T., Vayena, E. & Cohen, I. G. The challenges for regulating medical use of ChatGPT and other large language models. JAMA 330<\/b>, 315\u2013316 (2023).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Groeneveld, D. et al. OLMo: accelerating the science of language models. In Proc. 62nd Annual Meeting Association for Computational Linguistics (eds Ku, L.-W. et al.) 15789\u201315809 (ACL, 2024).<\/p>\n<\/li>\n

  • \n

    Riedemann, L., Labonne, M. & Gilbert, S. The path forward for large language models in medicine is open. npj Digit. Med. 7<\/b>, 339 (2024).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Kanter, G. P. & Packel, E. A. Health care privacy risks of AI chatbots. JAMA 330<\/b>, 311\u2013312 (2023).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Hsieh, C.-Y. et al. Distilling step-by-step! Outperforming larger language models with less training data and smaller model sizes. In Findings of the Association for Computational Linguistics (eds Rogers, A. et al.) 8003\u20138017 (ACL, 2023).<\/p>\n<\/li>\n

  • \n

    Kim, S. et al. SqueezeLLM: dense-and-sparse quantization. In Proc. 41st International Conference on Machine Learning (PMLR, 2024).<\/p>\n<\/li>\n

  • \n

    Dettmers, T., Lewis, M., Belkada, Y. & Zettlemoyer, L. GPT3.int8(): 8-bit matrix multiplication for transformers at scale. In Advances in Neural Information Processing Systems (eds Koyejo, S. et al.) Vol. 35, 30318\u201330332 (Curran Associates, 2022).<\/p>\n<\/li>\n

  • \n

    Blumenthal D. & Patel B. The regulation of clinical artificial intelligence. NEJM AI 1<\/b>, aIpc2400545 (2024).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Covert, I. C., Kim, C., Lee, S.-I., Zou, J. & Hashimoto, T. Stochastic amortization: a unified approach to accelerate feature and data attribution. In Advances in Neural Information Processing Systems (eds Globerson, A. et al.) Vol. 37, 4374\u20134423 (Curran Associates, 2024).<\/p>\n<\/li>\n

  • \n

    Li, W. & Yu, Y. Faster approximation of probabilistic and distributional values via least squares. In International Conference on Representation Learning (eds Kim, B. et al.) 51182\u201351216 (ICLR,2024).<\/p>\n<\/li>\n

  • \n

    Park, S. M., Georgiev, K., Ilyas, A., Leclerc, G. & Madry, A. TRAK: attributing model behavior at scale. In Proc. 40th International Conference on Machine Learning (eds Krause, A. et al.) Vol. 202, 27074\u201327113 (PMLR, 2023).<\/p>\n<\/li>\n

  • \n

    Mekki, Y. M. & Zughaier, S. M. Teaching artificial intelligence in medicine. Nat. Rev. Bioeng. 2<\/b>, 450\u2013451 (2024).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Mohamed, M. M., Mahesh, T. R., Vinoth, K. V. & Suresh, G. Enhancing brain tumor detection in MRI images through explainable AI using Grad-CAM with Resnet 50. BMC Med. Imaging 24<\/b>, 107 (2024).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Panwar, H. et al. A deep learning and grad-CAM based color visualization approach for fast detection of COVID-19 cases using chest X-ray and CT-Scan images. Chaos Solitons Fractals 140<\/b>, 110190 (2020).<\/p>\n

    Article<\/a>\u00a0
    \n     MathSciNet<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Gildenblat, J. et al. PyTorch Library for CAM Methods. Github https:\/\/github.com\/jacobgil\/pytorch-grad-cam<\/a> (2021).<\/p>\n<\/li>\n

  • \n

    Erion, G., Janizek, J. D., Sturmfels, P., Lundberg, S. M. & Lee, S.-I. Improving performance of deep learning models with axiomatic attribution priors and expected gradients. Nat. Mach. Intell. 3<\/b>, 620\u2013631 (2021).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Chen, C. et al. This looks like that: deep learning for interpretable image recognition. In Advances in Neural Information Processing Systems (eds Wallach, H. et al.) Vol. 32, 8928\u20138939 (Curran Associates, 2019).<\/p>\n<\/li>\n

  • \n

    Kim, Y., Wu, J., Abdulle, Y. & Wu, H. MedExQA: medical question answering benchmark with multiple explanations. In Proc. 23rd Workshop on Biomedical Natural Language Processing (eds Demner-Fushman, D. et al.) 167\u2013181 (ACL, 2024).<\/p>\n<\/li>\n

  • \n

    Lindsey, J. et al. On the Biology of a Large Language Model (Transformer Circuits, 2025).<\/p>\n<\/li>\n

  • \n

    Meng, K., Bau, D., Andonian, A. & Belinkov, Y. Locating and editing factual associations in GPT. In Advances in Neural Information Processing Systems (eds Koyejo, S. et al.) Vol. 35, 17359\u201317372 (Curran Associates, 2022).<\/p>\n<\/li>\n

  • \n

    Zakka, C. et al. Almanac \u2014 retrieval-augmented language models for clinical medicine. NEJM AI 1<\/b>, AIoa2300068 (2024).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Kim, J., Hur, M. & Min, M. From RAG to QA-RAG: integrating generative AI for pharmaceutical regulatory compliance process. In Proc. 40th ACM\/SIGAPP Symposium on Applied Computing 1293\u20131295 (ACM, 2025).<\/p>\n<\/li>\n

  • \n

    Fleckenstein, M. et al. Age-related macular degeneration. Nat. Rev. Dis. Prim.7<\/b>, 31 (2021).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Ai, L., Usman, M. & Lu, H. Experimental study of cerebral edema and expression of VEGF and AQP4 in the penumbra area of rat brain trauma. Sci. Rep. 15<\/b>, 17040 (2025).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    Gerke, S., Babic, B., Evgeniou, T. & Cohen, I. G. The need for a system view to regulate artificial intelligence\/machine learning-based software as medical device. npj Digit. Med. 3<\/b>, 53 (2020).<\/p>\n

    Article<\/a>\u00a0
    \n
    \n Google Scholar<\/a>\u00a0\n <\/p>\n<\/li>\n

  • \n

    116th Congress (2019-2020). H.R.6216 \u2014 National Artificial Intelligence Initiative Act of 2020; https:\/\/www.congress.gov\/bill\/116th-congress\/house-bill\/6216<\/a> (2020).<\/p>\n<\/li>\n

  • \n

    World Health Organization. Ethics and Governance of Artificial Intelligence for Health (2021).<\/p>\n<\/li>\n

  • \n

    European Union. Regulation (EU) 2016\/679 of the European Parliament and of the Council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data, and repealing Directive 95\/46\/EC (General Data Protection Regulation) (2016).<\/p>\n<\/li>\n

  • \n

    European Commission. European Health Data Space Regulation (EHDS) (2025).<\/p>\n<\/li>\n

  • \n

    van Smeden, M. et al. Guideline for High-Quality Diagnostic and Prognostic Applications of AI in Healthcare (Ministry of Health, Welfare and Sport, 2021).<\/p>\n<\/li>\n

  • \n

    European Commission. Ethics Guidelines for Trustworthy AI (2019).<\/p>\n<\/li>\n","protected":false},"excerpt":{"rendered":"Rajpurkar, P. & Lungren, M. P. The current and future state of AI interpretation of medical images. N.…\n","protected":false},"author":2,"featured_media":56700,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[275],"tags":[13460,18,135,475,474,19,17,4481],"class_list":{"0":"post-56699","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-healthcare","8":"tag-biomedical-engineering-and-bioengineering","9":"tag-eire","10":"tag-health","11":"tag-health-care","12":"tag-healthcare","13":"tag-ie","14":"tag-ireland","15":"tag-medical-research"},"share_on_mastodon":{"url":"","error":""},"_links":{"self":[{"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/posts\/56699","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/comments?post=56699"}],"version-history":[{"count":0,"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/posts\/56699\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/media\/56700"}],"wp:attachment":[{"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/media?parent=56699"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/categories?post=56699"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/tags?post=56699"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}