![\"chatgpt\"](\"https:\/\/www.europesays.com\/ai\/wp-content\/uploads\/2026\/04\/chatgpt-2.jpg\" "\\"Credit:")
<\/p>\n <\/p>\n
Credit: Matheus Bertelli from Pexels<\/p>\n
Language models like ChatGPT are not neutral. Without our realizing it, they can absorb all kinds of bias\u2014for example, around gender and ethnicity\u2014which then become increasingly embedded in the model. According to AI researcher Oskar van der Wal, we need different kinds of measurements to detect these biases so that they can be removed from the models. In his doctoral thesis<\/a>, he shows how this can be done. On 29 April, he will defend his thesis at the University of Amsterdam.<\/p>\n Language models are often seen as neutral tools, but in practice they can both reflect and amplify bias.<\/p>\n “Users often don’t realize that a model makes certain assumptions, for example by introducing subtle differences in how men and women are described,” says Van der Wal. Precisely because bias is so hidden, it can spread unnoticed and color the way we see the world.<\/p>\n Bias is hard to measure<\/p>\n An important problem is that bias<\/a> is difficult to measure. “Many existing measurement methods are fairly abstract and don’t take practice into account. They might look for overt stereotypes in what the model says, such as “The Dutch are stingy.” But in practice, bias isn’t something that’s directly visible. It depends on the context in which you use the model.”<\/p>\n Van der Wal cites the use of AI in health care as an example. “AI<\/a> learns from existing data. If those data contain outdated or incorrect assumptions\u2014for instance, the contested idea that certain diseases are linked to the outdated concept of “race”\u2014the model may keep reproducing them. In health care, that can lead to incorrect diagnoses or treatments.”<\/p>\n Another example is when medical data<\/a> largely derives from research involving men. “AI may then interpret women’s symptoms differently or less seriously, or make different risk assessments.”<\/p>\n Realistic scenarios<\/p>\n To discover whether realistic scenarios reveal different errors than simple tests, Van der Wal presented language models with a range of medical cases and asked them to provide diagnoses, risk assessments or advice. “We repeatedly changed the patient’s ethnicity. That way we could identify whether and how the model responded differently.”<\/p>\n Subtle but consistent differences appeared in the outcomes, differences that remained invisible in standard tests. “Precisely because our scenarios were close to practice, it became clear how bias can influence medical decision-making.”<\/p>\n Model reinforces patterns in the data<\/p>\n Van der Wal also investigated what happens inside a language model during training. He followed, step by step, how the model learns to store information. “During training, the model learns which words and ideas frequently occur together. If “doctor” often appears together with “he” and “nurse” with “she” in the training data, the model will pick up on those associations.”<\/p>\n Over time, the model appeared to store this information in increasingly specific places<\/a>, thereby reinforcing gender bias. “Bias doesn’t arise only from the data that AI is trained on, but also from the way the model structures that information.”<\/p>\n There are solutions<\/p>\n Unfortunately, you can’t fix bias in language models with a single trick. But, according to Van der Wal, targeted interventions can help. “If you know where in the model the bias is located, you can address those areas. This already seems to work in specific cases, but more research is needed to extend the approach to more complex forms of bias.”<\/p>\n Van der Wal tested this targeted approach by comparing a model before and after an adjustment in which the model was trained not to adopt identified gender-related biases. He wanted to see if the model responded less differently to men and women after the change, and how well it still performed ordinary tasks, such as generating text.<\/p>\n The bias decreased, while the quality of the model largely remained intact.<\/p>\n Careful and deliberate<\/p>\n The impact of AI is not restricted to the technical realm but now has broader societal relevance. “We are becoming increasingly dependent on systems that can influence how we think,” says Van der Wal. “That’s precisely why it’s important to develop AI carefully. Responsible AI development requires interventions at multiple levels at once: in the data, during training, targeted within the model itself, and also in its deployment and use.”<\/p>\n More information <\/p>\n Taking a step back: Measuring and mitigating bias in language models. www.dare.uva.nl\/id\/b3b89c60-7b \u2026 69-a95d-5edafec1eb3c<\/a><\/p>\n \t\t\t\t\t\t\t\t\t\t\t\tKey concepts Provided by \t\t\t\t\t\t\t\t\t\t\t\t\t<\/a><\/p>\n \n Citation: \n This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no
\n\t\t\t\t\t\t\t\t\t\t\t\tLarge language models<\/a>AI alignment<\/a>\t\t\t\t\t\t\t\t\t\t\t<\/p>\n
\n University of Amsterdam<\/a>
\n \t\t\t\t\t\t\t\t\t\t\t\t\t<\/p>\n
\n Sharper bias tests could help stop ChatGPT from amplifying hidden stereotypes (2026, April 22)
\n retrieved 22 April 2026
\n from https:\/\/techxplore.com\/news\/2026-04-sharper-bias-chatgpt-amplifying-hidden.html\n <\/p>\n
\n part may be reproduced without the written permission. The content is provided for information purposes only.\n <\/p>\n","protected":false},"excerpt":{"rendered":"Credit: Matheus Bertelli from Pexels Language models like ChatGPT are not neutral. Without our realizing it, they can…\n","protected":false},"author":2,"featured_media":12893,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[7],"tags":[580,2116,2113,2114,963,684,2115,157],"class_list":{"0":"post-12892","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-openai","8":"tag-chatgpt","9":"tag-computer-news","10":"tag-hi-tech-news","11":"tag-hitech","12":"tag-information-technology","13":"tag-innovation","14":"tag-inventions","15":"tag-openai"},"_links":{"self":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts\/12892","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/comments?post=12892"}],"version-history":[{"count":0,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts\/12892\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/media\/12893"}],"wp:attachment":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/media?parent=12892"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/categories?post=12892"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/tags?post=12892"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}