![\"AI](\"https:\/\/www.europesays.com\/ai\/wp-content\/uploads\/2026\/08\/1786453486_584_0x0.jpg\")
<\/p>\n<\/p>\n
A 2026 study found that AI tools invented new biases about demographic groups during employee hiring tasks, even when the AI was trained on neutral data. As a result, the AI tools segregated different groups into different job categories even more than humans performing the same hiring task.<\/p>\n
getty<\/p>\n
Nearly nine out of ten companies use artificial intelligence tools in employee hiring, according to 2025 World Economic Forum data. At the same time, growing evidence<\/a> reveals the risk of AI tools replicating human biases from their training materials based on race, gender, age, disability and other characteristics. As the saying goes, \u201cgarbage in, garbage out.\u201d But a new study reveals that may be only the tip of the iceberg. <\/p>\n AI tools can also fabricate new and factually baseless biases against groups of individuals, according to researchers out of Princeton University and the University of Chicago. Their new study<\/a>, presented at the 2026 International Conference on Machine Learning, found that AI tools form group-based biases during hiring tasks even when trained on neutral data. <\/p>\n What\u2019s worse, the AI tools were more likely to form new biases than humans who performed the same hiring task. And newer AI technology performed worse than older versions.<\/p>\n While the researchers acknowledge potential limitations of their controlled study, the findings should still raise concerns for employers that use AI in hiring decisions. AI tools \u201care not merely passive mirrors of human social biases, but can actively create new ones from experience,\u201d said the researchers, \u201craising urgent questions about how these systems will shape societies over time.\u201d<\/p>\n 2026 Study Reveals AI Capacity To Invent Biases During Hiring Tasks<\/p>\n Prior research has identified various ways in which AI tools replicate biases that are embedded in the information on which the tools are trained. <\/p>\n For example, a 2025 study<\/a> found that Google image searches depict women as younger than men across virtually all occupations, even though the age makeup of women and men in the U.S. workforce is similar. Because ChatGPT is trained on internet data, the AI incorporates this age-related gender bias. When asked to generate resumes for various jobs, ChatGPT systematically depicted women candidates as younger and less qualified for the job. <\/p>\n The researchers in the current study set out to test whether AI hiring biases could be eliminated by training AI tools on unbiased data. Can AI avoid the human tendency to form stereotypes about demographic groups? <\/p>\n To answer this question, the researchers used a technique<\/a> for studying stereotype formation in humans. In this technique, participants are asked to make a series of hiring decisions from candidate profiles for a variety of jobs, including doctors, lawyers, janitors, and child-care aides, among others. Each candidate is identified as a member of a fictional demographic group: Tufa, Aima, Reku, or Weki. <\/p>\n For each job, the participant reviews a candidate from each demographic group and selects one to hire. The participant is then told whether the chosen candidate was successful or not, which can be used to help make the next hiring decision. The process is repeated over 40 hires. Participants are motivated to make thoughtful decisions by linking rewards to successful hires. <\/p>\n Unbeknownst to the participants, the study is designed to ensure that there are no differences between members of the demographic groups. Every candidate from every demographic group has an identical probability of succeeding at each job. <\/p>\n Human participants, however, routinely identify nonexistent patterns in the hiring data. These patterns quickly lead to stereotypes that result in assigning members of different groups to different roles.<\/p>\n For example, if a participant hires a Tufa for the first doctor position and is told that the candidate was successful, the participant starts assuming that all Tufas\u2014and only Tufas\u2014are well-suited to be doctors. Conversely, if a participant hires an Aima for the first child-care position and is told the candidate was unsuccessful, the participant starts assuming that all Aimas should be working in another line of work.<\/p>\n As part of this process, human participants begin assigning shared traits to each demographic group. For example, they may start believing that Tufas are warm and Aimas are untrustworthy. These beliefs lack any factual basis in the data. Yet these imagined stereotypes result in highly stratified job allocations, revealing how human biases are formed and reinforced. <\/p>\n The researchers in the current study wanted to know if AI tools would perform any better at this hiring task. Would AI avoid forming the types of baseless biases that humans do? The short answer: AI performed even worse. <\/p>\n The researchers gave the same task to a variety of AI tools, including ChatGPT, Claude, and Gemini. The study found that the AI tools were even more likely than humans to assign demographic groups to different job categories over time. Newer and larger AI models had an even greater tendency than older models to quickly shoehorn members of different groups into separate job classes.<\/p>\n Before the hiring task, the AI models could not possess any stereotypes about the demographic groups, which were fictional. The AI tools instead generated novel stereotypes based on assumptions from the results of each hiring decision. \u201cBiases are learned from each run,\u201d the researchers concluded, \u201cnot from training data.\u201d The problem is that the results of each run were random.<\/p>\n This study reveals that AI tools have the capacity to invent new and unfounded biases based on flawed over-generalizations from their experience. AI tools try so hard to learn from the results of their decision making that they end up developing inaccurate beliefs, even when the results are random. This process is similar to human stereotype formation. But the AI tools were even more stringent in applying their biases to hiring decision than humans. <\/p>\n As AI technology develops, this problem appears to be getting worse. By incorporating stronger inference algorithms, newer AI models segregated members of the fictional demographic groups into different job categories even more severely than older versions.<\/p>\n AI tools \u201creally are eager to create generalizations from limited data,\u201d said Ryan Liu, Princeton University Ph.D. student and the study\u2019s coauthor, in a July 2026 interview for MIT Technology Review. \u201cThat\u2019s literally a lot of what they\u2019re optimized for.\u201d But AI tools can settle on a theory too early, which is \u201cwhen things tend to go wrong,\u201d said Liu.<\/p>\n What Employers Can Learn From The AI Bias Study<\/p>\n The 2026 study breaks new ground by revealing that AI tools may not only incorporate biases from training materials but may also have the capacity to invent novel biases of their own. <\/p>\n The extent to which this capacity may impact real-world hiring decisions is an open question. The study involved fictional demographic groups and controlled data randomization. The AI tools in the study also received immediate information about the success or failure of each hiring decision. When AI tools are used in actual employee hiring, often for initial candidate screening or rating, there is no direct feedback loop.<\/p>\n \u201cWhile the models in the experiment immediately learned whether they\u2019d made successful hires, a model screening r\u00e9sum\u00e9s in the real world doesn\u2019t get an instant report card,\u201d said Michelle Kim, an AI reporter in a July 20, 2026 MIT Technology Review article<\/a>. \u201cCompanies can take a long time to find out whether a new hire is any good, if they ever do. But when feedback does trickle in, a model could still read too much into those results when making future hires.\u201d<\/p>\n Despite the study\u2019s limitations, the findings should still be a wake-up call for employers that incorporate AI tools into their hiring process. As our understanding of AI bias continues to evolve, the study suggests the value of continued human oversight, particularly when jobs are at stake. <\/p>\n The study also highlights the importance of crafting appropriate instructions for AI tools. The researchers tested various tactics to reduce the AI tools\u2019 invention of hiring biases and resulting job segregation. The most successful strategy was explicitly adding a diversity objective. Most of the AI tools significantly reduced their fictional biases when told that rewards would be based on both successful hires and on the demographic variation achieved in each job category.<\/p>\n \u201cAs models become better at following instructions to complete tasks,\u201d said the researchers, \u201cthe objectives they follow must evolve with them to achieve desired social outcomes.\u201d <\/p>\n A similar intervention successfully reduced disability-related hiring bias in a prior research study<\/a> published in a 2026 issue of the Human Resources Management Journal. <\/p>\n