{"id":650284,"date":"2026-08-22T06:26:17","date_gmt":"2026-08-22T06:26:17","guid":{"rendered":"https:\/\/www.europesays.com\/ie\/650284\/"},"modified":"2026-08-22T06:26:17","modified_gmt":"2026-08-22T06:26:17","slug":"israeli-scientists-ai-can-make-personality-tests-predict-responses","status":"publish","type":"post","link":"https:\/\/www.europesays.com\/ie\/650284\/","title":{"rendered":"Israeli scientists: AI can make personality tests, predict responses"},"content":{"rendered":"

All users of ChatGPT, Gemini, and other artificial intelligence platforms know that these large language models (LLMs) are usually very \u201csmart\u201d and analyze texts and answer questions very well. But is AI<\/a> clairvoyant?<\/p>\n

Hebrew University of Jerusalem<\/a> (HUJI) scientists have developed a method for generating personality assessment questionnaires with ChatGPT from any source text in English.\u00a0<\/p>\n

To test the method, they applied it to both the Diagnostic and Statistical Manual of Mental Disorders, 5th Edition (DSM-5) \u2013 the \u201cbible\u201d of mental health professionals published by the American Psychiatric Association to name, describe, and diagnose mental health and brain-related conditions \u2013 and, as a deliberately unconventional example, an astrology textbook.<\/p>\n

The team said that not only could ChatGPT<\/a> be used to create and validate these questionnaires, but that it could also accurately predict population-level responses before the surveys were carried out.<\/p>\n

Testing AI with personality tests<\/strong><\/p>\n

The team \u2013 Dr. Rotem Monsa, Prof. Aviv Zohar, and Prof. Shahar Arzy of the Hebrew University-Hadassah Medical School and the HUJI Faculty of Computer Science published its findings in the Cell Press journal iScience under the title \u201cGenerating and analyzing personality questionnaires using large language models.\u201d<\/p>\n

\"PicturePicture showing the ChatGPT application displayed on a smartphone screen, illustrative (credit: Imen Ben Youssef \/ Hans Lucas \/ AFP via Getty Images)<\/p>\n

ChatGPT and other publicly accessible LLMs are trained on the Internet by compiling trillions of human-language data inputs from websites and social media.<\/p>\n

Because of this training, researchers have wondered whether LLMs understand human language at an expert level and whether personality is built into their algorithms.<\/p>\n

\u201cSince personality traits are reflected in language, LLMs may have learned the structure of human personality as a natural byproduct of their training,\u201d suggested lead author Monsa, a postdoctoral researcher in HUJI\u2019s medical neurosciences department, in an interview with The Jerusalem Post.<\/p>\n

\u201cSo, while they were not taught specifically psychology or personality theories, these are already embedded in the language that LLMs learn from,\u201d she continued.<\/p>\n

To test how well LLMs can naturally assess human personality, the researchers said they used GPT-4 \u2013 a large multimodal model that, while less capable than humans in many real-world scenarios, exhibits human-level performance on various professional and academic benchmarks \u2013 to generate two personality assessment questionnaires.<\/p>\n

They first used excerpts from the DSM-5<\/a> as source text, assuming that personality traits are localized on the personality disorder continuum.<\/p>\n

ChatGPT created a questionnaire with statements based on descriptions of personality disorders from the DSM-5.<\/p>\n

For example, based on the section describing paranoid personality disorder, the questionnaire asked participants to rank (1 = strongly disagree to 5 = strongly agree) how much they agree with statements such as \u201coften suspects others\u2019 motives\u201d or \u201cfinds it easy to trust people.\u201d<\/p>\n

Another questionnaire used the astrology textbook as a control; it generated similar statements, but these were based on the source text\u2019s assignment of personality traits to the astrological zodiac signs.<\/p>\n

\u201cWe wanted to choose texts that describe human personality in very rich detail but also sit on opposite ends of a spectrum in terms of scientific grounding,\u201d Monsa explained.<\/p>\n

\u201cThe DSM-5 was refined through decades of clinical research and is the standard diagnostic manual in clinical psychiatry, known worldwide. The astrology text is very culturally based but not scientifically validated.\u201d<\/p>\n

After the LLM-based questionnaires were generated, they were presented to 600 people together with the Big Five personality questionnaire (BFI) \u2013 the current, most-validated personality questionnaire to assess their utility that is based on the hypothesis that personality traits are encoded in language.<\/p>\n

The researchers were essentially asking whether an LLM has absorbed enough patterns about human psychology from language to predict how humans will answer questions it has just generated.<\/p>\n

RESULTS FROM the DSM-5-sourced questionnaire showed high internal consistency within personality clusters \u2013 traits that typically correlate together in the real world, including dependency and avoidance, also correlated in their responses.<\/p>\n

\u201cImportantly, these results were just like those in the BFI, which helps validate the strength of the questionnaire in measuring real-life patterns of human psychology,\u201d said Monsa.<\/p>\n

\u201cAs predicted, the astrology questionnaire, by contrast, showed a weak internal consistency across traits. Our data suggest that the astrological elements don\u2019t reflect coherent psychological dimensions.\u201d<\/p>\n

The most surprising result, however, was that ChatGPT could predict how participants would respond to the questionnaires before they were taken.<\/p>\n

For both questionnaires, ChatGPT predicted in advance the mean responses and correlations between questions with high real-world accuracy, suggesting that LLMs have an innate understanding of personality dynamics at a population level, Monsa said.<\/p>\n

Asked what it means to say that ChatGPT has an \u201cunderstanding\u201d of personality, she answered that \u201cit was trained by a lot of text. It doesn\u2019t understand by itself; it learns from statistical patterns.\u201d<\/p>\n

ChatGPT doesn\u2019t have human understanding, she continued, \u201cbut even I \u2013 who knows Chat is not human \u2013 often call it he because the responses are very human-like. The LLMs have learned a great deal in the last three years since we started the research.\u201d<\/p>\n

Asked how ChatGPT could predict people\u2019s responses before seeing their answers, Monsa replied that \u201cit wasn\u2019t one person, but a population-level response. We were very surprised that Chat performed so well.<\/p>\n

\u201cWhen we started, the models were less advanced. Obviously, the model wasn\u2019t \u2018born\u2019 with psychological knowledge. It wasn\u2019t trained in it. It became \u2018natural\u2019 or \u2018innate\u2019 from what it learned.\u201d<\/p>\n

The team was able to prevent ChatGPT from accessing the actual participants\u2019 responses before making its predictions because the questionnaires didn\u2019t exist on the Internet, which is the source of its raw material, Monsa noted.<\/p>\n

\u201cWe ran the prediction multiple times to see whether ChatGPT produced essentially the same predictions, and they were very similar each time,\u201d she said.<\/p>\n

An astrology questionnaire was used as a control because it was \u201ca negative control. Personality can\u2019t be determined by astrology.\u201d<\/p>\n

\u201cIf we fed ChatGPT another pseudoscientific text \u2013 such as a book claiming that handwriting accurately reveals personality \u2013 it would work successfully like our research. We tried other things that didn\u2019t involve personality, like menus and how well your kitchen was organized,\u201d Monsa recalled.<\/p>\n

The study using LLM-generated personality assessment could eventually be used to assess human patients.<\/p>\n

\u201cIt will take time, and there are risks,\u201d said Monsa, \u201cand it has to be analyzed by psychologists, but I\u2019m sure it\u2019ll eventually be used for diagnosis or even treatment after there is psychological validation. It would be much cheaper and be especially helpful in places where trained psychologists are scarce.\u201d<\/p>\n

She conceded that an LLM could inadvertently generate questions that are culturally biased, stigmatizing, or psychologically misleading because they were trained on English-language, Western material.<\/p>\n

\u201cOur results may not be relevant if these methods are repeated in different languages and cultures because LLMs were trained mostly on English texts in occidental cultures,\u201d said Monsa.<\/p>\n

\u201cBut if they were applied to Hebrew-speaking Israelis, it should be close, because Israelis are very Western. An LLM could actually learn culturally specific concepts of personality that human psychologists might overlook.\u201d<\/p>\n","protected":false},"excerpt":{"rendered":"All users of ChatGPT, Gemini, and other artificial intelligence platforms know that these large language models (LLMs) are…\n","protected":false},"author":2,"featured_media":650285,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":"","_share_on_mastodon":"0"},"categories":[78],"tags":[291,289,297,18,135,34767,19,17,133,21689],"class_list":["post-650284","post","type-post","status-publish","format-standard","has-post-thumbnail","category-health","tag-ai","tag-artificial-intelligence","tag-chatgpt","tag-eire","tag-health","tag-hebrew-university-of-jerusalem","tag-ie","tag-ireland","tag-science","tag-scientific-study"],"share_on_mastodon":{"url":"https:\/\/pubeurope.com\/@ie\/117137741524591701","error":""},"_links":{"self":[{"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/posts\/650284","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/comments?post=650284"}],"version-history":[{"count":0,"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/posts\/650284\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/media\/650285"}],"wp:attachment":[{"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/media?parent=650284"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/categories?post=650284"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/tags?post=650284"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}