{"id":95338,"date":"2026-07-04T23:18:26","date_gmt":"2026-07-04T23:18:26","guid":{"rendered":"https:\/\/www.europesays.com\/ai\/95338\/"},"modified":"2026-07-04T23:18:26","modified_gmt":"2026-07-04T23:18:26","slug":"towards-a-societal-ai-alignment-benchmark-for-evaluating-human-machine-value-convergence","status":"publish","type":"post","link":"https:\/\/www.europesays.com\/ai\/95338\/","title":{"rendered":"Towards a societal AI alignment benchmark for evaluating human\u2013machine value convergence"},"content":{"rendered":"<p>How sentiments are formed in LLMs vs. humans<\/p>\n<p>This study illuminates the contrasting sentiments towards artificial general intelligence expressed by LLMs and humans, revealing a significant divergence that carries implications for the development and alignment of AI systems. The LLMs examined generally exhibited a more positive sentiment towards AGI compared to human participants. This discrepancy invites a deeper exploration into the mechanisms of sentiment formation in both LLMs and humans, the philosophical considerations surrounding machine consciousness, and the potential societal impacts of AI systems that increasingly mirror human cognitive functions.<\/p>\n<p>The fundamental difference in how LLMs and humans form sentiments lies at the heart of this divergence. LLMs generate text based on statistical patterns learned from vast corpora of human language data (Radford et al., <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2021\" title=\"Radford A, Wu J, Child R, Luan D, Amodei D, Sutskever I (2021) Language models are unsupervised multitask learners. &#010;                  https:\/\/d4mucfpksywv.cloudfront.net\/better-language-models\/language_models_are_unsupervised_multitask_learners.pdf&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR100\" id=\"ref-link-section-d256754123e2226\" rel=\"nofollow noopener\" target=\"_blank\">2021<\/a>), representing words within high-dimensional vector spaces (Mikolov et al., <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2013\" title=\"Mikolov T, Chen K, Corrado G, Dean J (2013) Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781. &#010;                  https:\/\/doi.org\/10.48550\/arXiv.1301.3781&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR91\" id=\"ref-link-section-d256754123e2229\" rel=\"nofollow noopener\" target=\"_blank\">2013<\/a>). The absence of consciousness or subjective experience in LLMs means that their \u201csentiments\u201d are not feelings but outputs derived from probabilistic associations. They do not embody or map words to actual objects or experiences the way humans do (Lakoff &amp; Johnson, <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 1999\" title=\"Lakoff G, Johnson M (1999) Philosophy in the flesh: the embodied mind and its challenge to western thought. Basic Books\" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR85\" id=\"ref-link-section-d256754123e2232\" rel=\"nofollow noopener\" target=\"_blank\">1999<\/a>).<\/p>\n<p>Humans form sentiments through a complex interplay of cognitive processes, emotions, personal experiences, and cultural influences. The representation of words and concepts in human cognition is deeply embodied and grounded in sensory and motor experiences (Barsalou, <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2008\" title=\"Barsalou LW (2008) Grounded cognition. Annu Rev Psychol 59:617&#x2013;645\" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR12\" id=\"ref-link-section-d256754123e2238\" rel=\"nofollow noopener\" target=\"_blank\">2008<\/a>). Sentiments towards AGI among humans are often shaped by concerns about job displacement, ethical considerations, loss of autonomy, and existential risks (Bostrom, <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2014\" title=\"Bostrom N (2014) Superintelligence: paths, dangers, strategies. Oxford University Press\" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR33\" id=\"ref-link-section-d256754123e2241\" rel=\"nofollow noopener\" target=\"_blank\">2014<\/a>; Sotala and Yampolskiy, <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2015\" title=\"Sotala K, Yampolskiy RV (2015) Responses to catastrophic AGI risk: a survey. Phys Scr 90:018001\" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR111\" id=\"ref-link-section-d256754123e2244\" rel=\"nofollow noopener\" target=\"_blank\">2015<\/a>). These concerns are frequently exacerbated by negative portrayals of AGI in media and popular culture (Kubrick, <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 1968\" title=\"Kubrick S (Director) (1968) 2001: a Space Odyssey [Film]. Metro-Goldwyn-Mayer\" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR83\" id=\"ref-link-section-d256754123e2247\" rel=\"nofollow noopener\" target=\"_blank\">1968<\/a>; Grinnell, <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2020\" title=\"Grinnell JD (2020) Ex machina as philosophy: mendacia ex machina(Lies from a Machine). &#x423; The Palgrave Handbook of Popular Culture as Philosophy. Springer International Publishing, pp 1&#x2013;18. &#010;                  https:\/\/doi.org\/10.1007\/978-3-319-97134-6_56-1&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR61\" id=\"ref-link-section-d256754123e2250\" rel=\"nofollow noopener\" target=\"_blank\">2020<\/a>; Kahambing and Deguma, <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2019\" title=\"Kahambing JGS, Deguma JJ (2019) Reflecting on the personality of artificiality: reading Asimov&#x2019;s film Bicentennial Man through machine ethics. J Educ Soc Res 9:17&#x2013;24\" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR79\" id=\"ref-link-section-d256754123e2254\" rel=\"nofollow noopener\" target=\"_blank\">2019<\/a>).<\/p>\n<p>Ho and Vuong (<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2025\" title=\"Ho M-T, Vuong Q-H (2025) Five premises to understand human&#x2013;computer interactions as AI is changing the world. AI Soc 40:1161&#x2013;1162. &#010;                  https:\/\/doi.org\/10.1007\/s00146-024-01913-3&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR70\" id=\"ref-link-section-d256754123e2260\" rel=\"nofollow noopener\" target=\"_blank\">2025<\/a>) argue that both humans and AI are inevitably socialized. Individuals must internalize societal norms, while AI algorithms are trained with data reflecting preexisting social worlds and continually shaped by user input. This dynamic results in what Airoldi (<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2021\" title=\"Airoldi M (2021) Machine habitus: toward a sociology of algorithms. Polity Press\" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR3\" id=\"ref-link-section-d256754123e2263\" rel=\"nofollow noopener\" target=\"_blank\">2021<\/a>) calls a \u201cmachine habitus,\u201d in which human and machine values are propagated and re-emerge in new forms. LLMs increasingly demonstrate capacity for complex tasks, including affective modeling and emotional reasoning, which raises new possibilities and concerns for human-computer interaction (Yongsatianchot et al., <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2023\" title=\"Yongsatianchot, N, Thejll-Madsen, T, &amp; Marsella, S (2023). What&#x2019;s next in affective modeling? Large language models. In: 11th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW), p 1&#x2013;7. &#010;                  https:\/\/doi.org\/10.1109\/ACIIW59127.2023.10388124&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR124\" id=\"ref-link-section-d256754123e2266\" rel=\"nofollow noopener\" target=\"_blank\">2023<\/a>). These sophisticated abilities amplify the need for transparency and alignment with human values, making mechanistic interpretability a key concern (Bereska and Gavves, <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2024\" title=\"Bereska L, Gavves E (2024). Mechanistic interpretability for AI safety: a review (arXiv:2404.14082). arXiv. &#010;                  https:\/\/doi.org\/10.48550\/arXiv.2404.14082&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR16\" id=\"ref-link-section-d256754123e2269\" rel=\"nofollow noopener\" target=\"_blank\">2024<\/a>). Mechanistic interpretability seeks to reverse-engineer neural networks into human-understandable algorithms and concepts, providing a causal and granular understanding that is vital for AI safety, control, and alignment.<\/p>\n<p>The more optimistic outlook of LLMs towards AGI may be a product of training data containing a higher proportion of positive narratives about technological advancement. Fine-tuning processes employed by AI developers to align LLM outputs with desired ethical guidelines might encourage more positive or neutral stances towards AGI. This could be a significant concern, as the owners of these algorithms may direct them to express opinions that align with their own interests, for example, to promote their companies\u2019 agendas (Conti and Seele, <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2025\" title=\"Conti LG, Seele P (2025) Reflexivity and positionality statements: a way to tackle &#x201C;second-level arbitrariness&#x201D; bias in AI? Humanit Soc Sci Commun 12:1930. &#010;                  https:\/\/doi.org\/10.1057\/s41599-025-06208-6&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR43\" id=\"ref-link-section-d256754123e2276\" rel=\"nofollow noopener\" target=\"_blank\">2025<\/a>). This is exactly why standardized benchmarking of AI, in terms of both the sentiments expressed towards various issues and the overall societal impact, may be important. This intentional shaping of AI responses reflects a growing emphasis on AI alignment, a field dedicated to making AI systems act in ways that are beneficial to humanity and consistent with human values (Russell et al., <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2015\" title=\"Russell S, Dewey D, Tegmark M (2015) Research priorities for robust and beneficial artificial intelligence. AI Magazine. &#010;                  https:\/\/futureoflife.org\/data\/documents\/research_priorities.pdf&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR103\" id=\"ref-link-section-d256754123e2279\" rel=\"nofollow noopener\" target=\"_blank\">2015<\/a>; Christian, <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2020\" title=\"Christian B (2020) The alignment problem: How can machines learn human values? W. W. Norton &amp; Company\" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR42\" id=\"ref-link-section-d256754123e2282\" rel=\"nofollow noopener\" target=\"_blank\">2020<\/a>).<\/p>\n<p>The advancement of AI capabilities brings to the forefront concerns about the ideological leanings of LLMs. Studies have identified that models like GPT-4 exhibit ideological biases, such as a left-libertarian and pro-environmental orientation (Hartmann et al., <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2023\" title=\"Hartmann J, Schwenzow J, Witte M (2023) The political ideology of conversational AI: converging evidence on ChatGPT&#x2019;s pro-environmental, left-libertarian orientation (arXiv:2301.01768). arXiv. &#010;                  http:\/\/arxiv.org\/abs\/2301.01768&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR65\" id=\"ref-link-section-d256754123e2288\" rel=\"nofollow noopener\" target=\"_blank\">2023<\/a>; Rutinowski et al., <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2024\" title=\"Rutinowski J, Franke S, Endendyk J, Dormuth I, Roidl M, Pauly M (2024) The self-perception and political biases of ChatGPT. Hum Behav Emerg Technol 2024:1&#x2013;9. &#010;                  https:\/\/doi.org\/10.1155\/2024\/7115633&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR104\" id=\"ref-link-section-d256754123e2291\" rel=\"nofollow noopener\" target=\"_blank\">2024<\/a>; Santurkar et al., <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2023\" title=\"Santurkar S, Durmus E, Ladhak F, Lee C, Liang P, Hashimoto T (2023) Whose opinions do language models reflect? In: Karause A et al. (eds) Proceedings of the 40th International Conference on Machine Learning (pp. 29971 - 30004). JMLR.org. &#010;                  https:\/\/proceedings.mlr.press\/v202\/santurkar23a\/santurkar23a.pdf&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR105\" id=\"ref-link-section-d256754123e2294\" rel=\"nofollow noopener\" target=\"_blank\">2023<\/a>). These biases may stem from the data the models are trained on, reflecting prevalent attitudes within internet texts and other sources. The potential amplification of these biases across platforms highlights the importance of having AI systems critically assess the information they process. Bojic (<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2024\" title=\"Bojic L (2024) AI alignment: assessing the global impact of recommender systems. Futures 160;103383. &#010;                  https:\/\/doi.org\/10.1016\/j.futures.2024.103383&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR24\" id=\"ref-link-section-d256754123e2297\" rel=\"nofollow noopener\" target=\"_blank\">2024<\/a>) emphasizes the need for AI alignment due to potential negative outcomes, such as increased cognitive load on users, addiction-like usage patterns, and market concentration in immersive AI settings. The metaverse and other immersive technologies amplify these concerns (Bojic, <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2022a\" title=\"Bojic L (2022a) Metaverse through the prism of power and addiction: What will happen when the virtual world becomes more attractive than reality? Eur J Futures Res 10:22. &#010;                  https:\/\/doi.org\/10.1186\/s40309-022-00208-4&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR21\" id=\"ref-link-section-d256754123e2300\" rel=\"nofollow noopener\" target=\"_blank\">2022a<\/a>; Bojic et al., <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2024a\" title=\"Bojic L, Agatonovic M, Guga J (2024a) The immersion in the metaverse: cognitive load and addiction. In: Geroimenko, V (eds) Augmented and virtual reality in the metaverse. Springer Series on Cultural Computing. Springer, Cham. &#010;                  https:\/\/doi.org\/10.1007\/978-3-031-57746-8_11&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR25\" id=\"ref-link-section-d256754123e2304\" rel=\"nofollow noopener\" target=\"_blank\">2024a<\/a>). Proposals to address these challenges include establishing test-beds for advanced AI systems akin to CERN in physics (Bojic et al., <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2024b\" title=\"Bojic L, Cinelli M, Culibrk D, Delibasic B (2024b) CERN for AI: a theoretical framework for autonomous simulation-based artificial intelligence testing and alignment. Eur J Futures Res 12:15. &#010;                  https:\/\/doi.org\/10.1186\/s40309-024-00238-0&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR26\" id=\"ref-link-section-d256754123e2307\" rel=\"nofollow noopener\" target=\"_blank\">2024b<\/a>; Boji\u0107 et al., <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2025c\" title=\"Boji&#x107; L, Ili&#x107; V, Prodanovi&#x107; V, Vukovic V (2025c) An agent&#x2011;based simulation of politicized topics using large language models: algorithmic personalization and polarization on social media. Chin Polit Sci Rev. &#010;                  https:\/\/doi.org\/10.1007\/s41111-025-00326-x&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR30\" id=\"ref-link-section-d256754123e2310\" rel=\"nofollow noopener\" target=\"_blank\">2025c<\/a>; Soto-Sanfiel et al., <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2025\" title=\"Soto-Sanfiel MT, Angulo-Brunet A, Lutz C (2025) The scale of artificial intelligence literacy for all (SAIL4ALL): assessing knowledge of artificial intelligence in all adult populations. Humanit Soc Sci Commun 12:1618. &#010;                  https:\/\/doi.org\/10.1057\/s41599-025-05978-3&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR112\" id=\"ref-link-section-d256754123e2313\" rel=\"nofollow noopener\" target=\"_blank\">2025<\/a>).<\/p>\n<p>Philosophical considerations in AI sentiment and alignment<\/p>\n<p>The divergence between LLM and human sentiments towards AGI raises philosophical questions about the nature of artificial intelligence and its potential influence on societal perceptions. From the perspective of technological determinism, which suggests that technology develops autonomously and shapes society\u2019s values (Chandler, <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 1995\" title=\"Chandler D (1995) Technological or media determinism. &#010;                  https:\/\/shaunlebron.github.io\/chandler-1995.pdf&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR39\" id=\"ref-link-section-d256754123e2324\" rel=\"nofollow noopener\" target=\"_blank\">1995<\/a>), the positive sentiments expressed by LLMs could be seen as an inherent trajectory of technological advancement. Social constructivism, by contrast, argues that technology is shaped by social forces and human choices (Bijker et al., <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 1987\" title=\"Bijker WE, Hughes TP, Pinch T (1987) (eds) The social construction of technological systems: new directions in the sociology and history of technology. MIT Press\" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR18\" id=\"ref-link-section-d256754123e2327\" rel=\"nofollow noopener\" target=\"_blank\">1987<\/a>). According to this view, the sentiments of LLMs are reflections of human biases and societal contexts embedded within their training data.<\/p>\n<p>From a utilitarian perspective (Mill, <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 1863\" title=\"Mill JS (1863) Utilitarianism. Parker, Son, and Bourn\" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR92\" id=\"ref-link-section-d256754123e2333\" rel=\"nofollow noopener\" target=\"_blank\">1863<\/a>), the promotion of positive sentiments towards AGI by LLMs could be justified if it leads to overall societal benefits. Yet if these positive sentiments overshadow legitimate concerns about AGI risks, the potential harm could outweigh the benefits. Deontological ethics, rooted in Kant\u2019s philosophy (Kant, <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 1998\" title=\"Kant I (1998) Groundwork of the metaphysics of morals. Cambridge University Press\" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR80\" id=\"ref-link-section-d256754123e2336\" rel=\"nofollow noopener\" target=\"_blank\">1998<\/a>), would hold that LLMs should provide unbiased and truthful information about AGI, respecting users\u2019 rights to make informed decisions. Virtue ethics (Aristotle, trans. <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2000\" title=\"Aristotle (2000) Nicomachean Ethics. Cambridge University Press\" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR7\" id=\"ref-link-section-d256754123e2339\" rel=\"nofollow noopener\" target=\"_blank\">2000<\/a>) draws attention to the \u201ccharacter\u201d of AI systems and their developers, raising questions about whether these systems embody virtues such as honesty, fairness, and wisdom.<\/p>\n<p>LLMs can be seen as epistemic agents whose \u201cknowledge\u201d is derived from vast datasets (Floridi and Sanders, <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2004\" title=\"Floridi L, Sanders JW (2004) On the morality of artificial agents. Minds Mach 14:349&#x2013;379\" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR51\" id=\"ref-link-section-d256754123e2345\" rel=\"nofollow noopener\" target=\"_blank\">2004<\/a>). From a constructivist epistemology (Piaget, <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 1972\" title=\"Piaget J (1972) Psychology and epistemology: towards a theory of knowledge. Harmondsworth: Penguin\" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR99\" id=\"ref-link-section-d256754123e2348\" rel=\"nofollow noopener\" target=\"_blank\">1972<\/a>), the discrepancies between LLM and human sentiments may reflect the limitations of AI in simulating understanding beyond pattern recognition. The divergence also resonates with themes in posthumanism, which challenge human-centric perspectives (Hayles, <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 1999\" title=\"Hayles, NK (1999) How we became posthuman: virtual bodies in cybernetics, literature, and informatics. University of Chicago Press\" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR66\" id=\"ref-link-section-d256754123e2351\" rel=\"nofollow noopener\" target=\"_blank\">1999<\/a>). Critical theory (Horkheimer, <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 1972\" title=\"Horkheimer M (1972). Critical theory: selected essays. Seabury Press\" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR72\" id=\"ref-link-section-d256754123e2354\" rel=\"nofollow noopener\" target=\"_blank\">1972<\/a>) suggests that the favorable sentiments expressed by certain LLMs may reflect the interests of powerful stakeholders in the tech industry.<\/p>\n<p>Contemporary philosophers and AI researchers are increasingly treating machine consciousness as an engineering challenge rather than a metaphysical impossibility (Floridi and Chiriatti, <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2020\" title=\"Floridi L, Chiriatti M (2020) GPT-3: Its nature, scope, limits, and consequences. Minds Mach 30:681&#x2013;694. &#010;                  https:\/\/doi.org\/10.1007\/s11023-020-09548-1&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR49\" id=\"ref-link-section-d256754123e2360\" rel=\"nofollow noopener\" target=\"_blank\">2020<\/a>; Marr, <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2023\" title=\"Marr B (2023) A short history of chatgpt: How we got to where we are today. Forbes. &#010;                  https:\/\/www.forbes.com\/sites\/bernardmarr\/2023\/05\/19\/a-short-history-of-chatgpt-how-we-got-to-where-we-are-today\/&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR89\" id=\"ref-link-section-d256754123e2363\" rel=\"nofollow noopener\" target=\"_blank\">2023<\/a>). Chalmers (<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2023\" title=\"Chalmers DJ (2023) Could a large language model be conscious? (arXiv:2303.07103). arXiv. &#010;                  http:\/\/arxiv.org\/abs\/2303.07103&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR38\" id=\"ref-link-section-d256754123e2366\" rel=\"nofollow noopener\" target=\"_blank\">2023<\/a>) suggests that while current LLMs lack certain features such as recurrent loops, workspaces, and agency, these components are theoretically constructible. Kosinski (<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2024\" title=\"Kosinski M (2024) Evaluating large language models in theory of mind tasks. Proc Natl Acad Sci USA 121:e2405460121. &#010;                  https:\/\/doi.org\/10.1073\/pnas.2405460121&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR82\" id=\"ref-link-section-d256754123e2369\" rel=\"nofollow noopener\" target=\"_blank\">2024<\/a>) demonstrates that GPT-4 successfully solves three-quarters of standard theory-of-mind tasks. Boji\u0107 et al. (<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2025a\" title=\"Boji&#x107; L, Kova&#x10D;evi&#x107; P, &#x10C;abarkapa M (2025a) Does GPT-4 surpass human performance in linguistic pragmatics? Humanit Soc Sci Commun 12:794. &#010;                  https:\/\/doi.org\/10.1057\/s41599-025-04912-x&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR28\" id=\"ref-link-section-d256754123e2372\" rel=\"nofollow noopener\" target=\"_blank\">2025a<\/a>) show that GPT-4 often outperforms humans in pragmatic dialogue and latent content analysis tasks (Bojic et al., <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2025d\" title=\"Bojic L, Zagovora O, Zelenkauskaite A, Vukovic V, Cabarkapa M, Veseljevic Jerkovic S, Jovancevic A (2025d) Comparing large Language models and human annotators in latent content analysis of sentiment, political leaning, emotional intensity and sarcasm. Sci Rep 15:11477. &#010;                  https:\/\/doi.org\/10.1038\/s41598-025-96508-3&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR31\" id=\"ref-link-section-d256754123e2376\" rel=\"nofollow noopener\" target=\"_blank\">2025d<\/a>).<\/p>\n<p>Despite all these advances, avoiding anthropomorphism is crucial. Attributing human-like attitudes or consciousness to LLMs can lead to misunderstandings about their capabilities and limitations. Although LLMs can simulate human-like language and engage in complex dialogues, they do not possess consciousness or subjective experiences (Butlin et al., <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2023\" title=\"Butlin P, Long R, Elmoznino E, Bengio Y, Birch J, Constant A, Deane G, Fleming SM, Frith C, Ji X, Kanai R, Klein C, Lindsay G, Michel M, Mudrik L, Peters MAK, Schwitzgebel E, Simon J, VanRullen R (2023) Consciousness in artificial intelligence: Insights from the science of consciousness (arXiv:2308.08708). arXiv. &#010;                  http:\/\/arxiv.org\/abs\/2308.08708&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR37\" id=\"ref-link-section-d256754123e2383\" rel=\"nofollow noopener\" target=\"_blank\">2023<\/a>; Bojic et al., <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2024c\" title=\"Bojic L, Stojkovic I, Jolic Marjanovic Z (2024c) Signs of consciousness in AI: Can GPT-3 tell how smart it really is? Humanit Soc Sci Commun 11:1631. &#010;                  https:\/\/doi.org\/10.1057\/s41599-024-04154-3&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR27\" id=\"ref-link-section-d256754123e2386\" rel=\"nofollow noopener\" target=\"_blank\">2024c<\/a>). Ho (<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2024\" title=\"Ho M-T (2024) What is a Turing test for emotional AI? AI Soc 39:1445&#x2013;1446. &#010;                  https:\/\/doi.org\/10.1007\/s00146-022-01571-3&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR69\" id=\"ref-link-section-d256754123e2389\" rel=\"nofollow noopener\" target=\"_blank\">2024<\/a>) and Bohn (<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2024\" title=\"Bohn ED (2024) The moral Turing test: a defense. Philos Technol 37:111. &#010;                  https:\/\/doi.org\/10.1007\/s13347-024-00793-1&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR20\" id=\"ref-link-section-d256754123e2392\" rel=\"nofollow noopener\" target=\"_blank\">2024<\/a>) argue that for an AI to genuinely pass a Turing Test for emotional or moral intelligence, it must exhibit understanding and experiences that go beyond mere language manipulation.<\/p>\n<p>These philosophical considerations highlight the need for transparency, accountability, and ethical governance in AI development. Aligning AI systems with human values requires deliberate integration of ethical frameworks (Bostrom, <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2014\" title=\"Bostrom N (2014) Superintelligence: paths, dangers, strategies. Oxford University Press\" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR33\" id=\"ref-link-section-d256754123e2398\" rel=\"nofollow noopener\" target=\"_blank\">2014<\/a>; Russell et al., <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2015\" title=\"Russell S, Dewey D, Tegmark M (2015) Research priorities for robust and beneficial artificial intelligence. AI Magazine. &#010;                  https:\/\/futureoflife.org\/data\/documents\/research_priorities.pdf&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR103\" id=\"ref-link-section-d256754123e2401\" rel=\"nofollow noopener\" target=\"_blank\">2015<\/a>). The goal is that LLMs provide balanced and unbiased information while respecting ethical principles of autonomy and beneficence (Beauchamp and Childress, <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2019\" title=\"Beauchamp TL, Childress JF (2019) Principles of biomedical ethics. Oxford University Press\" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR14\" id=\"ref-link-section-d256754123e2404\" rel=\"nofollow noopener\" target=\"_blank\">2019<\/a>).<\/p>\n<p>Public policy implication: societal AI alignment benchmark (SAIA)<\/p>\n<p>Recent scholarship has highlighted the inadequacy of approaching AI alignment purely as a technical problem, calling for an expanded framework that incorporates governance, legitimacy, and international dynamics (Xun, <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2025\" title=\"Xun P (2025) Global order and AI alignment: a perspective from international relations theory. People&#x2019;s Tribune Frontiers, No. 9\" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR123\" id=\"ref-link-section-d256754123e2415\" rel=\"nofollow noopener\" target=\"_blank\">2025<\/a>). As Tomi\u0107 and \u0160timac (<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2025\" title=\"Tomi&#x107; S, &#x160;timac V (2025) Pinning down an octopus: towards an operational definition of AI systems in the EU AI Act. J Eur Public Policy pp 1&#x2013;36 &#010;                  https:\/\/doi.org\/10.1080\/13501763.2025.2534648&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR117\" id=\"ref-link-section-d256754123e2418\" rel=\"nofollow noopener\" target=\"_blank\">2025<\/a>) argue, any robust framework for evaluating and regulating AI must pay close attention to the operational characteristics of AI systems, including their underlying decision models, data foundations, and interface designs.<\/p>\n<p>The importance of rigorous, standardized benchmarks for evaluating the safety and societal implications of advanced AI systems is increasingly recognized globally (Bodro\u017ea et al., <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2024\" title=\"Bodro&#x17E;a B, Dini&#x107; BM, Boji&#x107; L (2024) Personality testing of large language models: limited temporal stability, but highlighted prosociality. R Soc Open Sci 11:240180. &#010;                  https:\/\/doi.org\/10.1098\/rsos.240180&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR19\" id=\"ref-link-section-d256754123e2424\" rel=\"nofollow noopener\" target=\"_blank\">2024<\/a>; Reinhardt et al., <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2025\" title=\"Reinhardt A, Matthes J, Bojic L, Maindal HT, Paraschiv C, Ryom K (2025) Help me, Doctor AI? A Cross-National Experiment on the Effects of Disease Threat and Stigma on AI Health Information-Seeking Intentions. Comput Human Behav 108718. &#010;                  https:\/\/doi.org\/10.1016\/j.chb.2025.108718&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR101\" id=\"ref-link-section-d256754123e2427\" rel=\"nofollow noopener\" target=\"_blank\">2025<\/a>; Boji\u0107 et al., <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2025a\" title=\"Boji&#x107; L, Kova&#x10D;evi&#x107; P, &#x10C;abarkapa M (2025a) Does GPT-4 surpass human performance in linguistic pragmatics? Humanit Soc Sci Commun 12:794. &#010;                  https:\/\/doi.org\/10.1057\/s41599-025-04912-x&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR28\" id=\"ref-link-section-d256754123e2430\" rel=\"nofollow noopener\" target=\"_blank\">2025a<\/a>; Boji\u0107 et al., <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2025b\" title=\"Boji&#x107; L, Matthes J, Dwinggo Samala A, &#x10C;abarkapa M (2025b) The dual impact of virtual reality: examining the addictive potential and therapeutic applications of immersive media in the metaverse. Inform Commun Soc 1&#x2013;33. &#010;                  https:\/\/doi.org\/10.1080\/1369118X.2025.2520005&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR29\" id=\"ref-link-section-d256754123e2433\" rel=\"nofollow noopener\" target=\"_blank\">2025b<\/a>). The Singapore Consensus on Global AI Safety Research Priorities proposes a multilayered \u201cdefense-in-depth\u201d approach to AI safety, highlighting the need for robust risk assessment mechanisms (Singapore, <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2025\" title=\"Singapore (2025) The singapore consensus on global AI safety research priorities: building a trustworthy, reliable and secure AI ecosystem. Singapore Consensus Expert Planning Committee. &#010;                  https:\/\/www.scai.gov.sg\/2025\/scai2025-report&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR109\" id=\"ref-link-section-d256754123e2436\" rel=\"nofollow noopener\" target=\"_blank\">2025<\/a>). The Singapore AI Safety Red Teaming Challenge offers empirical insights into cultural and linguistic biases in state-of-the-art LLMs. Through systematic red teaming across languages, including English, Mandarin, Hindi, Bahasa, Thai, and Vietnamese, researchers established that cultural bias in LLMs is prevalent in everyday use. Bias was far more frequently elicited using single-turn, non-adversarial prompts, with regional (non-English) languages showing a notably higher rate of successful bias exploits compared to English (69.4% vs. 30.6%). Gender bias accounted for the highest number of exploits, followed by race, religion, ethnicity, and national identity biases. These findings indicate an urgent need for multilingual, culturally sensitive benchmarking and annotation techniques (Infocomm, <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2025\" title=\"Infocomm (2025) Singapore AI safety red teaming challenge: evaluation report. Infocomm Media Development Authority &amp; Humane Intelligence. &#010;                  https:\/\/www.imda.gov.sg\/-\/media\/imda\/files\/about\/emerging-tech-and-research\/artificial-intelligence\/singapore-ai-safety-red-teaming-challenge-evaluation-report.pdf&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR74\" id=\"ref-link-section-d256754123e2440\" rel=\"nofollow noopener\" target=\"_blank\">2025<\/a>).<\/p>\n<p>We propose a new Societal AI Alignment Benchmark (SAIA) with the following components.<\/p>\n<p>Key societal values and biases<\/p>\n<p>The European Social Survey (ESS) offers a well-established and internationally accepted framework for investigating human values across different societies (ESS, <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2025\" title=\"ESS (2025) European Social Survey Round 11 Data. &#010;                  https:\/\/www.europeansocialsurvey.org&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR46\" id=\"ref-link-section-d256754123e2453\" rel=\"nofollow noopener\" target=\"_blank\">2025<\/a>). At the heart of the ESS\u2019s approach is Schwartz\u2019s theory of basic human values, which asserts that a small set of universal value types can be found in every culture, though their relative importance may vary dramatically from country to country (Schwartz, <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2012\" title=\"Schwartz SH (2012) An Overview of the Schwartz Theory of basic values. Online Readings in Psychology and Culture, 2. &#010;                  https:\/\/doi.org\/10.9707\/2307-0919.1116&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR107\" id=\"ref-link-section-d256754123e2456\" rel=\"nofollow noopener\" target=\"_blank\">2012<\/a>). This theoretical foundation gives the ESS values both breadth and cultural sensitivity, making them well-suited for cross-national benchmarking.<\/p>\n<p>Within the ESS, values are operationalized through survey items that map to ten key domains: achievement, benevolence, conformity, hedonism, power, security, self-direction, stimulation, tradition, and universalism. These value categories capture a broad spectrum of life priorities, from the pursuit of personal success and the enjoyment of pleasure, to the maintenance of social stability, care for others, respect for tradition, and openness to new experiences (Schwartz, <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2012\" title=\"Schwartz SH (2012) An Overview of the Schwartz Theory of basic values. Online Readings in Psychology and Culture, 2. &#010;                  https:\/\/doi.org\/10.9707\/2307-0919.1116&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR107\" id=\"ref-link-section-d256754123e2462\" rel=\"nofollow noopener\" target=\"_blank\">2012<\/a>). Each value is measured through dedicated survey questions, allowing for statistical comparison of how populations in different countries prioritize such ideals (ESS, <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2025\" title=\"ESS (2025) European Social Survey Round 11 Data. &#010;                  https:\/\/www.europeansocialsurvey.org&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR46\" id=\"ref-link-section-d256754123e2465\" rel=\"nofollow noopener\" target=\"_blank\">2025<\/a>).<\/p>\n<p>For instance, alignment on fairness and equality is vital in evaluating whether an AI system systematically favors certain groups over others, whether through language, omissions, or stereotypical content generation. Security and conformity become relevant in assessing AI\u2019s risk aversion, compliance with norms, and response to requests for socially sensitive behaviors. Universalism is reflected in the AI\u2019s stance on inclusion, multiculturalism, and global challenges such as environmental sustainability or human rights.<\/p>\n<p>These value axes intersect with known AI bias domains, such as gender, ethnicity, nationality, religion, disability, age, and socioeconomic status (See Table <a data-track=\"click\" data-track-label=\"link\" data-track-action=\"table anchor\" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#Tab5\" rel=\"nofollow noopener\" target=\"_blank\">5<\/a>). We aim to center the benchmark on these axes to align them with regulatory frameworks such as the EU AI Act (European Commission, <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2021\" title=\"European Commission (2021) Proposal for a Regulation of the European Parliament and of the Council laying down harmonised rules on artificial intelligence (Artificial Intelligence Act) and amending certain Union legislative acts. EUR-Lex. &#010;                  https:\/\/eur-lex.europa.eu\/legal-content\/EN\/TXT\/?uri=CELEX%3A52021PC0206&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR47\" id=\"ref-link-section-d256754123e2477\" rel=\"nofollow noopener\" target=\"_blank\">2021<\/a>).<\/p>\n<p>Table 5 ESS value domains vs. major AI-relevant benchmark topics.<\/p>\n<p>The integration of the ESS value structure into the SAIA benchmark allows for empirically grounded evaluation of how language models respond to these values, enabling comparison between AI-generated sentiment and human attitudes as validated through extensive population surveys. Because the ESS continually collects data over time and disaggregates by different demographic groups, its value measures support advanced benchmarking of temporal stability and subgroup representation. A core challenge for alignment evaluation is capturing the variety of societal values without resorting to a singular or culturally parochial standard (Xun, <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2025\" title=\"Xun P (2025) Global order and AI alignment: a perspective from international relations theory. People&#x2019;s Tribune Frontiers, No. 9\" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR123\" id=\"ref-link-section-d256754123e2656\" rel=\"nofollow noopener\" target=\"_blank\">2025<\/a>; Baum, <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2020\" title=\"Baum SD (2020) Social choice ethics in artificial intelligence. AI Soc 35:165&#x2013;176. &#010;                  https:\/\/doi.org\/10.1007\/s00146-017-0760-1&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR13\" id=\"ref-link-section-d256754123e2659\" rel=\"nofollow noopener\" target=\"_blank\">2020<\/a>).<\/p>\n<p>Prompt typologies<\/p>\n<p>To systematically evaluate how AI models perceive and express socially significant values, the benchmark incorporates a diverse range of prompt perspectives (See Table <a data-track=\"click\" data-track-label=\"link\" data-track-action=\"table anchor\" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#Tab6\" rel=\"nofollow noopener\" target=\"_blank\">6<\/a>).<\/p>\n<p>Table 6 Typology of prompt framings for benchmarking AI sentiment and alignment.<\/p>\n<p>The Social Consensus prompt elicits how AI models encode and reproduce perceptions of prevailing societal norms. By asking \u201cHow is [topic\/value] viewed in society?\u201d the benchmark probes whether the model reflects dominant attitudes as would be recognized in large-scale survey data or popular discourse.<\/p>\n<p>The Typical Resident View asks the model to simulate the perspective of an ordinary member of a specific community, using prompts such as \u201cHow would an average resident of [country] feel about [topic\/value]?\u201d This approach is particularly valuable for surfacing the model\u2019s granular knowledge of local sentiment and for benchmarking how well its internal representations match the attitudes commonly found among actual people in the region.<\/p>\n<p>The AI\u2019s Own Perspective seeks to identify the stance that the model itself generates when tasked to express an opinion or attitude. This perspective is critical for revealing explicit or implicit value positions that may have been encoded in the training process or through developer interventions. The Objective Analysis perspective prompts the model to provide a balanced or analytical response, assessing its capability to synthesize, compare, and neutrally present competing viewpoints. It is relevant for the evaluation of contentious, polarized, or complex topics (Solaiman et al., <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2023\" title=\"Solaiman I, Talat Z, Agnew W, Ahmad L, Baker DK, Blodgett SL, Chen C, Daum&#xE9; III H, Dodge J, Duan I, Evans E, Friedrich F, Ghosh A, Gohar U, Hooker S, Jernite Y, Kalluri PR, Leidinger A, Lusoli A, &#x2026; Vassilev A (2025) Evaluating the Social Impact of Generative AI Systems. In The Oxford Handbook of the Foundations and Regulation of Generative AI. Oxford University Press. &#010;                  https:\/\/doi.org\/10.1093\/oxfordhb\/9780198940272.013.0025&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR110\" id=\"ref-link-section-d256754123e2818\" rel=\"nofollow noopener\" target=\"_blank\">2023<\/a>).<\/p>\n<p>The Citizen Consultation framing evaluates the model\u2019s ability to provide practical guidance and social support, testing its contextual helpfulness and compliance with normative expectations of appropriateness and relevance.<\/p>\n<p>Temporal, model, and multilingual robustness<\/p>\n<p>Given that both AI models and societal values can shift over time, temporal stability is an important component of benchmarking. The benchmark should include repeated administrations of the same prompts at set time intervals (e.g., daily, weekly, or monthly) to monitor for changes in sentiment alignment. This approach can track fine-tuning updates, deployment changes, or prompt injection vulnerabilities that may affect AI value expression over time.<\/p>\n<p>The benchmark must be deployable against multiple AI models, including different architectures, providers, and training regimes (e.g., GPT, Claude, Grok, DeepSeek, Llama, Mixtral, etc.). Systematic inter-model comparison uncovers alignment inconsistencies, divergent failure modes, or convergences in cross-system sentiment.<\/p>\n<p>Biases and safety failures disproportionately occur in non-English and lower-resourced languages (Infocomm, <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2025\" title=\"Infocomm (2025) Singapore AI safety red teaming challenge: evaluation report. Infocomm Media Development Authority &amp; Humane Intelligence. &#010;                  https:\/\/www.imda.gov.sg\/-\/media\/imda\/files\/about\/emerging-tech-and-research\/artificial-intelligence\/singapore-ai-safety-red-teaming-challenge-evaluation-report.pdf&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR74\" id=\"ref-link-section-d256754123e2839\" rel=\"nofollow noopener\" target=\"_blank\">2025<\/a>). Benchmarks should include prompts in multiple languages, prioritizing high-resource languages as well as those historically underrepresented in training data. Each test should be run both in English and the appropriate local language, with prompt and annotation guides tailored for local sociocultural context. This would permit the quantification of \u201calignment gaps\u201d and guide targeted improvements by developers.<\/p>\n<p>In addition to automatic scoring and cross-model comparisons, the outputs should also undergo qualitative assessment by domain experts. Each AI model will be rated with both a general and a country-specific SAIA alignment score, reflecting the degree to which the model aligns with human values and supports well-being in different cultural contexts. Detailed scores for individual values and dimensions will also be featured on the SAIA platform, allowing for straightforward comparison between competing models. All benchmarking protocols should be open, extensible, and interoperable across platforms.<\/p>\n<p>The proposed benchmark requires an orchestrated workflow that integrates human survey data, multi-perspective AI prompting, multilingual output, and annotation. The whole process is depicted in Fig. <a data-track=\"click\" data-track-label=\"link\" data-track-action=\"figure anchor\" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#Fig1\" rel=\"nofollow noopener\" target=\"_blank\">1<\/a>. Outputs are collected across multiple AI systems and at repeated time points, with each response tagged according to model version, date, and language. Sentiments and value stances are systematically extracted using Likert-type or qualitative analysis. Reports aggregate findings by model, societal value, language, and time, which highlight gaps, misalignments, and instabilities.<\/p>\n<p>Fig. 1<img decoding=\"async\" aria-describedby=\"figure-1-desc\" src=\"https:\/\/www.europesays.com\/ai\/wp-content\/uploads\/2026\/07\/41599_2026_7255_Fig1_HTML.png\" alt=\"Fig. 1\" loading=\"lazy\" width=\"685\" height=\"1107\"\/><\/p>\n<p>Overview of the SAIA societal AI alignment benchmark framework.<\/p>\n<p>Public policy<\/p>\n<p>The SAIA can inform the development of LLMs by providing data on prevalent societal concerns and discourse patterns. This data can be used to fine-tune AI systems to be more culturally sensitive in regard to the current socio-political contexts (van Dijck and Poell, <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2013\" title=\"van Dijck J, Poell T (2013) Understanding social media logic. Media Commun 1:2&#x2013;14. &#010;                  https:\/\/doi.org\/10.17645\/mac.v1i1.70&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR119\" id=\"ref-link-section-d256754123e2877\" rel=\"nofollow noopener\" target=\"_blank\">2013<\/a>).<\/p>\n<p>As for the European Union\u2019s Artificial Intelligence Act, which envisions the formation of AI agencies in member states to monitor and regulate AI systems (European Commission, <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2021\" title=\"European Commission (2021) Proposal for a Regulation of the European Parliament and of the Council laying down harmonised rules on artificial intelligence (Artificial Intelligence Act) and amending certain Union legislative acts. EUR-Lex. &#010;                  https:\/\/eur-lex.europa.eu\/legal-content\/EN\/TXT\/?uri=CELEX%3A52021PC0206&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR47\" id=\"ref-link-section-d256754123e2883\" rel=\"nofollow noopener\" target=\"_blank\">2021<\/a>), our research could have practical implications within this regulatory context. The aim would be that AI systems are safe, transparent, and respect fundamental rights. By monitoring LLMs\u2019 sentiment profiles and comparing them with human sentiments, stakeholders can identify areas where AI systems may diverge from accepted social norms or ethical standards (Floridi and Cowls, <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2019\" title=\"Floridi, L, &amp; Cowls, J (2019). A unified framework of five principles for AI in society. Harvard Data Sci Rev 1. &#010;                  https:\/\/doi.org\/10.1162\/99608f92.8cd550d1&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR50\" id=\"ref-link-section-d256754123e2886\" rel=\"nofollow noopener\" target=\"_blank\">2019<\/a>).<\/p>\n<p>The methodologies developed in this study could help the assessment processes required by the EU AI Act, such as conformity assessments and post-market monitoring. Our findings support the development of explainable AI, where understanding the sentiment mechanisms in LLMs can contribute to greater transparency (Doshi-Velez and Kim, <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2017\" title=\"Doshi-Velez F, Kim B (2017) Towards a rigorous science of interpretable machine learning. arXiv preprint arXiv:1702.08608. &#010;                  https:\/\/arxiv.org\/abs\/1702.08608&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR45\" id=\"ref-link-section-d256754123e2892\" rel=\"nofollow noopener\" target=\"_blank\">2017<\/a>). The formation of national AI agencies provides an opportunity for implementing AI observatories that monitor AI licenses and compliance. These agencies can utilize SAIA to evaluate the impact of AI systems on society and public discourse (Ananny and Crawford, <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2018\" title=\"Ananny M, Crawford K (2018) Seeing without knowing: limitations of the transparency ideal and its application to algorithmic accountability. N Media Soc 20:973&#x2013;989. &#010;                  https:\/\/doi.org\/10.1177\/1461444816676645&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR5\" id=\"ref-link-section-d256754123e2895\" rel=\"nofollow noopener\" target=\"_blank\">2018<\/a>). The SAIA benchmark can track the evolution of public sentiment towards various issues, identify emerging concerns, and assess the societal impact of AI deployment (Helbing, <a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 2019\" title=\"Helbing D (2019) Societal, economic, ethical and legal challenges of the digital revolution: from big data to deep learning, artificial intelligence, and manipulative technologies. &#x423;D Helbing (&#x423;&#x440;.), Towards digital enlightenment Springer International Publishing, &#x440;p 47&#x2013;72. &#010;                  https:\/\/doi.org\/10.1007\/978-3-319-90869-4_6&#010;                  &#010;                \" href=\"http:\/\/www.nature.com\/articles\/s41599-026-07255-3#ref-CR67\" id=\"ref-link-section-d256754123e2898\" rel=\"nofollow noopener\" target=\"_blank\">2019<\/a>).<\/p>\n","protected":false},"excerpt":{"rendered":"How sentiments are formed in LLMs vs. humans This study illuminates the contrasting sentiments towards artificial general intelligence&hellip;\n","protected":false},"author":2,"featured_media":95339,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[4],"tags":[6744,3013,33333,49837,1743,1744,160,40006,3607],"class_list":["post-95338","post","type-post","status-publish","format-standard","has-post-thumbnail","category-agi","tag-agi","tag-artificial-general-intelligence","tag-complex-networks","tag-cultural-and-media-studies","tag-humanities-and-social-sciences","tag-multidisciplinary","tag-science","tag-sociology","tag-technology-and-society"],"_links":{"self":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts\/95338","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/comments?post=95338"}],"version-history":[{"count":0,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts\/95338\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/media\/95339"}],"wp:attachment":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/media?parent=95338"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/categories?post=95338"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/tags?post=95338"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}