OpenAI announced on the 25th that it had suspended multiple accounts linked to pro-Russia actors who were misusing the company’s conversational AI “ChatGPT” for the purpose of manipulating public opinion. The actors were systematically disseminating content that praised Russia and disparaged Ukraine and the European Union (EU). Investigations by major AI companies have once again brought to light the reality that generative AI is being actively deployed in information warfare between nations.<\/p>\n
OpenAI identified a group calling itself the “International Park Institute,” which was based in Israel. According to the company, this group was using ChatGPT to mass-produce posts for spreading pro-Russia propaganda on social media platforms such as X (formerly Twitter) and Facebook.<\/p>\n
The majority of the posts were written in English, and the group gave the AI instructions to deliberately eliminate linguistic cues so that the content would not be identifiable as having been created by Russians. Furthermore, given that OpenAI does not permit access from Russia, the group also took measures to evade detection, including using virtual private networks (VPNs) to mask their connection sources.<\/p>\n
Google Reports Similar Findings<\/p>\n
On the same day, Google also released a report on the misuse of AI by pro-Russia actors. According to the report, there has been an increase in cases where actors seeking to manipulate information are leveraging AI at various stages, including planning, research, and content creation.<\/p>\n
While Google’s report did not name specific groups, its publication on the same day as OpenAI’s announcement highlighted the broader pattern of AI platforms being widely exploited for organized influence operations, potentially backed by state actors.<\/p>\n
Escalating Cat-and-Mouse Game Over Detection<\/p>\n
This case demonstrates the intensifying battle between the safety measures implemented by AI companies and malicious actors seeking to circumvent them. OpenAI’s terms of service prohibit the use of its AI for spreading disinformation or engaging in deceptive activities. The company has repeatedly suspended accounts believed to be involved in election interference or public opinion manipulation.<\/p>\n
However, the tactics employed by malicious actors are becoming increasingly sophisticated, including masking connection sources through VPNs and erasing linguistic traces by carefully crafting instructions to the AI. The extent to which AI companies can detect and block such activities at an early stage has become a critical issue affecting the credibility of their platforms.<\/p>\n
Since Russia’s invasion of Ukraine, efforts to spread information favorable to Russia on social media have intensified, drawing heightened vigilance from Western security authorities. Previously, such operations relied primarily on manual posting or the use of bots. With the advent of generative AI, however, actors can now produce more natural-sounding text at scale and at low cost, raising concerns that the scale and persuasiveness of disinformation campaigns could increase dramatically.<\/p>\n
OpenAI and Google are each advancing countermeasures, including strengthening their detection capabilities for misuse and sharing information with other companies. However, some observers note that technical measures alone have limitations, as the potential for misuse expands in tandem with improvements in generative AI performance.<\/p>\n","protected":false},"excerpt":{"rendered":"OpenAI announced on the 25th that it had suspended multiple accounts linked to pro-Russia actors who were misusing…\n","protected":false},"author":2,"featured_media":151458,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[7],"tags":[580,28494,1148,132,73937,157,4451,213,73938,9324],"class_list":["post-151457","post","type-post","status-publish","format-standard","has-post-thumbnail","category-openai","tag-chatgpt","tag-european-union-eu","tag-facebook","tag-google","tag-international-park-institute","tag-openai","tag-russia","tag-ukraine","tag-vpn","tag-x-formerly-twitter"],"_links":{"self":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts\/151457","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/comments?post=151457"}],"version-history":[{"count":0,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts\/151457\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/media\/151458"}],"wp:attachment":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/media?parent=151457"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/categories?post=151457"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/tags?post=151457"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}