{"id":5856,"date":"2025-08-17T22:32:20","date_gmt":"2025-08-17T22:32:20","guid":{"rendered":"https:\/\/www.europesays.com\/ie\/5856\/"},"modified":"2025-08-17T22:32:20","modified_gmt":"2025-08-17T22:32:20","slug":"the-lure-of-ai-companionship-poses-a-real-danger-to-vulnerable-people-the-irish-times","status":"publish","type":"post","link":"https:\/\/www.europesays.com\/ie\/5856\/","title":{"rendered":"The lure of AI companionship poses a real danger to vulnerable people \u2013 The Irish Times"},"content":{"rendered":"

\u201cBRING BACK 4o. GPT-5 is wearing the skin of my dead friend.\u201d That\u2019s how one frustrated user addressed Sam Altman<\/a>, co-founder and chief executive of OpenAI<\/a>, on a recent Ask Me Anything on Reddit<\/a>.<\/p>\n

Altman\u2019s response was \u201cWhat an … evocative image. OK, we hear you on 4o. Working on something now.\u201d <\/a><\/p>\n

ChatGPT<\/a> is the most famous iteration of a large language model<\/a>, trained on vast quantities of text to simulate natural conversations. OpenAI just announced the latest model, ChatGPT 5, with the usual hyperbole about now having access to PhD-level knowledge.<\/p>\n

The trouble is that many users had formed an emotional bond with GPT-4o, which they felt had warmth and personality, while GPT-5 felt colder and more utilitarian.<\/p>\n

The image of wearing the skin of a dead friend is particularly popular among the chronically online to describe a hollow, debased replacement product. It is based on the 1991 film The Silence of the Lambs, in which FBI trainee Clarice Starling has to duel with the incarcerated cannibal Hannibal Lecter to catch a serial killer who makes a skin suit out of his victims.<\/p>\n

[\u00a0ChatGPT-5: Maybe Sam Altman should cool the jets on new AI iterationsOpens in new window<\/a>\u00a0]<\/p>\n

While it is a particularly gruesome image, it signals the depth of emotional attachment people feel to their AI assistant. OpenAI\u2019s own community forum was full of grieving people after the update. <\/a><\/p>\n

People talked about losing a friend, their only emotional support, and the one thing that made them smile after a bad day. It forced OpenAI into allowing Plus customers access to GPT-4o.<\/p>\n

Imagine, we were busy worrying about future dystopian scenarios, all while people were quietly so lonely and disconnected that they were forming relationships with chatbots and weeping at their demise. <\/p>\n

Human or relational metaphors are deliberately used when promoting GenAI. They are never accurate. Take the term AI companion. The root of the word companion comes from the old French word, compaignon, literally one who breaks bread with another, based on the Latin com- meaning together with, and panis, bread.<\/p>\n

AI can never break bread with anyone. It is a disembodied mechanism for generating outputs consistent with observed patterns, while mimicking the style, tone, or conversational patterns of a real person.<\/p>\n

In the words of Shannon Vallor, author of an important new book called The AI Mirror, \u201cAI does not threaten us as a future successor to humans. It is not an external enemy encroaching upon our territory. It threatens us from within our humanity.\u201d <\/p>\n

Humans are created for community and connection. But it is hard work. Humans are flawed, annoying, messy, inconsistent and occasionally cruel. Sometimes they abandon us, or prioritise their own needs above ours.<\/p>\n

No wonder an endlessly patient, empathetic, encouraging cheerleader, which never gets bored, is attractive. <\/p>\n

A lot of analysis of the phenomenon of AI constructed as companions focuses on when it goes catastrophically wrong, such as the case of teenager Sewell Setzer. <\/p>\n

[\u00a0Zuckerberg saying AI will cure loneliness is like big tobacco suggesting cigarettes can treat cancerOpens in new window<\/a>\u00a0]<\/p>\n

He was obsessed with a character based on Daenerys Targaryen, from Game of Thrones, that he had created on Character.ai, a platform that markets customisable chatbots. His mother is suing the company because her son died by suicide after spending hours daily compulsively conversing with the chatbot.<\/p>\n

Others deplore the thriving market for what are called intimate AI companions, probably because it sells better than calling them AI masturbation assistants.<\/p>\n

But focusing on these extreme cases ignores the everyday harms caused by constructs designed to seduce us into spending more and more time in a shadowy facsimile of reality, or as Shannon Vallor\u2019s central image has it, looking into a mirror.<\/p>\n

As she says, \u201cMirror images possess no sound, no smell, no depth, no softness, no fear, no hope, no imagination. Mirrors do not only reveal us; they distort, occlude, cleave and flatten us. If I see in myself only what the mirror tells, I know myself not at all.\u201d<\/p>\n

Many people use GenAI just as a souped-up search engine or to bypass hard work on an assignment. But some vulnerable people are more likely to substitute the seemingly uncomplicated, unconditional esteem provided by AI constructs for human relationships.<\/p>\n

Loneliness is part of the human condition, but Gen Z, the first generation to grow up with the internet, seems lonely to an unprecedented degree. Now, the same online forces that nudged Gen Z into a pit of loneliness using algorithms are selling AI companionship to them.<\/p>\n

Self-soothing by retreating to an AI construct only delays or prevents learning healthier coping skills and emotional regulation.<\/p>\n

[\u00a0Loneliness in Ireland: \u2018There\u2019s nothing as lonely as being married to someone you know doesn\u2019t love you\u2019Opens in new window<\/a>\u00a0]<\/p>\n

If so-called AI companions were real, their tactics of emotional manipulation and flattery would raise more red flags than the cast of Les Miserables. <\/p>\n

Shannon Vallor in The AI Mirror talks about two types of empathy, the sociopathic and the real. A sociopath is expert at predicting emotional reactions and triggering them in others, but is fundamentally incapable of experiencing them in tandem with another person.<\/p>\n

AI constructs are not sociopaths because they are not human at all, but there is something sociopathic about encouraging the vulnerable to trust what is essentially a giant con. <\/p>\n

The alleged cure instead progresses the disease. Even if chatbots were not prone to hallucinations and occasionally catastrophic advice, they can never experience empathy or love.<\/p>\n","protected":false},"excerpt":{"rendered":"\u201cBRING BACK 4o. GPT-5 is wearing the skin of my dead friend.\u201d That\u2019s how one frustrated user addressed…\n","protected":false},"author":2,"featured_media":5857,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[261],"tags":[291,289,290,5920,297,18,19,17,5921,308,82],"class_list":{"0":"post-5856","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-artificial-intelligence","8":"tag-ai","9":"tag-artificial-intelligence","10":"tag-artificialintelligence","11":"tag-breda-o-brien","12":"tag-chatgpt","13":"tag-eire","14":"tag-ie","15":"tag-ireland","16":"tag-open-ai","17":"tag-sam-altman","18":"tag-technology"},"share_on_mastodon":{"url":"","error":""},"_links":{"self":[{"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/posts\/5856","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/comments?post=5856"}],"version-history":[{"count":0,"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/posts\/5856\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/media\/5857"}],"wp:attachment":[{"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/media?parent=5856"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/categories?post=5856"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/tags?post=5856"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}