Until recently, the biggest concern for someone using a credit card abroad was that their bank might block the transaction as potential fraud.<\/p>\n
The fix was to call customer service and confirm the transaction by voice. The card would be unblocked. The process relied on a simple assumption that the person on the phone was who they claimed to be.<\/p>\n
That assumption no longer holds.<\/p>\n
A new PLoS One study<\/a> found that artificial intelligence has reached a point where cloned voices are indistinguishable from genuine ones. In the experiment, participants were asked to tell human voices from AI-generated ones across 80 samples. Cloned voices were mistaken for real in 58% of cases, while human voices were correctly identified only 62% of the time.<\/p>\n \u201cAI-generated voices are all around us now,\u201d said lead author Dr. Nadine Lavan<\/a>, senior lecturer at Queen Mary University of London<\/a>, per a LiveScience report<\/a>. \u201cWe\u2019ve all spoken to Alexa or Siri, or had our calls taken by automated customer service systems. Those things don\u2019t quite sound like real human voices, but it was only a matter of time until AI technology began to produce naturalistic, human-sounding speech.\u201d<\/p>\n In practical terms, AI has passed its first Turing test<\/a> in sound. Alan Turing\u2019s benchmark proposed that a machine could be considered intelligent when a human could no longer tell it apart from another human. That threshold now applies to voice. What we hear can no longer be taken as proof of who is speaking or who is authorizing a transaction.<\/p>\n Advertisement: Scroll to Continue<\/p>\n The Human Voice as a New Fraud Vector<\/strong><\/p>\n OpenAI<\/a> CEO Sam Altman<\/a> warned over the summer that AI has defeated the voice ID<\/a> systems many banks still rely on, calling it \u201ca crazy thing to still be doing.\u201d Altman told central bankers that AI can now replicate a customer\u2019s voice with near-perfect precision and that the next phase will involve video indistinguishable from live calls.<\/p>\n Altman\u2019s comments highlight a weakness in financial security. Many authentication systems are still built on the assumption that sound is a reliable indicator of identity. However, that assumption is becoming outdated.<\/p>\n The PYMNTS Intelligence report \u201cThe Impact of Financial Scams on Consumers\u2019 Finances and Banking Habits<\/a>\u201d found that fraud has become targeted and adaptive.<\/p>\n \u201cScammers have adopted advanced techniques for their financial scams, drawing parallels to how businesses personalize consumer outreach,\u201d the report said. \u201cThis shift reflects a growing sophistication in fraud strategies. Rather than one-size-fits-all targeting, savvy scammers exploit consumers\u2019 unique circumstances.\u201d<\/p>\n For banks and wealth managers, the PLoS One study exposes a growing operational and reputational risk. A voice call that sounds authentic can lead to unauthorized transfers, approval of false instructions, or exposure of sensitive information.<\/p>\n \u201cAs scammers continue to refine their tactics, [financial institutions] must invest in advanced analytics and behavioral monitoring to stay ahead of these tailored threats,\u201d the PYMNTS Intelligence report said.<\/p>\n The Collapse of Auditory Trust<\/strong><\/p>\n Regulators have begun to respond.<\/p>\n The Federal Trade Commission<\/a> said in August that there has been a more than fourfold increase in impersonation scams<\/a> since 2020, with losses in the hundreds of millions of dollars.<\/p>\n In 2024, the FTC held a Voice Cloning Challenge<\/a> to address the harms of AI-enabled voice cloning technologies. The goal was to \u201cfoster breakthrough ideas on preventing, monitoring and evaluating malicious voice cloning.\u201d<\/p>\n \u201cA strong approach to AI-enabled voice cloning ensures that AI companies releasing tools that have the potential for misuse may be held liable for assisting and facilitating illegal activity in certain circumstances if they do not implement guardrails to prevent it,\u201d the FTC said in an April 2024 press release<\/a>.<\/p>\n The Federal Communications Commission<\/a> ruled in February 2024 that AI-generated voices in robocalls<\/a> violate the Telephone Consumer Protection Act<\/a>.<\/p>\n Meanwhile, Consumer Reports Advocacy<\/a> documented in August rising consumer concern, with more than 75,000 signing a petition urging stricter enforcement against voice-cloning scams<\/a>.<\/p>\n The World Economic Forum<\/a> identified in July deepfake<\/a> speech and identity impersonation as emerging risks to digital financial infrastructure.<\/p>\n