Surely Anthropic did not institute its watermark to discourage people from using Claude, or to make its product less appealing\u2014so why, then, would it choose to make its automated text more obviously traceable in the first place? The company\u2019s official announcement explained that the change was made to comply with the E.U. A.I. Act, which requires L.L.M. providers to make A.I.-generated text identifiable as such. This identification could take the form of a watermark, metadata, or a cryptographic signal\u2014statistical signatures that allow detection systems to determine whether text, images, or audio was created or manipulated by A.I. Google Gemini, for instance, uses a watermark called SynthID in its A.I.-generated material. OpenAI currently applies detection methods only to images and audio, but, after the E.U. A.I. Act\u2019s \u201ctransparency obligations\u201d went into effect, the company stated that it was \u201cworking to expand provenance measures\u201d for ChatGPT text. These A.I. companies emphasize that tracking properties like the watermark won\u2019t be discernible to the average reader and can\u2019t be traced to whoever prompted the L.L.M. to generate the text\u2014unless, of course, said person attempts to publish or present the text as his own and is outed by a detection system.<\/p>\n
Anthropic\u2019s motives, however, may not be limited to complying with the E.U. and upholding its stated values of safety and transparency. The company may, quite simply, want to make it easier for its models to verify human-written text and exclude A.I.-generated material when training its L.L.M.s, out of fear that training an A.I. model on A.I.-generated content might lead to a decline in reliability and quality. (The irony!) It also may be angling to assert \u201cprovenance\u201d\u2014a cherished word among A.I. providers\u2014over their L.L.M.s\u2019 output, establishing a sort of intellectual property over what their product creates, unique from its competitors. It\u2019s hard not to perceive the whole identification operation as, in some ways, an advancement in A.I. surveillance\u2014a way of tracking where a chatbot\u2019s words go after they leave the machine, creating a Rolodex of use cases for future referral. \u201cYou know what this reminds me of?\u201d the same addled Reddit poster wrote in his anti-watermark manifesto. \u201cThose police operations that arrest the drug user and leave the dealer alone. Watermarking is the same thing.\u201d A company like Anthropic may reasonably view watermarking as a harmless and sensible evolution: a boon to their training data, a legally compliant expansion of A.I. transparency, and a way to determine if something originated with its model. But, to its users, the stain of a watermark mainly forecasts a senseless form of social punishment, a tactic to tarnish anyone who dares use A.I.-generated material instead of plumbing the muck of their own mind.<\/p>\n
Some critics have argued that the watermark will prove largely ineffective for flagging anything short of blatant chatbot use. When an L.L.M. like Claude generates text, it typically makes its word choices from a range of statistically probable options. With a watermark, however, the model hews toward a more predetermined set of outcomes. These outcomes can accumulate into a statistical pattern that allows a detection system to calculate the likelihood that Claude generated a piece of text. If one were to rigorously edit, or rewrite, text that the L.L.M. spits out, the detection system may struggle to pick up the pattern, but arguably that\u2019s a feature and not a bug\u2014isn\u2019t catching the most obvious abuses of using A.I. for writing the point of something like a watermark, or at least a slightly more ethical internal system than the current system of nothing?<\/p>\n
Aside from anxieties that the watermark is merely a red herring, an easy-to-evade compliance strategy, some watermark detractors fear that these statistical signatures will make chatbots worse at writing. John Gruber, a tech blogger, posited that Claude would now more readily default to watermarked words, rather than unleash the full scope of its linguistic range, which might result in lower-quality text, or in some cases unusable prose. This outcome is certainly possible if L.L.M.s begin to gravitate toward specific synonyms or phrases that hinder the explanatory prowess and precision of, say, an instruction manual or a doctor\u2019s note\u2014documents that are increasingly being outsourced to L.L.M.s. But many experts agree that Gruber\u2019s concerns are overblown; Steven Murdoch, a professor of security engineering at University College London, told the Guardian<\/a> that the change \u201cprobably wouldn\u2019t have any noticeable impact.\u201d<\/p>\n","protected":false},"excerpt":{"rendered":"Surely Anthropic did not institute its watermark to discourage people from using Claude, or to make its product…\n","protected":false},"author":2,"featured_media":145284,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[8],"tags":[53,3154,5007,182],"class_list":["post-145283","post","type-post","status-publish","format-standard","has-post-thumbnail","category-anthropic","tag-anthropic","tag-anthropic-claude","tag-artificial-intelligence-a-i","tag-claude"],"_links":{"self":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts\/145283","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/comments?post=145283"}],"version-history":[{"count":0,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts\/145283\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/media\/145284"}],"wp:attachment":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/media?parent=145283"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/categories?post=145283"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/tags?post=145283"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}