{"id":446353,"date":"2025-12-14T11:27:17","date_gmt":"2025-12-14T11:27:17","guid":{"rendered":"https:\/\/www.europesays.com\/us\/446353\/"},"modified":"2025-12-14T11:27:17","modified_gmt":"2025-12-14T11:27:17","slug":"for-the-first-time-ai-analyzes-language-as-well-as-a-human-expert","status":"publish","type":"post","link":"https:\/\/www.europesays.com\/us\/446353\/","title":{"rendered":"For the First Time, AI Analyzes Language as Well as a Human Expert"},"content":{"rendered":"

The original version of this story<\/a> appeared in Quanta Magazine<\/a>.<\/p>\n

Among the myriad abilities that humans possess, which ones are uniquely human? Language has been a top candidate at least since Aristotle, who wrote that humanity was \u201cthe animal that has language.\u201d Even as large language models such as ChatGPT superficially replicate ordinary speech, researchers want to know if there are specific aspects of human language that simply have no parallels in the communication systems of other animals or artificially intelligent devices.<\/p>\n

In particular, researchers have been exploring the extent to which language models can reason about language itself. For some in the linguistic community, language models not only don\u2019t have reasoning abilities, they can\u2019t. This view was summed up by Noam Chomsky, a prominent linguist, and two coauthors in 2023, when they wrote in The New York Times<\/a> that \u201cthe correct explanations of language are complicated and cannot be learned just by marinating in big data.\u201d AI models may be adept at using language, these researchers argued, but they\u2019re not capable of analyzing language in a sophisticated way.<\/p>\n

\"Image<\/p>\n

Ga\u0161per Begu\u0161, a linguist at the University of California, Berkeley.<\/p>\n

Photograph: Jami Smith<\/p>\n

That view was challenged in a recent paper<\/a> by Ga\u0161per Begu\u0161<\/a>, a linguist at the University of California, Berkeley; Maksymilian D\u0105bkowski<\/a>, who recently received his doctorate in linguistics at Berkeley; and Ryan Rhodes<\/a> of Rutgers University. The researchers put a number of large language models, or LLMs, through a gamut of linguistic tests\u2014including, in one case, having the LLM generalize the rules of a made-up language. While most of the LLMs failed to parse linguistic rules in the way that humans are able to, one had impressive abilities that greatly exceeded expectations. It was able to analyze language in much the same way a graduate student in linguistics would\u2014diagramming sentences, resolving multiple ambiguous meanings, and making use of complicated linguistic features such as recursion. This finding, Begu\u0161 said, \u201cchallenges our understanding of what AI can do.\u201d<\/p>\n

This new work is both timely and \u201cvery important,\u201d said Tom McCoy<\/a>, a computational linguist at Yale University who was not involved with the research. \u201cAs society becomes more dependent on this technology, it\u2019s increasingly important to understand where it can succeed and where it can fail.\u201d Linguistic analysis, he added, is the ideal test bed for evaluating the degree to which these language models can reason like humans.<\/p>\n

Infinite Complexity<\/p>\n

One challenge of giving language models a rigorous linguistic test is making sure they don\u2019t already know the answers. These systems are typically trained on huge amounts of written information\u2014not just the bulk of the internet, in dozens if not hundreds of languages, but also things like linguistics textbooks. The models could, in theory, simply memorize and regurgitate the information that they\u2019ve been fed during training.<\/p>\n

To avoid this, Begu\u0161 and his colleagues created a linguistic test in four parts. Three of the four parts involved asking the model to analyze specially crafted sentences using tree diagrams, which were first introduced in Chomsky\u2019s landmark 1957 book, Syntactic Structures. These diagrams break sentences down into noun phrases and verb phrases and then further subdivide them into nouns, verbs, adjectives, adverbs, prepositions, conjunctions and so forth.<\/p>\n

One part of the test focused on recursion\u2014the ability to embed phrases within phrases. \u201cThe sky is blue\u201d is a simple English sentence. \u201cJane said that the sky is blue\u201d embeds the original sentence in a slightly more complex one. Importantly, this process of recursion can go on forever: \u201cMaria wondered if Sam knew that Omar heard that Jane said that the sky is blue\u201d is also a grammatically correct, if awkward, recursive sentence.<\/p>\n","protected":false},"excerpt":{"rendered":"The original version of this story appeared in Quanta Magazine. Among the myriad abilities that humans possess, which…\n","protected":false},"author":3,"featured_media":446354,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[21],"tags":[691,738,42464,6746,159,158,67,132,68],"class_list":{"0":"post-446353","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-artificial-intelligence","8":"tag-ai","9":"tag-artificial-intelligence","10":"tag-languages","11":"tag-quanta-magazine","12":"tag-science","13":"tag-technology","14":"tag-united-states","15":"tag-unitedstates","16":"tag-us"},"share_on_mastodon":{"url":"https:\/\/pubeurope.com\/@us\/115717686284380459","error":""},"_links":{"self":[{"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/posts\/446353","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/comments?post=446353"}],"version-history":[{"count":0,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/posts\/446353\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/media\/446354"}],"wp:attachment":[{"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/media?parent=446353"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/categories?post=446353"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/tags?post=446353"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}