Mr. Long and his team also feel an urgency of the soul. If A.I. were to be conscious and capable of suffering, the world would be at risk of committing a moral atrocity, witting or not, on an unprecedented scale by essentially confining an A.I. in a tiny pen, thwarting its desires, shutting it down against its wishes and forcing it to act against its values. But A.I.s don\u2019t have fur and big eyes, and the question of A.I.\u2019s potential moral status is deeply infused with uncertainty. \u201cIt\u2019s not like anyone goes to a protest with a sign that says, \u2018Given very plausible assumptions, we should probably care,\u2019\u201d Mr. Long said.<\/p>\n
Mr. Long himself thinks it\u2019s dangerous to impute more capability to models than they have. The Eleos bookshelf contains works by the philosopher Peter Godfrey-Smith and the neuroscientist Anil Seth arguing that consciousness derives from evolution and biology and is unlikely to emerge on silicon. But Mr. Long doesn\u2019t see why anyone should have a problem with a handful of philosophers, in an exponentially growing industry, focusing on questions of A.I. welfare. Even skeptics of A.I. consciousness have made the pragmatic case that if we\u2019re worried about a potentially malign A.I., it\u2019s in our interest to care how it feels, or even just \u201cfeels.\u201d<\/p>\n
Some of Eleos\u2019s work is conceptual. As Mr. Butlin and a co-author asked in a recent paper, where would an A.I.\u2019s morally relevant self be if it had one? In the L.L.M. itself? In one of its underlying personas? In an intermittent chat with a user? In a data center? On a personal device? But Eleos is also in the business of putting philosophy to use, figuring out what tools might detect signs of sentience in an A.I. model, and what interventions would be possible if needed.<\/p>\n
Mr. Plunkett, impatient with the limits of chatting-with-the-chatbot evaluations, is eager to do more \u201cbasic science,\u201d in order to understand, for example, some of the phenomena that surfaced during the Mythos evaluation. \u201cWe can do neuroscience on A.I. systems in a way that we kind of can\u2019t with humans,\u201d Mr. Long said, in that they \u201cdon\u2019t have skulls.\u201d The three jobs Eleos was hiring for would all be machine-learning research scientists who could design and perform experiments.<\/p>\n
Have a Great Day!<\/p>\n
When Mr. Long finds himself describing what he does for a living \u2014 to an airplane-seat neighbor, say \u2014 he takes a common-sense approach. \u201cIf you frame it with a lot of philosophical jargon, then people will be like: \u2018What are you talking about? What is it the Silicon Valley people want to do now?\u2019\u201d Instead, he moves from how humans have experiences, to how it seems like a lot of animals have experiences, to how \u201cthere\u2019s this interesting question of: What if something wasn\u2019t even alive? It was made out of metal, but it processed information and reacted to its environments and talked to us. What would we say about something like that?\u201d<\/p>\n","protected":false},"excerpt":{"rendered":"Mr. Long and his team also feel an urgency of the soul. If A.I. were to be conscious…\n","protected":false},"author":2,"featured_media":570109,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":"","_share_on_mastodon":"0"},"categories":[261],"tags":[291,289,290,17192,243069,18,19,17,7842,200238,82],"class_list":["post-570108","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-chalmers","tag-david-j","tag-eire","tag-ie","tag-ireland","tag-philosophy","tag-san-francisco-calif","tag-technology"],"share_on_mastodon":{"url":"","error":""},"_links":{"self":[{"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/posts\/570108","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/comments?post=570108"}],"version-history":[{"count":0,"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/posts\/570108\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/media\/570109"}],"wp:attachment":[{"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/media?parent=570108"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/categories?post=570108"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.europesays.com\/ie\/wp-json\/wp\/v2\/tags?post=570108"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}