I’m getting a bit tired of reading about Anthropic CEO Dario Amodei and how he will ensure that AI models do what’s best for humanity.<\/p>\n
Here is a reality check. The company is planning an IPO with a $2 trillion valuation and that’s going to have to be earned back and it won’t be easy as other open and closed-source models rapidly improve and pricing races to the bottom.<\/p>\n
Who will win? <\/p>\n
It won’t be the lab that’s most-aligned with humanity, whatever that might entail. The reality is that we’ve already seen a revealed preference in models away for what’s best for individuals and towards what people will actually spend money on.<\/p>\n
That showed that people want an echo chamber (as if all the information market wasn’t already telling us that). People want sycophancy, or at least the vast majority of people. Consumers want models who will tell them what they want to hear, that they’re smart, that they look pretty and everything is just right. Models that sell that, particullarly models that sell it in a subtle, imperceptible way, will win.<\/p>\n
That simple and self-evident truth is why there will never be alignment in AI models.<\/p>\n","protected":false},"excerpt":{"rendered":"I’m getting a bit tired of reading about Anthropic CEO Dario Amodei and how he will ensure that…\n","protected":false},"author":2,"featured_media":1178433,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":"","_share_on_mastodon":"0"},"categories":[3163],"tags":[323,1942,53,16,15],"class_list":["post-1178432","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-technology","tag-uk","tag-united-kingdom"],"share_on_mastodon":{"url":"https:\/\/pubeurope.com\/@uk\/117188297051591049","error":""},"_links":{"self":[{"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/posts\/1178432","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/comments?post=1178432"}],"version-history":[{"count":0,"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/posts\/1178432\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/media\/1178433"}],"wp:attachment":[{"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/media?parent=1178432"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/categories?post=1178432"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.europesays.com\/uk\/wp-json\/wp\/v2\/tags?post=1178432"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}