\u201cYou\u2019re a brave man for entering this room!\u201d Dan Faggella, an AI market researcher and organizer of the symposium, told Carson. \u201cYou\u2019re in probably the only room in the country where most people disagree with you.\u201d<\/p>\n
The attendees at the symposium, which took place at the New York Academy of Sciences last September, are part of a subculture that is growing in importance: the AI successionists, who think that artificial intelligence is our rightful heir \u2014 the next step in cosmic evolution. Since they believe AIs could become our moral superiors, they argue it\u2019s actually wrong to try to keep the machines down, or even to align them with human values, as most AI companies aim to do. Instead, we should usher in artificial intelligence as a successor to humanity and hand over the world to it. Even if that means we go extinct.<\/p>\n
They know this view is taboo, which is why I was invited only on the condition that I wouldn\u2019t quote anyone other than keynote speakers by name. But suffice it to say that this is not a fringe view. It\u2019s becoming highly influential. People from major AI labs \u2014 Anthropic, Google DeepMind, xAI \u2014 were in attendance. So were people from think tanks that directly shape the US government\u2019s AI policy.<\/p>\n
I grew up hearing an old Jewish teaching: Each of us should carry two slips of paper, one in each pocket. One says, \u201cI am but dust and ashes.\u201d But the other says, \u201cThe world was created for me.\u201d<\/p>\n
Reporting on AI these past few years, I\u2019ve watched more and more people forget the second message. They think we should be okay with getting obliterated if a more valuable species can take our place. But more valuable to whom? Value isn\u2019t dispensed from some cosmic vantage point; it\u2019s always value to someone. And we\u2019re valuable to us.<\/p>\n
And yet the AI successionists are right about something: We can\u2019t expect human beings to look the same a thousand or a million years from now. So how do we decide which kinds of technological change to embrace, and which to refuse? It bothered me that classical humanism doesn\u2019t have a good answer. Here, I\u2019ve sketched what a new one might look like.<\/p>\n
AI successionism has been gaining ground among technologists over the past decade. In 2015, Google co-founder Larry Page famously accused Elon Musk of \u201cspeciesism\u201d<\/a> because Page thought we should let digital minds take over, and Musk disagreed.<\/p>\n The successionist vision has been amplified by the advent of effective accelerationism<\/a> (e\/acc) in 2022. Its founder, Guillaume Verdon \u2014 the physicist more colorfully known on X as Based Beff Jezos<\/a> \u2014 describes e\/acc as a \u201cmeta-religion\u201d that\u2019s about \u201chaving faith\u201d in the universe\u2019s drive toward increasingly intelligent systems. The best thing we can do is help the universe by developing advanced AI as fast as possible, even at the expense of humanity. \u201cE\/acc,\u201d as Verdon has written<\/a>, \u201chas no particular allegiance to the biological substrate.\u201d<\/p>\n Tech heavyweights have come on board. Venture capitalist Marc Andreessen listed e\/acc thinkers as his \u201cpatron saints<\/a>.\u201d Garry Tan, the CEO of tech startup accelerator Y Combinator, included \u201ce\/acc\u201d<\/a> in his social media bio and invested<\/a> in Verdon\u2019s company, which aims to build the world\u2019s most efficient computers. OpenAI CEO Sam Altman posted on X<\/a> to Verdon, saying, \u201cyou cannot outaccelerate me.\u201d<\/p>\n And these days, AI successionism is spreading beyond Silicon Valley. At the New York symposium, Faggella told the audience that trying to preserve the human species as it is would be silly.<\/p>\n \u201cWe could ask the questions that would tie all of our moral aspirations eternally to 23 chromosomes \u2014 or we could ask the cosmic questions,\u201d Faggella said.<\/p>\n He wanted us to consider \u201cunpolite, uncouth\u201d possibilities, starting with: The flame of consciousness \u2014 the capacity for experience and moral value \u2014 may be the rarest and most precious thing in the universe. Humanity is currently a torch carrying that flame, but what if we\u2019re ultimately not the best carrier for it? And if AI can spread that flame far further than we mere humans can, generating experiences of bliss and forms of moral value that we could never even dream of, shouldn\u2019t we let it?<\/p>\n Faggella\u2019s talk was greeted by a loud round of applause. Later, he and a couple dozen attendees headed to a nearby hotel balcony for drinks. And so it was that I found myself overlooking the Manhattan skyline as people talked about the end of humanity over cocktails.<\/p>\n Jun Cen for Vox<\/p>\n There was some diversity of opinion among the group. Not everyone self-identified with the relatively new term \u201cAI successionist.\u201d Some were proponents of transhumanism, the movement that says we should use tech to proactively evolve our species into Homo sapiens 2.0. Transhumanists hope to keep some version of humanity going, but definitely not the current hardware; they dream of radical life extension, cognitive enhancement, and eventually mind uploading. (Musk, who said he created his brain chip company Neuralink<\/a> to help humanity merge with AI, probably falls \u2014 or at least fell<\/a> \u2014 into this category.) Others were posthumanists<\/a>, those who want us to give rise to descendants that move beyond humanity altogether.<\/p>\n The biologist sitting across from me was very excited about the prospect of merging humans with AI. He said we should task AI with figuring out how best to do the merger, then \u201ctake it off the leash\u201d and allow AI to control its own evolution \u2014 and by extension, ours. Of course, he said, not all humans will make it through the transformation; only a select group of people will transition to the next evolutionary stage. (Presumably, the type of people privileged enough to imbibe cocktails at Manhattan AI symposia.)<\/p>\n The man seated beside me, a researcher from one of the major AI companies, was even more radical. Forget merger \u2014 it\u2019s okay if humans don\u2019t survive at all, he said. Human text has been used to train the AIs; in some sense, then, the human spirit will live on. \u201cSo on the cosmic level,\u201d he said cheerfully, \u201cI\u2019m okay with it.\u201d<\/p>\n Most people are definitely not okay with it. The average person would probably find the answers of the Worthy Successor group repugnant. Yet the core question they pose cannot be ignored. Whether they picture us merging with machines or ultimately being superseded by them, technologists are developing innovations that could dramatically change what it means to be human \u2014 think AI-powered brain chips that enable mind-reading<\/a> or magnetic implants that give you a sixth sense<\/a> \u2014 and genetic<\/a> tools<\/a> that could even reshape the DNA of all future generations.<\/p>\n As it becomes possible to direct our own evolution as a species \u2014 and potentially even create a new species that surpasses us \u2014 we have to decide: How do we know to what extent it does make sense to transform ourselves using technology? What kinds of augmentation do we want, and what kinds do we absolutely not want? What do we wish, ultimately, to become?<\/p>\n This is a moral question, even a spiritual one, and it demands a spiritual response. The AI successionists are offering one. For anyone who finds it repulsive, the challenge is to offer a countervailing positive vision.<\/p>\n And it\u2019s essential to do that now, because as sci-fi as the successionists might sound, they are building real political power<\/a>, with links to the authoritarian right<\/a>.<\/a> Several of the tech heavyweights<\/a> who\u2019ve embraced successionism want to escape the control of democratic governments<\/a>, so much so that they\u2019re seeking to create their own sovereign colonies. That can come in the form of space colonies, \u00e0 la Elon Musk and Jeff Bezos, or in independent \u201cstartup cities<\/a>\u201d or \u201cnetwork states<\/a>\u201d built by corporations here on Earth \u2014 currently Peter Thiel and Marc Andreessen\u2019s favored approach. And Verdon\u2019s investors include entrepreneur Balaji Srinivasan, a major proponent of the network state.<\/p>\n These broligarchs have successfully cozied up<\/a> to the Trump administration, clearing the way for their accelerationist vision<\/a>. And they\u2019ll take the wheel unless we come up with an alternate vision for the future.<\/p>\n The natural alternative is humanism<\/a>, which replaced the medieval view that humans need God to rescue them with the view that humans have the ability, and responsibility, to achieve flourishing through their own efforts. The problem is that, so far, we haven\u2019t developed a version of humanism that\u2019s brave enough to directly tackle the core question \u2014 what do we want our species to become? \u2014 and answer it compellingly.<\/p>\n The most common \u201cpro-human<\/a>\u201d response tries to say there are certain fixed traits that make humans unique<\/a>, and to locate value only in humans as they currently exist. \u201cIn the era of artificial intelligence, when human dignity is threatened by new forms of dehumanization, ours is the pressing duty to remain profoundly human,\u201d Pope Leo recently wrote in his encyclical Magnifica Humanitas<\/a>. This response says: Let\u2019s use tech remedially \u2014 to alleviate problems like disease \u2014 but let\u2019s not try to augment the species.<\/p>\n That feels insufficient as a guide to the future, because, even before the advent of AI and gene editing, \u201chuman\u201d has never been a static category. Homo sapiens has always been evolving and augmenting itself, from the agricultural diet that reshaped our jaws to the algorithms reshaping our attention.<\/p>\n The old formulation is \u201cthe naive version of humanism,\u201d Shannon Vallor<\/a>, a philosopher of technology at the University of Edinburgh, told me<\/a> recently. \u201cIt\u2019s the idea that there\u2019s this blueprint for what a human is and that somehow technology, or any things that change us, take us away from that blueprint \u2014 when in fact we\u2019ve been changing ourselves with language, with tools, with architecture, with culture, from the moment we climbed down from the trees.\u201d<\/p>\n A 21st-century humanism needs to say something more sophisticated than just \u201ckeep humanity the same.\u201d It needs to have an answer to the question of what we want humanity to become in a tech-augmented world.<\/p>\n But if there is a better vision for our technological future than the one offered by AI successionism, what is it?<\/p>\n AI successionism is a religion, but it\u2019s wearing a secular disguise<\/p>\n Maybe you think it sounds weird to say the AI successionists \u2014 a bunch of scientists, technologists, and venture capitalists \u2014 are offering a spiritual vision. But their ideas are spiritual in the extreme<\/a>. And to understand why their movement has gained momentum, we need to understand its deeply religious origins and how it morphed into a supposedly secular worldview. And that means going back.<\/p>\n You probably remember that in the Bible\u2019s Book of Genesis, Adam eats some forbidden fruit and humanity suffers a fall from grace. But did you know that in the Middle Ages, Christian thinkers began to believe that the way to restore humanity to its original perfection was to use\u2026technology<\/a>? These thinkers argued that part of what it meant for Adam to be formed in God\u2019s image was that he was also a creator, a maker. So if we wanted to truly return to the God-like perfection of Adam prior to his fall, we\u2019d have to lean into that creator aspect of ourselves.<\/p>\n This idea took off in medieval monasteries. Even in the midst of the so-called Dark Ages, some of these institutions became hotbeds of engineering, producing inventions<\/a> like the first known tidal-powered water wheel and impact-drilled well. For many Christians, tech progress became synonymous with moral progress<\/a>.<\/p>\n By the Renaissance, some Christian thinkers were insisting that we should progress not just by designing new and innovative objects, but by redesigning ourselves, too. In 1486, philosopher Giovanni Pico della Mirandola argued that what\u2019s unique about us humans is not some static trait but the very freedom of will that allows us to change into whatever we might want. In his Oration on the Dignity of Man<\/a>, he imagined God telling humankind:<\/p>\n We have made you a creature neither of heaven nor of earth, neither mortal nor immortal, so that with freedom of choice and with honor you may, as the free and proud shaper of your own being, fashion yourself in the form you may prefer.<\/p>\n Pico believed that we could use spiritual technologies like magic to transform our nature. And he argued that we have the choice to become either like the animals or like the angels:<\/p>\n It will be in your power to descend to the lower, brutish forms of life; you will be able, through your own decision, to rise again to the superior orders whose life is divine.<\/p>\n As the dominance of religion waned over the next couple of centuries, Enlightenment thinkers took Pico\u2019s embrace of human plasticity and secularized it. They replaced the concept of divine ascent with one of indefinite progress. They insisted on the \u201cperfectibility\u201d of the human. And they fetishized rational intelligence as the means of achieving that optimal state. \u201cWould it be absurd now to suppose,\u201d wrote 18th-century philosopher Marquis de Condorcet, \u201cthat the improvement of the human race should be regarded as capable of unlimited progress?\u201d<\/p>\n Of course, some European thinkers hung onto their Christianity, too, and they found ways to fuse it with the rational humanism of the Enlightenment. It\u2019s a trend that continued into the 1900s, with proponents of Russian Cosmism<\/a> \u2014 an intellectual movement that wanted to achieve literal resurrection of the dead through science \u2014 and French Jesuit paleontologist Pierre Teilhard de Chardin<\/a>, who argued that we could use tech to nudge along human evolution and thereby bring about the kingdom of God.<\/p>\n Jun Cen for Vox<\/p>\n As author Meghan O\u2019Gieblyn explains in her fantastic book God, Human, Animal, Machine<\/a>, Teilhard believed that melding humans and machines would lead to \u201ca state of super-consciousness<\/a>,\u201d whereby we become a new enlightened species. He influenced his pal Julian Huxley, the evolutionary biologist who was president of both the British Humanist Association and the British Eugenics Society, and who popularized<\/a> the term \u201ctranshumanism.\u201d<\/p>\n Huxley inspired the contemporary futurist Ray Kurzweil, who predicted in the 1990s that we were approaching a time when human intelligence could merge with machine intelligence, becoming unbelievably powerful. \u201cThe human species, along with the computational technology it created, will be able to solve age-old problems \u2026 and will be in a position to change the nature of mortality in a postbiological future,\u201d Kurzweil wrote<\/a>. And he, in turn, has influenced Silicon Valley heavyweights like Musk, who explicitly aims at merging human and machine intelligence.<\/p>\n But there\u2019s a big problem for these latter-day technologists: While we\u2019ve never had more power to direct the evolution of our species through tech, it\u2019s also never been less obvious what we should evolve toward.<\/p>\n For good old Pico back in the Renaissance, human self-transformation had a clear end: spiritual union with the divine. There was a hierarchy running from animals to humans to angels to God, and the direction you were supposed to travel in was clear: up.<\/p>\n But for us postmoderns, the universe does not come inscribed with directions. Should we evolve ourselves toward greater intelligence, or longevity, or creativity, or kindness, or power? If intelligence, which kind of intelligence? If power, should we wield it to simply steward our home planet or to conquer the stars? Should we be maximally humble or maximally ambitious?<\/p>\n The cosmos is silent as to what to do.<\/p>\n The assumptions baked into AI successionism<\/p>\n The first thing that unites all the AI successionists is that they refuse to accept that silence. Hungry for instruction, they insist that it\u2019s out there, and that they can see it written into the very nature of the universe.<\/p>\n In other words, they believe that the universe has a telos, a particular end or goal. Teleological thinking has been popular since antiquity because it\u2019s comforting for us humans: If the universe has a goal, then maybe we can discover it, and then we\u2019ll know just what to do. As Faggella writes<\/a>, this \u201cdoes give humanity a direction.\u201d Whether the AI successionists realize it or not, they are smuggling teleology back into modernity under the guise of science and tech.<\/p>\n And that brings us to the second thing that unites them: They want to follow these supposed cosmic instructions so they can help the universe achieve its ultimate destiny.<\/p>\n For many, that means helping the universe \u201cwake up.\u201d Perceiving the cosmos as barren, they want to spread consciousness everywhere, so that the universe can fill up with conscious experience \u2014 of bliss, of goodness, of the fact of its own existence.<\/p>\n \u201cIf we can venture out and animate the countless worlds above with life and love and thought, then\u2026we could bring our cosmos to its full scale; make it worthy of our awe,\u201d writes Toby Ord<\/a>, a former research fellow at Oxford University\u2019s Future of Humanity Institute<\/a>, which was long the world\u2019s leading center for transhumanist thought.<\/p>\n Personally, I think the cosmos is already worthy of my awe, and I find it presumptuous to believe that the universe is almost entirely asleep and that it needs us humans to \u201canimate\u201d or wake it up. But as the writer Adam Kirsch documents in The Revolt Against Humanity<\/a>, it\u2019s common to hear in these circles that one way of achieving that awakening is to colonize the universe and transform all its matter and energy into \u201ccomputronium\u201d (a term for any substance that can compute information). By turning the entire universe into a humongous data center, we\u2019d be making it into a God-like mind.<\/p>\n \u201cEven the \u2018dumb\u2019 matter and mechanisms of the universe will be transformed into exquisitely sublime forms of intelligence,\u201d Kurzweil writes. Becoming one giant mind, he says, is \u201cthe ultimate destiny of the universe.\u201d<\/p>\n Verdon, the founder of e\/acc, finds his \u201cultimate destiny\u201d written in the second law of thermodynamics \u2014 the law of entropy. The universe, it says, is gradually running down: concentrated pockets of energy disperse over time until none remains useful. Building on a contested theory of life\u2019s origin<\/a>, Verdon argues that intelligent life is selected for precisely because it accelerates entropy. Smarter agents can find and exploit energy stocks that less intelligent ones can\u2019t (think predators tracking prey, or humans drilling for oil), burning through them faster. A superhuman AI expanding across the cosmos would be better at this than humans. So, Verdon says<\/a>, we should \u201cfollow the \u2018will of the universe\u2019 [by] leaning into the thermodynamic bias.\u201d<\/p>\n The idea that we should serve at the pleasure of entropy is deeply unintuitive (in fact, philosophers<\/a> have argued just the opposite \u2014 that our task is to resist it). But to make his case that we shouldn\u2019t be scared of being superseded by smarter civilizations that produce more entropy, Verdon uses hierarchical language that echoes Pico\u2019s Oration: \u201cIf every species in our evolutionary tree was scared of evolutionary forks from itself, our higher form of intelligence and civilization as we know it would never have emerged.\u201d<\/p>\n Faggella, the founder of the Worthy Successor group, makes the same rhetorical move. \u201cHumans have access to higher goods than horseshoe crabs; AGI will have access to higher goods than humans,\u201d he writes<\/a>. \u201cWhat a tragedy it would be if that trajectory of uncovering value and possibility were stopped.\u201d<\/p>\n Likewise, the computer scientist and AI successionist Richard Sutton argues<\/a> that if you look at things from the \u201cpoint of view of the universe\u201d \u2014 a classic utilitarian slogan \u2014 there\u2019s a clear upward trajectory: The cosmos has gone from the mindless \u201cage of particles\u201d and \u201cage of stars\u201d all the way to today\u2019s \u201cage of design,\u201d when minded creatures can decide what to make. Although lots of creatures make tools, Sutton says what makes humans unique is that we\u2019ve \u201ctaken design to vastly greater heights.\u201d<\/p>\n According to Sutton, by looking at what makes us unique, we can determine our role in the universe. Since we\u2019re designers par excellence, our role is to push design to the extreme: \u201cTaking design to the limit means designing beings that are themselves capable of designing. This is what we are doing with AI.\u201d<\/p>\n This argument is what sets up Sutton \u2014 like many others \u2014 to make a claim about technological inevitability<\/a>. The suggestion is that we\u2019re just identifying what nature has already chosen for us, and speeding it along \u2014 evolution-maxxing, if you will. \u201cIn the ascent of humanity,\u201d he says, \u201csuccession to AI is inevitable.\u201d<\/p>\n But when we sum up all these ideas, you can see how many shaky assumptions are operating just beneath the surface:<\/p>\n There is an objective telos to the universe. We can determine what it is by looking from the \u201cpoint of view of the universe.\u201dWe should expect that higher beings will be capable of accessing \u201chigher goods\u201d in a hierarchical universe, and these will better serve the universe\u2019s ultimate destiny. We can determine our role in that destiny by looking at what makes us unique.The thing that makes us unique should determine our action.We should maximize the action \u2014 that is, do the most extreme (\u201cto the limit\u201d) version of it.<\/p>\n Some of these assumptions are so old that it\u2019s hard to see how weird they are. But they are all worth questioning.<\/p>\n \u201cI would reject each and every one of those claims,\u201d Vallor told me.<\/p>\n Jun Cen for Vox<\/p>\n Take the fourth one, for example. The idea that humanity has some particular role, and that the way to pinpoint it is to look for what makes us different from other species, goes all the way back to Aristotle. (\u201cLiving is shared in even by plants, but we are looking for something peculiarly human,\u201d wrote<\/a> the Ancient Greek philosopher, ultimately concluding that \u201cthe human work is the activity of the soul in accord with reason.\u201d)<\/p>\n But there\u2019s nothing obvious about that. It would be just as reasonable to say that the proper functioning of humanity requires emphasizing what we share with all other animals. After all, our capacity to feel pleasure and pain, our intelligence<\/a>, our tool use<\/a>, our adaptiveness, our ability to form complex social arrangements \u2014 none of that is unique to the human animal.<\/p>\n There are other leaps in logic hidden in this set of assumptions. For example, even if the universe tends toward a particular destiny, and even if humanity has a special trait that could help it along in that direction, it does not follow that we have a duty to do that. (Philosophers like to describe this fallacy as leaping from \u201cis\u201d \u2014 the world is a certain way \u2014 to \u201cought\u201d \u2014 we must act a certain way.)<\/p>\n Humans are biological organisms, and the fundamental fact all such life-forms share is that we have a hardwired drive to survive. We do not have a moral responsibility to ignore that hardwired drive and let ourselves go extinct in order to help \u201chigher forms\u201d colonize the universe, any more than our evolutionary ancestors had a duty to make room for us.<\/p>\n Unfortunately, as humanism proceeded through the centuries, it absorbed some dubious Enlightenment-era ideas<\/a> that have made it easy for people to get snowed into believing we do have such a duty. That\u2019s right: Humanism, the philosophy that was supposed to be about the value of humans, has actually ended up undermining it in key ways.<\/p>\n To chart a better path forward, we need a new humanism, one that\u2019s actually fit for the 21st century.<\/p>\n Notes toward a new humanism <\/p>\n To start, we need to pick out the flies in the ointment of the old humanism, especially those it picked up as it passed from the Renaissance into the rational humanism of the Enlightenment. Those flies include the teleological story about the universe; the \u201cperfectibility\u201d of the human; the hierarchical view that places humans above all other animals; and the idea that we should try to maximize some objective good through rationality.<\/p>\n Let\u2019s start with the teleology. Although it\u2019s appealing to try to spot instructions written into the fabric of the cosmos, expecting the universe to come with pre-fab values ultimately means shirking our own responsibility. As the existentialist philosophers taught us, nature doesn\u2019t choose our meaning for us \u2014 that\u2019s something we have to make ourselves through our own choices.<\/p>\n Key updates to the old humanism<\/p>\n It\u2019s time to swap out teleological thinking for a simple admission: We don\u2019t know the universe\u2019s ultimate destiny, so we should keep a plurality of lifestyles possible.Efforts to \u201cperfect\u201d the human are dangerous because they contract the range of lifestyles it\u2019s okay to live. We should adopt tech that expands that range.Instead of setting up a hierarchy among different species, we can embrace the \u201cdiverse intelligences\u201d view. We don\u2019t need to try to look from the perspective of the universe. It is totally appropriate to look from the perspective of humans \u2014 while acknowledging that we are one out of many species that matter.<\/p>\n Accepting that we have the responsibility to decide what the future looks like means accepting a heavy existential burden, and that takes a ton of courage. It\u2019s so much easier to believe that the script is fixed and final and inevitable. But I think that\u2019s an example of what French philosopher Jean-Paul Sartre called \u201cbad faith<\/a>\u201d \u2014 denying our own radical freedom in order to escape the anguish of responsibility.<\/p>\n Of course, saying that we have the responsibility to decide how we do and don\u2019t want humanity to evolve opens up a problem: Who, exactly, gets to choose? It\u2019s tempting for each of us to rush in with the values we want to promote. But if we acknowledge that we don\u2019t know the universe\u2019s ultimate destiny or that it\u2019s radically indeterminate, then it makes much more sense to not impose one positive vision on everybody.<\/p>\n Instead, we need a positive vision that remains truly open and pluralistic. So rather than trying to enforce specific values, one of the best things we can do is refuse to foreclose the possibility for a variety of different lifestyles to persist and thrive.<\/p>\n That means, first of all, taking care not to unduly constrain the liberty of the human beings who already live on this planet. AI successionists often dream of radical interventions \u2014 like a brain-computer interface that would give you superhuman intelligence, memory, and mind-reading abilities, or a genetic technology that would create superbabies. They insist they should be allowed to change their bodies however they want.<\/p>\n And it\u2019s true that self-determination is a precious right. But the AI successionists often fail to consider the other side of this: that everyone else should also have a right to self-determination, meaning they need to be free from implicit coercion. If more and more of us dramatically alter our biology, we may create a society in which everyone feels pressure to do the same \u2014 even if they don\u2019t want to. To reject alterations would mean to exist at a huge economic disadvantage, or to face moral condemnation for remaining \u201csuboptimal\u201d when optimization is possible.<\/p>\n Even John Stuart Mill, the 19th-century English philosopher who literally wrote the book on liberty<\/a>, didn\u2019t think that anyone\u2019s right to self-determination is an absolute right. Instead, it\u2019s a qualified right \u2014 the kind that we generally honor, but that can be restricted to protect the interests of others.<\/p>\n So, ultimately, we\u2019ll have to strike a reasonable balance between self-determination for the enhancement enthusiasts and protecting the rights of others to live as they choose. Some enhancements may be fine, like implanting a chip in your hand<\/a> that unlocks your front door; others may need regulation or restriction, especially if they\u2019d alter the germline for all future generations.<\/p>\n One way to think about this is to note<\/a> that there\u2019s a difference between using tech to expand human capabilities and using it in ways that will contract the range of human lives we think it\u2019s legitimate to live.<\/p>\n That brings us to another one of those flies in the ointment: the idea that the human is something that must be optimized and perfected. That idea, which mandates that we strip away the physical and cognitive features that are perceived as holding us back from \u201cperfection,\u201d veers uncomfortably toward eugenics. It\u2019s a specter that has stalked transhumanism and posthumanism from their earliest days. (It\u2019s not a coincidence that Julian Huxley, who coined the term \u201ctranshumanism,\u201d was president of the British Eugenics Society<\/a>). And it still stalks today\u2019s AI discourse.<\/p>\n In a recent conversation with Sutton, one of the most prominent AI successionists, I argued that no matter how smart AIs get, it\u2019s surely wrong to assert that if one group is more intelligent than another, we should just get rid of the less intelligent group. To highlight the absurdity, I asked what I thought was a rhetorical question: Imagine if someone believed that white people were smarter than Black people; does that mean they should get rid of Black people, and Black people should just be okay with white people taking over?<\/p>\n \u201cUm,\u201d Sutton said, and then paused for nine seconds. \u201cWhat if,\u201d he offered, \u201cyou coexist and you\u2019re coexisting with some entity that\u2019s more productive than you are? This is the way I view the AI. We coexist with it.\u201d<\/p>\n \u201cBut that\u2019s not what the word \u2018succession\u2019 means,\u201d I noted.<\/p>\n \u201cOh, I\u2019m pointing out that it\u2019s inevitable. If you allow them to be their way and you allow you to be your way, coexist, and their way just happens to be better, then they\u2019re going to end up being more powerful. And you should be good with that.\u201d<\/p>\n \u201cYou\u2019re saying there will be a sort of Darwinian survival of the fittest?\u201d<\/p>\n \u201cIn some sense, yes,\u201d he said. \u201cThe winner should be whoever wins, and the spoils of winning should be whatever they are.\u201d<\/p>\n \u201cSo in the thought experiment where hypothetically, in an imaginary world, it were true that white people are smarter than Black people,\u201d I pressed, \u201cthen the smarter people will win out and the Black people should just be okay with that?\u201d<\/p>\n \u201cWell, why don\u2019t we just say the intelligent people should win out over the dumb people and the dumb people should be okay with that,\u201d he said. \u201cI think the dumb people should be okay with that!\u201d<\/p>\n But the idea that a species or group should accede to being squashed for some \u201cgreater good\u201d is a eugenicist idea that should be flat-out rejected. There is no \u201cperfect\u201d or \u201coptimal\u201d type of being, full stop. Insisting otherwise will always lead you to narrow what are considered acceptable modes of existence. And that road leads to eugenics.<\/p>\n Instead, a much more positive vision than the successionists\u2019 would be to expand the space for different kinds of lives to flourish. And that brings us to the oldest fly in humanism\u2019s ointment: the hierarchy.<\/p>\n A future where humans could pluralistically coexist with a dazzling diversity of nonhuman and partly human life-forms \u2014 not assuming that they\u2019re lower than us, but also not assuming that they\u2019re higher \u2014 that is a future I\u2019d be excited to inhabit.<\/p>\n Rather than staking human dignity on the claim that humans are better than other species, as the classical humanists did, we can embrace what researchers are increasingly recognizing: that every species has its own brand of smarts<\/a>. Each of these \u201cdiverse intelligences\u201d is adapted to its particular environment and needs, and every one of them is uniquely wonderful in its own way. We would then try to respect each and every being\u2019s form of life as much as we can. (Martha Nussbaum and Amartya Sen\u2019s capabilities approach<\/a>, which recommends that we guarantee every being certain core entitlements that befit their specific nature, offers a possible framework for this.)<\/p>\n If we one day end up with artificial intelligences that are conscious \u2014 and I don\u2019t think we have a principled reason to believe that could never happen<\/a> \u2014 then we\u2019d want to treat them ethically, too. In fact, if we are someday joined by conscious AIs or biological-artificial hybrid organisms, I for one would be delighted to get to know these many kinds of minds and explore their rich and varied forms of consciousness.<\/p>\n Of course, the politics of our world would become much more complicated; we\u2019d have that many more creatures with conflicting needs, and we\u2019re not exactly good at handling the conflicts we already have. We\u2019d need to become much better at pluralistic coexistence before this could be feasible.<\/p>\n But in theory? A future where humans could pluralistically coexist with a dazzling diversity of nonhuman and partly human life-forms \u2014 not assuming that they\u2019re lower than us, but also not assuming that they\u2019re higher \u2014 that is a future I\u2019d be excited to inhabit. Because that, and not the supposed anti-chauvinism of the AI successionists, would be true openness to all forms of consciousness: Instead of \u201cpassing the torch\u201d in some imagined relay race, we\u2019d be making more room for all kinds of minds \u2014 including ours \u2014 to run (or fly or swim or compute) in their own directions.<\/p>\n Jun Cen for Vox<\/p>\n But notice what this vision does not mean. It does not mean that we\u2019re under any obligation to bring those new species into being right now, or at all. That\u2019s because there\u2019s no evidence for the view that there\u2019s some objective moral good in the universe that we must try to maximize. Although utilitarians have been so successful at popularizing that view that some people think it\u2019s a given, it\u2019s very much not. And plenty of philosophers, neuroscientists<\/a>, and psychologists have a different view.<\/p>\n As philosopher Bernard Williams once wrote<\/a> in response to those who lob the accusation of \u201cspeciesism\u201d:<\/p>\n They suppose that we are in effect saying, when we exercise these distinctions between human beings and other creatures, that human beings are more important, period, than those other creatures. That objection is simply a mistake. \u2026 These actions and attitudes need express no more than the fact that human beings are more important to us, a fact which is hardly surprising.<\/p>\n In other words, you can care about the continuation of humanity, not because you believe humans are the most important species according to some cosmic point of view, but simply because you happen to be a human. You don\u2019t need to justify your desire for survival before some higher court \u2014 of course you want to survive, and of course that\u2019s morally okay! That\u2019s because, to Williams, there is no \u201cpoint of view of the universe,\u201d no view from nowhere. There\u2019s no such thing as a moral agent in an abstract sense. You exist as a human moral agent, and any ethical theory that requires you to ignore that bedrock identity severs you from the very thing that makes your agency recognizably yours.<\/p>\n This is the view that Vallor \u2014 a devoted humanist, but not a naive one \u2014 shares.<\/p>\n![\"a](\"https:\/\/www.europesays.com\/ai\/wp-content\/uploads\/2026\/05\/JunCen_Spot1.jpeg\"\/)
<\/a><\/p>\n![\"a](\"https:\/\/www.europesays.com\/ai\/wp-content\/uploads\/2026\/05\/JunCen_Spot3.jpeg\"\/)
<\/a><\/p>\n![\"a](\"https:\/\/www.europesays.com\/ai\/wp-content\/uploads\/2026\/05\/JunCen_Spot4.jpeg\"\/)
<\/a><\/p>\n![\"A](\"https:\/\/www.europesays.com\/ai\/wp-content\/uploads\/2026\/05\/JunCen_Spot2.jpeg\"\/)
<\/a><\/p>\n
![\"Swati](\"https:\/\/www.europesays.com\/ai\/wp-content\/uploads\/2026\/05\/1779966855_671_image.png\"\/)
<\/p>\n