Recent Comments
SIAI Bloggers
  • Michael Roy Ames SIAI Canada President
  • Tyler Emerson Executive Director
  • Ben Goertzel Director of Research
  • David Hart Director of Open Source Projects
  • Bruce Klein Director of Outreach
  • Jonas Lamis Director of Partnerships
  • C. Colby Thomson Director of Strategy
  • Eliezer Yudkowsky Research Fellow
Guest Bloggers
  • Michael Anissimov Lifeboat Foundation
  • Seth Baum Pennsylvania State University
  • Nick Hay University of Auckland
  • Mitchell Howe Contributing Writer
  • Carl Shulman New York University
  • Peter de Blanc Temple University
Tag Cloud
accelerating change accelerating change agi AGI 08 ai Anthropic Reasoning anthropomorphism artificial intelligence artificial intelligence barney pell biases BIL bloggers bloggingheads tv bruce klein catastrophic risks conference agi 09 conference chairman conferences conventions convergence cto cynthia breazeal david hart donations doug wolens eliezer yudkowsky eric baum esther dyson event horizon events evolution existential risks FAI feature length documentary films Friendly AI Friendly Artificial Intelligence future salon future shock futurist community goertzel google gsoc institute research fellow intelligence explosion interest journal interesting articles interviews intros JAGI john horgan justin rattner language search engine life extension martin rees math mathematics media meeting microsoft mit morality nanotechnology natural language search neil gershenfeld new york times news open letter open source open source open source projects opencog opencogprime optimization processes outreach papers peter diamandis podcasts prediction quantum computing radio ray kurzweil relevant articles research fellow roadmap science fiction SIAI singularity singularity summit singularity institute singularity summit spectrum talk transhumanism utilitarianism utility vernor vinge videos yudkowsky
Archives

Transhumanists Don’t Need Special Dispositions

June 24th, 2007Eliezer Yudkowsky

I have claimed that transhumanism arises strictly from love of life. A bioconservative humanist says that it is good to save someone’s life or cure them of debilitating syndromes if they are young, but once they are “too old” (the exact threshold is rarely specified) we should stop trying to keep them alive and healthy. A transhumanist says unconditionally: “Life is good, death is bad; health is good, death is bad.” Whether you’re 5, 50, or 500, life is good, why die? Nothing more is required.

Then why is there a widespread misunderstanding that transhumanism involves a special fetish for technology, or an unusually strong fear of death, or some other abnormal personal disposition?

I offer an analogy: Rationality is often thought to be about cynicism. The one comes to us and says, “Fairies make the rainbow; I believe this because it makes me feel warm and fuzzy inside.” And you say, “No.” And the one reasons, “I believe in fairies because I enjoy feeling warm and fuzzy. If I imagine that there are no fairies, I feel a sensation of deadly existential emptiness. Rationalists say there are no fairies. So they must enjoy sensations of deadly existential emptiness.” Actually, rationality follows a completely different rule - examine the rainbow very closely and see how it actually works. If we find fairies, we accept that, and if we don’t find fairies, we accept that too. The look-and-see rule makes no mention of our personal feelings about fairies, and it fully determines the rational answer. So you cannot infer that a competent rationalist hates fairies, or likes feelings of deadly existential emptiness, by looking at what they believe about rainbows.

But this rule - the notion of actually looking at things - is not widely understood. The more common belief is that rationalists make up stories about boring old math equations, instead of pretty little fairies, because rationalists have a math fetish instead of a fairy fetish. A personal taste, and an odd one at that, but how else would you explain rationalists’ strange and unusual beliefs?

Similarly, love of life is not commonly understood as a motive for saying that, if someone is sick, and we can cure them using medical nanotech, we really ought to do that. Instead people suppose that transhumanists have a taste for technology, a futurism fetish, that we just love those pictures of little roving nanobots. A personal taste, and an odd one at that, but how else would you explain transhumanists’ strange and unusual moral judgments?

Of course I’m not claiming that transhumanists take no joy in technology. That would be like saying a rationalist should take no joy in math. Homo sapiens is the tool-making species; a complete human being should take joy in a contrivance of special cleverness, just as we take joy in music or storytelling. It is likewise incorrect to say that the aesthetic beauty of a technology is a distinct good from its beneficial use - their sum is not merely additive, there is a harmonious combination. The equations underlying a rainbow are all the more beautiful for being true, rather than just made up. But the esthetic of transhumanism is very strict about positive outcomes taking precedence over how cool the technology looks. If the choice is between using an elegant technology to save a million lives and using an ugly technology to save a million and one lives, you choose the latter. Otherwise the harmonious combination vanishes like a soap bubble popping. It would be like preferring a more elegant theory of rainbows that was not actually true.

In social psychology, the “correspondence bias” is that we see far too direct a correspondence between others’ actions and their personalities. As Gilbert and Malone put it, we “draw inferences about a person’s unique and enduring dispositions from behaviors that can be entirely explained by the situations in which they occur.” For example, subjects listen to speakers giving speeches for and against abortion. The subjects are explicitly told that the speakers are reading prepared speeches assigned by coin toss - and yet the subjects still believe the pro-abortion speakers are personally in favor of abortion.

When we see someone else kick a vending machine for no visible reason, we assume he is “an angry person”. But if you yourself kick the vending machine, you will tend to see your actions as caused by your situation, not your disposition. The bus was late, the train was early, your report is overdue, and now the damned vending machine has eaten your money twice in a row. But others will not see this; they cannot see your situation trailing behind you in the air, and so they will attribute your behavior to your disposition.

But, really, most of the people in the world are not mutants - are probably not exceptional in any given facet of their emotional makeup. A key to understanding human nature is to realize that the vast majority of people see themselves as behaving normally, given their situations. If you wish to understand people’s behaviors, then don’t ask after mutant dispositions; rather, ask what situation they might believe themselves to be in.

Suppose I gave you a control with two buttons, a red button and a green button. The red button destroys the world, and the green button stops the red button from being pressed. Which button would you press? The green one. This response is perfectly normal. No special world-saving disposition is required, let alone a special preference for the color green. Most people would choose to press the green button and save the world, if they saw their situation in those terms.

And yet people sometimes ask me why I want to save the world. Why? They want to know why someone would want to save the world? Like you have to be traumatized in childhood or something? Give me a break.

We all seem normal to ourselves. One must understand this to understand all those strange other people.

Correspondence bias can also be seen as essentialist reasoning, like explaining rain by water spirits, or explaining fire by phlogiston. If you kick a vending machine, why, it must be because you have a vending-machine-kicking disposition.

So the transhumanist says, “Let us use this technology to cure aging.” And the reporter thinks, How strange! He must have been born with an unusual technology-loving disposition. Or, How strange! He must have an unusual horror of aging!

Technology means many things to many people. So too, death, aging, sickness have different implications to different personal philosophies. Thus, different people incorrectly attribute transhumanism to different mutant dispositions.

If someone prides themselves on being cynical of all Madison Avenue marketing, and the meaning of technology unto them is Madison Avenue marketing, they will see transhumanists as shills for The Man, trying to get us to spend money on expensive but ultimately meaningless toys.

If someone has been fed Deep Wisdom about how death is part of the Natural Cycle of Life ordained by heaven as a transition to beyond the flesh, etc., then they will see transhumanists as Minions of Industry, Agents of the Anti-Life Death Force that is Science.

If someone has a postmodern ironic attitude toward technology, then they’ll see transhumanists as being on a mission to make the world even stranger, more impersonal, than it already is - with the word “Singularity” obviously referring to complete disconnection and incomprehensibility.

If someone sees computers and virtual reality as an escape from the real world, opposed to sweat under the warm sun and the scent of real flowers, they will think that transhumanists must surely hate the body; that they want to escape the scent of flowers into a grayscale virtual world.

If someone associates technology with Gosh-Wow-Gee-Whiz-So-Cool flying cars and jetpacks, they’ll think transhumanists have gone overboard on youthful enthusiasm for toys.

If someone associates the future with scary hyperbole from Wired magazine - humans will merge with their machines and become indistinguishable from them - they’ll think that transhumanists yearn for the cold embrace of metal tentacles, that we want to lose our identity and be eaten by the Machine or some other dystopian nightmare of the month.

In all cases they make the same mistake - drawing a one-to-one correspondence between the way in which the behavior strikes them as strange, and a mutant mental essence that exactly fits the behavior. This is an unnecessarily burdensome explanation for why someone would advocate healing the sick by any means available, including advanced technology.

Comments (9) (RSS feed)

Toggle comment visibility Comment by Nortius Maximus
Jun 24, 2007 9:26 pm

A worthy exegesis of the tendency to “flatten” people one sees as strange. I’ll be linking to this. Thanks, Eliezer.

 
Toggle comment visibility Comment by James R Hughes, MD
Jun 24, 2007 9:54 pm

Well written. You can better appreciate life, beauty, and knowledge, free from preconceived notions (beliefs). Real beauty trumps fairies anytime.

 
Toggle comment visibility Comment by Antoine van de Ven
Jun 25, 2007 1:36 pm

> The equations underlying a rainbow are all the more beautiful for being true, rather than just made up.

Very true. I just wanted to add a quote of Feynman about this: (scientist as rationalist)

I have a friend who’s an artist and he’s some times taken a view which I don’t agree with very well. He’ll hold up a flower and say, “look how beautiful it is,” and I’ll agree, I think. And he says, “you see, I as an artist can see how beautiful this is, but you as a scientist, oh, take this all apart and it becomes a dull thing.” And I think he’s kind of nutty.

First of all, the beauty that he sees is available to other people and to me, too, I believe, although I might not be quite as refined aesthetically as he is. But I can appreciate the beauty of a flower.

At the same time, I see much more about the flower that he sees. I could imagine the cells in there, the complicated actions inside which also have a beauty. I mean, it’s not just beauty at this dimension of one centimeter: there is also beauty at a smaller dimension, the inner structure…also the processes.

The fact that the colors in the flower are evolved in order to attract insects to pollinate it is interesting – it means that insects can see the color.

It adds a question – does this aesthetic sense also exist in the lower forms that are…why is it aesthetic, all kinds of interesting questions which a science knowledge only adds to the excitement and mystery and the awe of a flower.

It only adds. I don’t understand how it subtracts.

R.P. Feynman
http://www.youtube.com/watch?v=zSZNsIFID28

 
Toggle comment visibility Comment by Patrick L. McHargue
Jun 25, 2007 1:47 pm

Eliezer;

Loouise!

Where do I sign up to get this kind of insight into life?

I read this, and I am proud to be on the same planet with you, and those that brought you your own insight.

I look forward to reading more, and understanding more, in the time ahead.

Pat

 
Toggle comment visibility Comment by Tom McCabe
Jun 26, 2007 12:27 am

“Where do I sign up to get this kind of insight into life?”

Just read everything. Read books, read papers, read stuff people write on the Internet. Sooner or later you’ll encounter most of these ideas, and then you can start making connections between them. For example, today I heard a talk by Dr. Zimbardo (of the Stanford prison experiment) on how humans misattribute the cause of evil due to correspondence bias. And from there you can go on into how we see evil in others but not ourselves, how humans will usually behave similarly in similar situations regardless of culture, what we perceive evil as, how all this would extrapolate under CEV, etc.

 
Toggle comment visibility Comment by Roko
Jun 26, 2007 5:17 am

An enlightening post. I learned something reading this, and I think that next time I have to explain transhumanism to someone, I will be better prepared to deal with their response.

 
Toggle comment visibility Comment by Mark Plus
Jun 27, 2007 6:58 pm

Many kinds of story-telling promote the “correspondence bias” model of human behavior: Individuals behave either heroically or villainously because of their “character,” not as a function of their histories and the situations they’ve found themselves in. In story-telling, the person with one kind of “character” will behave quite differently in a given situation than the person with another kind of “character.” The human brain readliy relates to this model for assessing poorly known individuals based on thin slices of data, which suggests that evolution selected for it as an effective heuristic. I don’t think in that case we should dismiss “correspondence bias” as necessarily irrational.

Getting back to transhumanism, in my experience cryonicists (not all of whom identify themselves with transhumanism, BTW) do tend to have certain personality types over-represented: You’ll meet more child-free, independent-minded women, men with high-functioning autism, gays, entrepreneurs, libertarians and sexual “adventurers” (for want of a better term) in cryonics gatherings than you meet in ordinary sociiety. Cryonics seems to attract people who want to make and live by their own rules in life nstead of following socially conventional patterns that don’t suit them. Outsiders who come away with the impression that cryonics attracts a strange collection of individuals haven’t made a wrong inference.

 
Toggle comment visibility Comment by Nick Tarleton
Jun 28, 2007 7:21 am

I think the error underlying most or all anti-transhumanist bias is _failure to understand people who are passionate about anything_. You want to cure death? Why, isn’t that cute, you think you can make a difference…. I’m not sure of the underlying causes of this (loss of religion and consequent perceived loss of values? failure of idealistic political movements? perception that the world has been going to hell for the last century? plain laziness and status quo bias?) but it’s incredibly sad.

 
Toggle comment visibility Comment by Tom McCabe
Jun 28, 2007 10:07 am

“I’m not sure of the underlying causes of this”

Most people have just given up, and those that haven’t usually pick an incredibly unlikely path to solve the world’s problems, get bogged down and become cynical. Pretty much every “motivational” book I’ve read on how to make a difference in the world focuses on interacting with small-scale situations you are already familiar with (”think globally, act locally”).

 

Leave a reply

Comments may take a while to appear, as they are moderated for spam.