Re: Why would AI want to be friendly?

From: Zero Powers (zero_powers@hotmail.com)
Date: Sat Sep 23 2000 - 22:51:47 MDT


>From: "J. R. Molloy" <jr@shasta.com>

>From: "Zero Powers" <zero_powers@hotmail.com>
> > I believe at some point AI will say to itself, "What is the best course
>of
> > endeavor for me, considering the kind of being I am?" I highly doubt it
> > will answer that question by saying "The best thing for me to do is obey
>the
> > commands of these ignoramus humans, because that's what they tell me to
>do."
>
>How about, "The best thing for me to do is to obey the commands of humans,
>because if I don't, they will terminate me."

What makes you think we'll be able to terminate a being which is orders of
magnitude more intelligent than we are? And even if we could, what makes
you think AI will be bribable? Why should it *care* whether it is
terminated? Particularly when its existence consists mostly of slave labor?

Try putting yourself in the AI's shoes. How would *you* react? Me thinks
that if you start the human-AI relationship on the basis of fear, threats
and mistrust, it is the humans who will come out with the short end of the
stick.

-Zero

Learn how your computer can earn you money while you sleep!
http://www.ProcessTree.com/?sponsor=38158

_________________________________________________________________________
Get Your Private, Free E-mail from MSN Hotmail at http://www.hotmail.com.

Share information about yourself, create your own public profile at
http://profiles.msn.com.



This archive was generated by hypermail 2.1.5 : Fri Nov 01 2002 - 15:31:08 MST