Re: Revolting AI (was economics of star trek)

From: Eliezer S. Yudkowsky (sentience@pobox.com)
Date: Wed Mar 06 2002 - 07:11:48 MST


Alex Ramonsky wrote:
>
> Well, yeh, but, how do we jump the gap? I mean, you use your computer as a
> slave now, don't you? And the dishwasher, and the coffee machine, etc,
> etc...what would you really do, if you turn your computer on one day and
> tell it to do your accounts and it says, 'bugger off I'm playing quake'?
> Would you be happy with that?

"Building a mind is not like building a tool. Tools can be used for
whatever action the wielder likes; a mind can have a sense of its own
purpose, and can originate actions to achieve that purpose."
        -- "What is Friendly AI?", http://singinst.org/friendly/whatis.html

-- -- -- -- --
Eliezer S. Yudkowsky http://singinst.org/
Research Fellow, Singularity Institute for Artificial Intelligence



This archive was generated by hypermail 2.1.5 : Sat Nov 02 2002 - 09:12:48 MST