From: Eliezer S. Yudkowsky (sentience@pobox.com)
Date: Wed Jan 24 2001 - 16:02:40 MST
Eugene.Leitl@lrz.uni-muenchen.de wrote:
>
> I do not believe in super-docile AIs. The AI we can build
> and control is next to useless (good for sorting trash,
> delivering goods, keeping the house tidy and driving a car),
> and a useful AI is uncontrollable.
Just a brief note: "Uncontrollable" is, semantically, orthogonal to
"friendly". Martin Luther King and Gandhi were neither docile nor
controllable, but they were altruistic. You can, of course, argue that a
smart AI is necessarily unFriendly as well as uncontrollable, but we
should all be careful not to conflate the concepts and add confused
terminology to an already-chaotic issue.
We now return you to your previous argument.
-- -- -- -- --
Eliezer S. Yudkowsky http://singinst.org/
Research Fellow, Singularity Institute for Artificial Intelligence
This archive was generated by hypermail 2.1.5 : Sat Nov 02 2002 - 08:05:18 MST