Re: Why would AI want to be friendly? (Was: Congratulations to Eli,Brian ...)

From: J. R. Molloy (jr@shasta.com)
Date: Tue Sep 05 2000 - 21:09:18 MDT


Michael S. Lorrey
> Socio/psychopathic minds are sick/malfunctioning minds. Proper oversight
systems
> should quickly put any sociopathic/psychopathic SI down. Such control
mechanisms
> would be a primary area of research by the Singularity Institute I would
> imagine.
>

We don't really have any reason to presume that SIs would not emerge from
genetic programming projects, do we? As AIs compete with each other, winners
would evolve with higher and higher IQs. Those intelligent agents (IAs) that
display unfriendly tendencies could simply be terminated. This is a tremendous
advantage of working with Mind Children, because you can't (legally or
ethically) do this with biological children. As the evolution of AI moves toward
SI, all you need to do to preclude unfriendliness is to cull to herd, so to
speak.

--J. R.

"We participate, therefore we are."
--John Seely Brown, _The Social Life of Information_



This archive was generated by hypermail 2b29 : Mon Oct 02 2000 - 17:37:16 MDT