Definitions of friendliness? (was singularity loop logic)

From: Lee Corbin (lcorbin@tsoft.com)
Date: Wed Apr 24 2002 - 01:33:40 MDT


Eliezer wrote

> Any SI worthy of the name *could* do that [seamlessly uploading
> humans], but Michael Anissimov is the only one I know of who was
> talking about the nonvolitional seamless uploading of recalcitrant
> sentients into a Pedestrian mockup to conserve computing resources
> - to my way of thinking, this violates Friendliness.

Why in the world? I would deeply hope that it would be so
considerate! *Everyone* would be better off uploaded (if
the AI is so nice to do so), whether they realize it or not.
At *very least* the AI provides you a life indistinguishable
from what you currently have, but with no chance of halting,
and probably many fewer red lights on your way to work.

...and Samantha wrote

> I see no reason that the SI would not let these researchers, and
> all others who would not be damaged by knowing, in on the truth.

Quite right. You said it first.

Lee



This archive was generated by hypermail 2.1.5 : Sat Nov 02 2002 - 09:13:38 MST