RE: FAQ Additions (Posthuman mind control)

From: hal@rain.org
Date: Tue Feb 23 1999 - 17:36:34 MST


Billy Brown, <bbrown@conemsco.com>, writes:
> Suppose my parents are religious, and they feel that anyone who is not a
> member of their faith will suffer eternal damnation. Consequently, at an
> early age they have be fitted with neural implants that will ensure I
> fervently believe in their faith, that I will never violate its tenets, and
> that I am incapable of ever changing this belief system.

A very interesting question, independent of the posthuman question. What
degree of control is moral for parents to exert over their children? More
generally, what is moral when creating a new intelligence?

One answer is that, as long as the resulting person is happy with his lot,
anything is moral. You can create intelligences that are stupid or smart,
flexible or constrained, but as long as they are happy it is OK.

The opposite extreme would suggest that only intelligences with maximal
extropy should be created: flexible, intelligent, creative, curious minds.
Such people would have a wide range of possible behaviors. They would
perhaps face greater dangers, but their triumphs would be all the more
meaningful. Doing anything less when creating a new consciousness would
be wrong, in this view.

I am inclined to think that this latter position is too strong. There
would seem to be valid circumstances where creating more constrained
intelligences would be useful. There may be tasks which require
human-level intelligence but which are relatively boring. Someone has to
take out the garbage. Given an entity which is going to have limitations
on its options, it might be kinder to make it satisfied with its life.

Generalizing the case Billy describes, if the universe is a dangerous
place and there are contagious memes which would lead to destruction, you
might be able to justify building in immunity to such memes. This limits
the person's flexibility, but it is a limitation intended ultimately to
increase his options by keeping him safe.

How different is this from the religious person who wants to keep
his own child safe, and secure for him the blessings of eternal life?
Not at all different. Although we may not agree with his premises,
given his belief system I think his actions can be seen as moral.

Hal



This archive was generated by hypermail 2.1.5 : Fri Nov 01 2002 - 15:03:07 MST