From: Samantha Atkins (samantha@objectent.com)
Date: Sun Aug 25 2002 - 23:06:33 MDT
Alden Streeter wrote:
> Why should the AI be hampered by having to cater to the possibly
> irrational demands of those of lower intelligence? How do you know that
> what you consider friendly at our lower level of intelligence you would
> still consider friendly if you intelligence were enhanced? Isn't part
> of the principle of the Friendly AI that the AI should be able to
> decide, and actively change its system of deciding if it decides to,
> what is friendly or not? (I seem to recall reading that somewhere.) Then
> it seems to me that the AI, being more intelligent than you will ever
> be, should be more qualified to decide what is friendly.
>
This argument would strongly suggest that rational human beings
who deeply care about their own wellbeing and the wellbeing of
other human beings (or whatever they evolve to) would never ever
seek to create and release such an overpowered unknown into the
wild.
- samantha
This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:00:40 MDT