From: Tommeteor@aol.com
Date: Wed May 21 2003 - 18:40:52 MDT
I've been reading Creating Friendly AI, and it talks about the concept of a
"flight recorder," to monitor the AI's actions and goals. It said that
"obviously," the flight recorder needed to be made inaccessible to the AI if
at all possible. Yes, that is the obvious answer, but "obvious" and "correct"
are not always synonymous. After all, it was once "obvious" that the Sun went
around the Earth! The concept of "preventing tampering with the flight
recorder" would probably be necessary with an AI too young to understand FoF
and the concept of a "flight recorder" fully. However, as the AI matures, if
FoF is a genuine possibility, the AI should agree with the programmers about
the need for safeguards, thus eliminating the need for "anti-tampering"
devices. If an unFAI tried to modify the flight recorder for unFriendly
purposes, it must already have an unFriendly parent goal to give desirability
to the subgoal of "modifying the flight recorder", and this parent goal will
have been noticed by the "flight recorder" before it is actually modified. A
sufficently advanced "flight recorder" would be intelligent enough to alert
the humans whenever there is an unFriendly goal in the AI, or, at least, an
unFriendly goal that could cause damage. Thus, the only data that would need
to be protected is the data that would store the memory of an unFriendly
goal, and even that "guard the data" concept could be worked around, given a
year or so to figure it out.
This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:00:42 MDT