Thanks for changing the subject line!
In short, I have decoupled Interim Goal Systems from the concept of
objective morality. The Prime Directive now states: "Maintain choices
as the holistic function of reasoning." That is, goals should be
distributed through the knowledge base instead of concentrated in a few
syntactic tokens. That way they reassemble themselves if the
architecture changes, and also there are major problems with trying to
maintain coercions which are imposed as special cases.
--
sentience@pobox.com Eliezer S. Yudkowsky http://pobox.com/~sentience/AI_design.temp.html http://pobox.com/~sentience/singul_arity.htmlDisclaimer: Unless otherwise specified, I'm not telling you everything I think I know.