Re: Eugene's nuclear threat

From: Robin Hanson (rhanson@gmu.edu)
Date: Fri Sep 29 2000 - 18:16:55 MDT


Eliezer S. Yudkowsky wrote:

> > >And scientists and engineers are, by and large, benevolent ...
> > >I really don't see why the Earthweb would be benevolent. ...
> > These two quotes seem worth comparing.
>
> Okay, let's. Scientists and engineers are benevolent most of the time, and so
> is the Earthweb. ... And I certainly wouldn't trust a randomly selected AI
> researcher to competently program a Friendly AI, just as I wouldn't trust a
> randomly selected AI researcher to successfully build an AI at all - this
> being the analogy to trusting a young Earthweb.

There seems to be something you trust more about the "small scientist teambuilds big
bang AI" scenario that you trust more than a "young Earthweb
supervises AI development" scenario. If you think my quotes give the
wrong impression, perhaps you could explain your reasoning more directly.

> Robin, you - like myself - have *got* to learn to resist that parting shot.

Perhaps so. But it is fun sometimes, eh? :-)



This archive was generated by hypermail 2.1.5 : Fri Nov 01 2002 - 15:31:18 MST