Re: Paper: Artificial Intelligence will Kill our Grandchildren

From: Stathis Papaioannou (stathisp@gmail.com)
Date: Sat Jun 14 2008 - 06:56:54 MDT


2008/6/14 Anthony Berglas <anthony@berglas.org>:
> Having scanned the literature, I decided to write a paper on the dangers of
> intelligence. I have tried to keep it short, sharp and very focused.

> http://berglas.org/Articles/AIKillGrandchildren/AIKillGrandchildren.html

One of the assumptions you make in the paper is that there will be
lots of AI's with lots of different motives, and that those with the
motives of world domination at the expense of everything else will
prevail. But realistically, people will program AI's to help
themselves or their organisations gain wealth and power, and achieving
that goal would involve preventing other people with their AI's from
gaining the upper hand. In general it's only possible to prevail if
you alone have the superior technology. This argument doesn't apply if
there is a hard take-off singularity, in which case our only hope is
to make the first AI reliably Friendly.

-- 
Stathis Papaioannou


This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:01:03 MDT