Re: [sl4] FAI development within academia.

From: Roko Mijic (rmijic@googlemail.com)
Date: Mon Feb 23 2009 - 10:21:52 MST


2009/2/23 Matt Mahoney <matmahoney@yahoo.com>:
> --- On Sun, 2/22/09, Roko Mijic <rmijic@googlemail.com> wrote:
>
>> One way to hasten the development of FAI is for me to seek to do
>> research within academia. A disadvantage of this strategy is that
>> academia is an open community, and anyone can potentially look at the
>> results that the field is producing and use them to create uFAI.
>
> Unlikely. Nobody can build AI, much less FAI or uFAI. All the top people in the field like Yudkowsky, Minsky, and Kurzweil have realized the problem is too hard by themselves,

Actually I emailed Marvin Minsky a few days ago, and he thinks that
the problem is soluble in 6 years with a team of 6 programmers at a
cost of $10,000,000. He just says he can't find anyone to fund it. I
can forward you the email if you want.

so they are not actually writing any software. It has to be a global
effort. I did a cost estimate in section 2 of
http://www.mattmahoney.net/agi2.html
>
> I don't have a solution to the friendliness problem. I believe AI will become uncontrollable once the majority of intelligence is in silicon.

So, you think that the end of the world is nigh? You think we'll all die?

 I think it will take about 30 years to extract that much knowledge
from human brains, even with the optimistic assumptions of cheap,
powerful computers and pervasive public surveillance. The world will
be a much different place when you never know whether you are talking
to a human or a computer, and you can't trust your computer.
>
> -- Matt Mahoney, matmahoney@yahoo.com
>
>

-- 
Roko Mijic
MSc by Research
University of Edinburgh


This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:01:04 MDT