Re: Slow-fast singularity

From: Krekoski Ross (rosskrekoski@gmail.com)
Date: Sat May 10 2008 - 12:08:58 MDT


Yes, true.

But we can still throttle input to reduce the speed of a takeoff

Ross

On Sat, May 10, 2008 at 5:43 PM, Matt Mahoney <matmahoney@yahoo.com> wrote:

> --- Krekoski Ross <rosskrekoski@gmail.com> wrote:
>
> > any AI can therefore really only at most, assimilate the complexity of
> the
> > sum of all human knowledge. Without the ability to meaningfully interact
> > with its environment and effectively assimilate information that is
> > otherwise external to the sum of human knowledge, it will plateau.
>
> The effect of language, writing, and the internet is to transform 10^10
> humans each with 10^9 bits of knowledge [1] into a single AI with 10^18
> bits of knowledge (assuming 90% sharing). If the AI only received input
> from humans, then this would be as far as we go. However, machines can
> have sensors that record information far faster than the few bits per
> second that limit human long term memory [1].
>
> Would this additional knowledge give an AI a competitive advantage? I
> believe it would. Our cognitive limits will not allow us to recognize the
> value of this additional knowledge. I believe an AI with more knowledge
> than the entire human race could possibly know would be outside our
> control and would appear to have godlike powers.
>
> 1. http://www.merkle.com/humanMemory.html
>
>
> -- Matt Mahoney, matmahoney@yahoo.com
>



This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:01:02 MDT