From: H C (lphege@hotmail.com)
Date: Fri Dec 02 2005 - 21:39:16 MST
>From: "Herb Martin" <HerbM@LearnQuick.Com>
>Reply-To: sl4@sl4.org
>To: <sl4@sl4.org>
>Subject: RE: guaranteeing friendliness
>Date: Fri, 2 Dec 2005 19:50:15 -0800
>
> > > Much like believing you can keep terrorists from taking
> > > down an airplane by taking away sewing scissors from
> > > ordinary passengers.
> >
> > This is an astoundingly bad (attempt at) an analogy, to the
> > point of being actively misleading. Aside from the attempt
> > to import random political and emotional baggage, and the
> > usual reasons why it's fairly futile to try and evaluate what
> > wildly transhuman intelligences can and can't do, the task of
> > preventing general intelligences with harmful goal systems
> > self-improving to a dangerous level is nothing like an obscure
> > physical security issue faced by some contemporary hominids.
> >
> > * Michael Wilson
>
>I have to admit enjoying that my "astoundingly bad analogy"
>resulted in your direct response in making the my point:
>
>
> > ...it's fairly futile to try and evaluate what
> > wildly transhuman intelligences can and can't do, the task of
> > preventing general intelligences with harmful goal systems
> > self-improving to a dangerous level is nothing like an obscure
> > physical security issue faced by some contemporary hominids.
>
>Exactly.
>
>After the Singularity we have no real hope of predicting
>friendliness -- or knowing what initial conditions will
>necessarily favor such.
Technically IF the functional entity which enables the Singularity is
instinctively dependent upon the understanding and approval of humanity for
the predicted course of action of the entity and the principles upon which
those actions were derived, any deviation would be contrary to the
intentions of the AI.
Just something to consider.
>
>You can TRY (and should) to develop (or encourage the
>development of) friendly AI, but such cannot be guaranteed.
>
>Beyond the singularity conditions is unknowable territory
>(thus the name), and preceding the Singularity are competing
>groups of human beings with different goals and ideas of
>friendliness.
>
>
>--
>Herb Martin
>
>
Th3Hegem0n
http://smarterhippie.blogspot.com
This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:00:53 MDT