From: Stefan Pernar (stefan.pernar@gmail.com)
Date: Fri Apr 25 2008 - 18:20:12 MDT
On Sat, Apr 26, 2008 at 5:50 AM, Nick Tarleton <nickptar@gmail.com> wrote:
> On Fri, Apr 25, 2008 at 10:31 AM, Tim Freeman <tim@fungible.com> wrote:
> > On Thu, Apr 17, 2008 at 11:59 PM, Nick Tarleton <nickptar@gmail.com>
> wrote:
> > > Fixing who the AI cares about is over-specification. That's what the
> > > AI (in the CFAI model) or extrapolated volition (in the newer model)
> > > is supposed to figure out.
> >
> > > http://www.sl4.org/wiki/CoherentExtrapolatedVolition
> >
> > CEV fixes who the AI cares about. Quoting directly from the cited
> article:
> >
> > >As of May 2004, my take on Friendliness is that the initial dynamic
> > >should implement the coherent extrapolated volition of humankind.
> >
> > The AI cares about the extrapolated volition of "humankind", not the
> > extraploated volition of mammals or some other group.
>
> The extrapolated volition of humankind could choose to extend the
> group. The selection of humankind is part of the *initial dynamic*,
> it's right there. If you fix humanity (or present humanity, or
> whatever) as part of the goal system/utility function, it will never
> change, because a rational agent resists changes to its
> supergoals/utility function.
>
I was following the discussion from the sideline but think it is time to
point you to an alternative to Elizier's CEV.
You can find my paper on friendliness called 'Practical Benevolence - a
Rational Philosophy of Morality' at:
http://rationalmorality.info/wp-content/uploads/2007/12/practical-benevolence-2007-12-06_iostemp.pdf
In it I combine Kantian moral philosophy with Darwinian evolution to form a
moral theory based in rational choice.
You might also be interested in a book I wrote on the subject called Jame5 -
a Tale of Good and Evil (ISBN 3000227091)
http://www.amazon.de/Jame5-Tale-Good-Stefan-Pernar/dp/3000227091/ref=sr_1_1?ie=UTF8&s=books&qid=1209168786&sr=8-17090804251450t46e312b5i42ec671aa0fe2c2e@mail.gmail.com
I put it up as free download on Jame5.com
Looking forward to hearing from all of you.
Kind regards,
Stefan
-- Stefan Pernar 3-E-101 Silver Maple Garden #6 Cai Hong Road, Da Shan Zi Chao Yang District 100015 Beijing P.R. CHINA Mobil: +86 1391 009 1931 Skype: Stefan.Pernar
This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:01:02 MDT