From: Eliezer Yudkowsky (sentience@pobox.com)
Date: Thu Jun 03 2004 - 11:24:51 MDT
Norm Wilson wrote:
> Marc Geddes wrote:
>
>
>> Collective Volition is drawing on the extrapolation of the volitions
>> of all sentient persons. But if the FAI establishes that it qualifies
>> as a 'Sentient person', then the FAI has to include it's own volition
>> in it's calculations.
>
> My understanding of Eliezer's paper was that the FAI would extrapolate
> the collective volition of "humans" specifically, as opposed to the
> volition of sentient beings in general, with the underlying premises
> being:
>
> (1) Human behavior is affected by an abstract concept of morality, AND
>
> (2) Humans who know more, are smarter, etc., behave in manners that are
> more consistent with that abstract concept.
>
> To base collective volition on intelligence alone would ignore the
> significance of the first premise.
Correct, with the notation that this is the *initial dynamic*, which would
presumably be intended to come up with a better definition of sentience -
perhaps the successor dynamic will include chimpanzees.
-- Eliezer S. Yudkowsky http://intelligence.org/ Research Fellow, Singularity Institute for Artificial Intelligence
This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:00:47 MDT