Re: Sentience

From: Eliezer Yudkowsky (
Date: Thu Jun 03 2004 - 11:24:51 MDT

Norm Wilson wrote:
> Marc Geddes wrote:
>> Collective Volition is drawing on the extrapolation of the volitions
>> of all sentient persons. But if the FAI establishes that it qualifies
>> as a 'Sentient person', then the FAI has to include it's own volition
>> in it's calculations.
> My understanding of Eliezer's paper was that the FAI would extrapolate
> the collective volition of "humans" specifically, as opposed to the
> volition of sentient beings in general, with the underlying premises
> being:
> (1) Human behavior is affected by an abstract concept of morality, AND
> (2) Humans who know more, are smarter, etc., behave in manners that are
> more consistent with that abstract concept.
> To base collective volition on intelligence alone would ignore the
> significance of the first premise.

Correct, with the notation that this is the *initial dynamic*, which would
presumably be intended to come up with a better definition of sentience -
perhaps the successor dynamic will include chimpanzees.

Eliezer S. Yudkowsky                
Research Fellow, Singularity Institute for Artificial Intelligence

This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:00:47 MDT