From: Phillip Huggan (cdnprodigy@yahoo.com)
Date: Thu Dec 08 2005 - 11:58:40 MST
No way. Equating PAI with AI boxing is circular reasoning. From the entire state-space of AGI optimization processes, FAI attempts to select an optimal solution from the state-space subset where we don't go extinct, among other things. PAI further reduces the subset volume to those solutions where it must rely on human actors to act (not defining PAI computation as an act). I don't know if it is actually possible to hit such a small target. My examples of computronium as an active AGI danger and mass suicide prevention as a PAI safeguard were horrible. Consider a boxed AGI that seemed was actually UFAI; was intent on killing us off. It has been concluded that by using gravity wave magic or pychological persuasion, or even hypnotic screen interface flashes, the AGI would get out. But the key question is would an AGI programmed in its unchangeable goal-structures to only offer suggestions be able to kill us off? I'm pretty sure that if the answer is no, it would still be able
to be friendly and extinguish imminent extinction threats in all but the most dire geo-political/technological environments even with the human actor handicap.
Chris Capel <pdf23ds@gmail.com> wrote: On 12/8/05, Phillip Huggan wrote:
> But if PAI spit out
> a course of action like "okay, now you have to let me online, and then all
> kill yourselves", we could blast ver servers with a shotgun. If FAI fails
> because of some fluke error in the philosophy or logic of the goal system we
> give ver, we are steamrolled. If PAI fails the same way, we have a chance
> for human intervention before we finish building the steamroller ve is
> giving us the blueprints to.
Passive AI reduces to the AI boxing problem, plain and simple. If a
superintelligent PAI fails, it's no longer passive. Any constraints we
try to enable to ensure that it remains passive are an AI box, by
definition.
Encouraging passivity is a good precaution to take, (and I presume one
that SIAI is planning on taking,) but it doesn't mitigate the pressing
need for Friendliness, not even a little.
---------------------------------
Yahoo! Shopping
Find Great Deals on Holiday Gifts at Yahoo! Shopping
This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:00:54 MDT