From: Gordon Worley (redbird@rbisland.cx)
Date: Mon Jun 11 2001 - 21:58:53 MDT
At 11:38 PM -0400 6/11/01, Ben Houston wrote:
>I am not sure that I understand it from that description those. It
>seems to be suggesting that one create an overarching benevolent
>controller that looks out for the well being of all those in its realm
>-- a benevolent god if you will. If that is the case I do not think
>such omnipotence is feasible for the same reason that it is very
>difficult to predict the stock market with accuracy -- it is a chaotic
>recursive system composed of learning entities. I suggest that anytime
>less than omnipotence will be ineffective in actually controlling the
>fates of all the individual actors -- there will always exist some that
>are being taken advantage of by others in either over or subtle ways.
Re what I wrote a week or two ago, unless we are quite clear on what
benevolent means, we must mean altruistic (I realize that CFAI uses
benevolent in a few places) in the Friendly sense.
Now, on what you've written. This is not really what the Sysop is.
I think that Sysop may not be the best way to think of it. To make a
Unix analogy (because that's what I know best :-)), the Sysop is not
root, but more like the permission system, only much more complex.
It can advise aginst you accessing a file, even though you have
access to it, but in the end it can't stop you, even if it is not in
your interest to do as such, because it is your volition that is most
important and the Sysop may not violate it and must respect it so
long as it doesn't violate anyone else's volition.
On a side note, I think the Sysop scenario page needs some work.
Maybe it's already been improved some in internal versions that
Eliezer may be working on, gearing up for 1.0, but I think that it's
vague and there is a lot more to it than is mentioned on that page.
Having read numerous posts about the Sysop, I now know what it is and
isn't, but I think if I just read the page, I wouldn't like it.
Actually, I'm still skeptical of the ability to impliment the Sysop
Scenario, but if we have a Transition Guide, it is more likely but
once we run into other civilizations we may find out that
Friendliness is the exception to a norm of dystopian Singularities.
-- Gordon Worley http://www.rbisland.cx/ mailto:redbird@rbisland.cx PGP Fingerprint: C462 FA84 B811 3501 9010 20D2 6EF3 77F7 BBD3 B003
This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:00:36 MDT