From: Tennessee Leeuwenburg (tennessee@tennessee.id.au)
Date: Wed Feb 23 2005 - 00:24:36 MST
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
|> Well, I think designing in a reasonable sense of
|> self-preservation of identity into the AGI and using a
|> reproductive model will mostly take care of things. No individual
|> intelligence that values its own existence is going to wilfully
|> construct an offspring which will guarantee its own demise,
|> unless perhaps it regards its own demise as inevitable, and can
|> fulfil some other important goals by doing so. It is a short step
|> from self-preservation to morality.
|
| Suppose for the sake of argument this ensures the second and third
| generation will still be recognizably Friendly, how do you ensure
| the same thing for the millionth generation? (Which may not be all
| that long a time coming, when nanotech assembler technology is
| available.)
Well, there's an easy answer to that - 2nd and 3rd generations will
have Friendliness as a goal for the future, just as we do now, and
will be better able to ensure its implementation. With every
generation comes increased confidence, not decreased.
What do you think? Maybe?
Cheers,
- -T
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.2.4 (GNU/Linux)
Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org
iD8DBQFCHC+zFp/Peux6TnIRAu50AJ9tJ3BTIojBNu1pCPjz+tLqpvE9zQCfcdvY
bUWyrthl1HCb4ue+/zz3ImY=
=lQZW
-----END PGP SIGNATURE-----
This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:00:50 MDT