Hello Philip,  (01)
On Sat, Sep 06, 2014 at 10:33:19AM -0400, Philip Jackson wrote:
> These are useful distinctions, and I agree this is a very important topic for 
>study and research. However, these distinctions aren't mutually exclusive or 
>exhaustive: A human-level AI could be controllable and servile, and also have 
>some capabilities that match ours, some that exceed ours, and some that don't 
>match ours. The extent to which it is controllable and servile would depend on 
>its goals and range of capabilities. A human-level AI would not necessarily 
>have all the same priorities and capabilities that human beings do.
>
> For instance, a human-level AI might be designed to be an "artificial 
>scientist", specializing in a particular domain, e.g. theoretical physics. It 
>might not have any goals outside understanding theoretical physics.  (02) 
It would conclude that switching it off threatens its goals. It would also have
to be augmented with another human-level AI deciding which sub-goals or actions
lie within "understanding theoretical physics", which would have to be
augmented with another human-level AI deciding which sub-goals or actions
lie within deciding which sub-goals or actions lie within... etc.  (03)
Regards,  (04)
Michael Brunnbauer  (05)
-- 
++ Michael Brunnbauer
++ netEstate GmbH
++ Geisenhausener Stra?e 11a
++ 81379 M?nchen
++ Tel +49 89 32 19 77 80
++ Fax +49 89 32 19 77 89 
++ E-Mail brunni@xxxxxxxxxxxx
++ http://www.netestate.de/
++
++ Sitz: M?nchen, HRB Nr.142452 (Handelsregister B M?nchen)
++ USt-IdNr. DE221033342
++ Gesch臟tsf?hrer: Michael Brunnbauer, Franz Brunnbauer
++ Prokurist: Dipl. Kfm. (Univ.) Markus Hendel  (06) 

Attachment: pgpSuEklC1zc3.pgp
Description: PGP signature

_________________________________________________________________
Message Archives: http://ontolog.cim3.net/forum/ontolog-forum/ 
Config Subscr: http://ontolog.cim3.net/mailman/listinfo/ontolog-forum/ 
Unsubscribe: mailto:ontolog-forum-leave@xxxxxxxxxxxxxxxx
Shared Files: http://ontolog.cim3.net/file/
Community Wiki: http://ontolog.cim3.net/wiki/ 
To join: http://ontolog.cim3.net/cgi-bin/wiki.pl?WikiHomePage#nid1J  (01)