[MagnusWootton]

I think a sentient/conscious ANN would be better off learning from the feedback of the environment itself. Having an unconscious program limiting the actions of a conscious being seems like it would be dystopian. But if we're talking about an ANN that's just an idea generator, then a "God" could be a good solution. Maybe the "God" could apply a version of Maslow's Hierarchy to each sentient being within its sphere of influence. Then it could let through outputs from the ANN with a high probability of optimizing each estimated hierarchy.

You cant learn what to do off looking at the environment alone,  you can do whatever to it, theres a huge ambivilence here,   what the computer is driven to do must be a separate piece!

[frankinstien]

You cant learn what to do off looking at the environment alone,  you can do whatever to it, theres a huge ambivilence here,   what the computer is driven to do must be a separate piece!

Well, my Rottweiler could shred me to pieces but he doesn't, why? No Asimov robotic laws, no belief in God, no monitoring of thoughts.

You know when people see him loose out in the hills when we run into people while hiking, you can just see the fear of death on their faces.  But he doesn't bother them, of course, if you tried to enter my house he'll give you a different attitude.

[HS]

Exactly, where power is involved, important choices have to be made somehow. It seems like the best bet to give that responsibility to the system with the most complete understanding.

[MagnusWootton]

Exactly, where power is involved, important choices have to be made somehow. It seems like the best bet to give that responsibility to the system with the most complete understanding.

Yes you are correct,  running a powerful genius on the amount of apples that are in his/her eye only gets you so far,   but how do you put it into a machine? it seems to be unappleable!