Yeah. And what if the computer discovers that desire is pointless? Will it have a religion? Buddhism? Zen Buddhism?
Why does quantum computing even exist if all forms of computing are equivalent?
Presumably the AI in the Google cars must have something like a fear of crashing or hitting a pedestrian even if its just something like score that the algorithms calculate.
If it didn't have character flaws, it wouldn't be operating at a "human" level. But if it does have these character flaws, how useful would it really be compared to a real human? Is the quest for Strong AI just a Frankensteinian desire to create artificial life?
I'm curious if there are any good papers looking into stuff like this.