Will AI have desire? I do not know myself. I do not think that AI without desire would be likely to be dangerous
This is the key, isn't it. AI will not have evolved, will not come with the genetic equipment that three and a half billion years of life on earth has given us. AI will have only such desires as we build into it. Asimov's Three Laws (or Four, depending when you came in) are in effect desires, things the robot will 'want' to do.
But what would self-awareness mean without desires anyway? AI wouldn't be bored as such, because there's nothing else it would rather be doing than what its program says, including nothing, or a scan every half hour, or year, or whatever.
I think I'm trying to say that it's not obvious to me that self-awareness gives rise to a sense of self such as we biomechanisms have.
Which means it's up to the designers.
Once again I'm reminded of Dick's book
Do Androids Dream of Electric Sheep? which, far more than the movie (
Blade Runner) does, looks at the motivations of the designers, not just the androids.
Maybe some of our theistic friends can program a soul for it.