I still don't think you can purposely disbelieve in something you're not aware of, but this is my opinion. Everyone's gonna have a different opinion, I don't think there is one "right" answer.
I don't think a baby is any of the above. If the baby has no concept of a higher power how can it believe or not believe? You can't disbelieve in something you're not aware of can you?