I don't think the Bible has any monopoly on talking about conscience, good governing, or laws. There were philosophers who predated Jesus and came to similar realizations. It doesn't mean that they were helpless people who needed God to tell them what to do. People learn through trial and error, such as learning that poor morals can lead to bad outcomes for a community and a society.
There are many concepts which aren't very comforting. For example, our own mortality, as most people fear death and don't find it very comforting. But it also appears we don't have any real choice in the matter either.
I actually believe that a case can be made for being more at peace and comforted by the concept of a godless universe, as opposed to a universe supposedly governed by a sentient, powerful being who is actively involved in human affairs. Some people believe that "everything happens for a reason" and that everything is all part of some "divine plan" by some powerful entity who "loves" us. That belief hits a few serious roadblocks right out of the gate.
By not believing in such things, one doesn't have to expend energy or become anxious trying to come up with reasons for things which we can't explain.