Or maybe it's accurate because of seeing that even the best of us still have faults. It's great that you want to help others. In my world that just means God gives everyone some form of moral compass, and you haven't totally suppressed it because of sin.
If everyone has a moral compass, even if they are atheists, then why is belief in god needed for a moral compass?
And of course we don't know if we would descend into barbarians if we were not restrained by society, because we have never had society completely collapse on us.
What history shows us is that some people would descend into barbarism while others would show compassion and self-sacrifice.
If humans were inherently good there would be no crime, no wars and on and on. It's not hard to see we aren't inherently good.
The tiny proportion of people who commit genuinely "evil" crime (as opposed to things like drug possession, theft through destitution, etc), shows that people are generally good.
I don't know about you and your social circle, but with mine we are nice/help each other and others far more than we abuse/take advantage each other and others. In fact, I'd say it is a ratio of like 1000:1, probably more.
Maybe your lot are different. Perhaps when you go to a party the only thing that stops you stealing a wallet is god watching you?