There is actually very little conflict between atheists and religious believers. Most religious conflict is between people of different faiths.
On forums like this, we're a tiny proportion of the wider population and such discussions tend to attract an unfortunate proportion of extremists and trolls (of all positions and beliefs). The discussions here aren't at all representative of what happens in the real world, even for most of us, let alone anyone else.
In the vast majority of places and situations, people of different religion's or beliefs, and certainly general non-believers, get on perfectly well. Much of the time, you'll have no idea what beliefs people you interact with on a daily basis even hold. And as you said yourself, it is the committed believers for whom their faith is the primary focus of their lives and so it is they who bring it in to those secular interactions and thus create potential conflict.