It depends on what you mean by "religion." In the broadest sense of the word, I don't really have an issue with people believing in a God or gods or venerating that figure, nor do I want to censor the belief in an afterlife or rebirth.
I do have issues with organized religion. That is, communities who band together out of a shared cultural identity or institutions (like churches, mosques, synagogues, monasteries, etc.) with a hierarchical religious leadership.
The former tends to erase individual identity for the sake of collective majoritarianism, and it almost always ends up harming minority groups within that community and creating outcasts of those who can't (or won't) fully conform. At its extreme, it leads to things like xenophobia and ultranationalism.
The latter is outright abusive, because it's giving a select few the power to control those who are deemed underneath them in the hierarchy. It also leads to those in these institutions to reject responsibility for what they have chosen to do and value, placing the blame onto some religious figure or even a mythical one, which I think is self-destructive.
I'm not saying people can't gather with those who share similar values or interests, but they should be wary of these pitfalls. They're unavoidable in the majority of religious spaces I've seen, and so I think we're better off without those spaces.