The arguments that annoy - and perplex - me most are atheists fanboying/fangirling/fanchilding religion: atheists who praise religion and theism, or atheists who adopt positions that are completely irrational without some set of religious premises (e.g. anti-choice, anti-gay, anti-trans, etc.).
The one beef I have with religion is how brashly it makes its moral claims (anti-gay and stuff like that). I also take issue with how suspicious it is, how afraid it is, of sexuality in general. How it needs to name the man as master, women as subservient... how it fears femininity. How it fears homosexuality or anything different. I majorly take issue with that. Religion often blunders, not only with its statements about nature, but also with its moral statements. If you want to know more about reality, religion is the last place you should look.
But, otherwise, I fear I may fit the bill for being a "fanchild" of religion. As I just said, I'm not a fan of its irrationality, but, apart from practical or moral concerns, I find it fascinating. Religion, to me, is certainly one of the most curious and interesting of human enterprises. I can criticize most of it, but not all of it. Where I'm apt to fault religion is where it impacts sociality, especially with its brutish moral claims. I hate religion in that regard. But at the points where it DOESN'T coerce, control, or abuse I like to make an effort to view it fondly. Even concerning its falsehoods... its myths... Myths are dangerous when taken literally, but when taken figuratively, I think they can sometimes be helpful. And that is curious to me. How falsehoods can be helpful. And all of that feeds in to why I find religion to be one of the most interesting things humans do.
.. but why the hate for the Problem of Evil?
I don't "hate" the problem of evil. I think it's a good argument, in that it kinda forces theists to rethink and adjust their brash claims. Truth be told, I'm more interested in the problem of evil than your average bear. I like the problem of evil. But, in the final analysis, it must be pointed out that it fails to accomplish what it set out to do: disprove an omnimax God. It's worth tracing out the logical borders and saying out loud that this isn't a good argument.
One good thing the problem of evil does is teach theists to rethink things and be more careful with their claims. For that reason alone, I'm glad we've decided to keep it around. But it does have some weaknesses. And no atheist should be a coward about addressing those weaknesses.