No, but they are philiacs.
So is everyone else who is attracted to something?
I am not assuming all pedos are rapists. I am assuming that humans, in general, are weak and at the mercy of their desires. I would not leave an addict alone with their addiction, and if they happened to be the vicinity of their desire I would be justifiably wary, especially if acting on that desire would result in very bad results.
Just because you are around a lady and you are a heterosexual, does that mean you'll rape her?