But what I still don't get is what is grounding your view.
Let me put it this way: Let's say I agree that one should be able to freely masturbate in the privacy of one's own home. That still doesn't mean that I accept that people have the right to do that.
Then answer this: what is the difference that you see between "be able to freely" and "have the right to?" What differentiates those in your mind?
I'd like to expand on this, if I may, before you answer,
@Koldo.
You say, "that still doesn't mean that I accept that people have the right to do that," so how does it become up to you to deny them the right? Where does that come from? Aren't you just a person, like everybody else? Why should your notion of rights take such precedence?
When Pope Leo III (a pretty feeble Pope, by the way) crowned Charlemagne in 800CE, it served two purposes -- it gave Charlemagne the imprimatur of God Himself to make whatever rules he saw fit over people's daily lives, but it also established the power of the Church to make all the rules around their faiths -- what and how they were to believe. A nice, and very convenient fiction. And it is a fiction, because it's only "true" because Leo and Charlemagne said it was.
And we humans have been struggling with this business of control over the lives of our fellows since humans banded together in groups larger than just a couple of families -- so basically for all of our known history. So, for example, 8 centuries after Charlie and Leo's little fiction, Giordano Bruno was burned to death for having ideas of his own about the movement of planets, and some thoughts on the Trinity, among other wrongful notions.
So, yes, it is true that power can take away people's "rights," (as the US Supreme Court actually did just last year in Dodd's), but rights are not "conferred" by anyone -- they are simply assumed until some power denies them. And much of the civilized world has, over the last century, been busilly abandoning those denials of rights. Thus, they have not been conferring rights at all -- they have been removing the unwarrented denials of rights that should merely be recognized.