Its a good rule of thumb but should not be used as an explanation or argument. Its not an argument.
Sometimes people I respect claim that sex is wrong if both parties are not consenting with understanding, and I object that its not an argument. I can probably agree with that rule of thumb...