An often omitted factor is the affect on those that don't get the special treatment. I think it was in the 1970's in England, they passed a law to make the wearing of motorcycle helmets compulsory. Many bikers objected to it. The Sikhs claimed that it interfered with their religious "rule" to wear a turban. Well, they were allowed an exception to the law.
The non-Sikh bikers were furious at what they saw as an unfair exemption, and what would probably have calmed down quite quickly became a movement. Bikers would engage in "towel runs", where large groups would ride around with no helmets and towels wrapped round their heads. A lot of anger was directed at the Sikhs who were generally seen as inoffensive before.
I know I'm going to be accused of being intolerant, but the way things are evaluated based on "fair" and "not fair" is deeply seated in us and generally, I believe, a good thing. Forcing people to do things against their will and simultaneously allowing a minority to avoid that ruling based on religion is unfair, as I see it at least.