Are you saying its difficult I the can't remove the trappings or just difficult in general?
Consider someone who moves from one country to another. Just for example, let's say from Brazil to the USA. And not as a child, but as an adult. So they get sworn in as an American, and get citizenship. For awhile they identify as a Brazilian-American. They feel comfortable around Portuguese. They go to Latin-American stores and find food they're comfortable with. They like soccer and call it football. It may even carry over to the next generation. So religion switching is like that. My Mother, born in Canada in 1922, of English immigrants, all her life referred to the 'old country', when she talked about Britain. Yet she was born in Canada, and learned that phrase, undoubtedly, from her parents, who actually did have an old country.
Thank God for the country thing, as I now have a beautiful Hindu temple that feels and works just like the one 'back home' in Sri Lanka.
I'm not saying for a minute that there's anything wrong with this process. I'm just observing the process. It really isn't easy. I still have 'rural' written all over my face, especially when it comes to identifying trees, crops, etc. Agnostic is deeper, but still in there somewhere.
So it is like that. Much is hidden, and can only be seen from a keen observation, both outward, and more appropriately, inward.