I'm really not sure where this is going, or why...but it's certainly not something I want to argue, because I was initially explaining MY reason for personally not being a Buddhist.
While Buddhism has interacted with and coexists with local and regional folk religions, that's just fine. Christianity and Islam, as the other major 'world' religions, have also done so in many areas, but have also made a great effort to eradicate (or in some cases, incorporate) local/regional religions, and to force conversion, which I don't think Buddhism has done.
But my point is, when people start thinking of themselves as gods or demigods, and stop working with and listening to the ancestors and earth spirits, the result is going to be trouble--for everyone. In the West, that jump has been made through the Abrahamic faiths and the Enlightenment. I see at least the potential in Buddhism for rejecting the ancestors and spirits as illusion. It's a concern for me, but maybe if I had engaged MORE with Buddhism than I have, I might not be as concerned about it.
I guess one of the reasons it doesn't fit with me could be that the whole idea of the illusion, and the unity with the One, however it's conceived, is simply not something that I accept as real. Intellectually I understand it, but I do not experience it.