The truly mind-boggling aspect of these religious arguments is that the religious proponents seem to think that they have explained away the paradox of infinite causal chains. Skeptics point out that God merely becomes part of the causal chain, but that seldom deters the true believer from a kind of "turtles all the way down" logic. God is declared to be "timeless" in some obscure sense of the word, and so he provides a self-satisfying way for believers to ground their imaginary causal regression and somehow step outside of the paradox.
I have heard it proposed that "time" began with the singularity that caused the Big Bang ("Upon occasion, Hawking has stated that time actually began with the Big Bang, and that questions about what happened before the Big Bang are meaningless" --though perhaps he meant that it effectively began with the Big Bang). Isn't an infinite causal chain equally "explained away" by suggesting a singularity before which no "time" existed?