Well, to mystics at least, even Christian ones, strange gender associations regarding their deity would be nothing new.
Anyone here ever read the medieval poem
Granum Sinapis? Especially the beginning. It's in medieval German, so you probably gotta rely on translations, but it mentions things like giving birth to creation, and even the logos streaming forth lustfully out of god's breasts and yet remaining in his womb. The second verse then tames down a bit, only mentioning the fire of love between god and logos, and the holy spirit gushing out of them as the bond connecting them.
Admittedly, such texts are rather an exception. More common would probably have been bride mysticism, I suppose. If done by male authors, they normally self-insert into the bride's role, so on that department there seems to have been little possibility of not putting god into the male role.
So, of all religions Christianity seems like one of the less-likely ones to have a genderless deity, but there were certainly already in historic times such approaches even in that religion.
As far as I know, Logos is Jesus, and not the holy spirit. Also says so on
Wikipedia (not like that would be a proof).
Regarding Jesus and/or the holy spirit being considered female - could that have something to do with Gnosticism and them being equated with Sophia?