There may have been a pre-Christian Anglo-Saxon goddess by the name of Eostre whose festival month coincided with the Christian holiday. Our only source for that is Bede, and it's not clear where he's getting the information or if he's engaging in some "creative scholarship," as folks like him often did. It's equally likely that the Germanic word for the holiday simply refers to the concept of dawn or rebirth. We really don't have enough evidence to know either way.
Where people go astray is in claiming that the eggs and rabbits were sacred to Eostre, something for which there is no evidence whatsoever. It comes from the false assumption that any symbolism drawn from the natural world must be pagan in origin. Christian imagery has always included animals and plants. So even if we were to accept Eostre as a goddess, it's not logical to leap to the conclusion that any particular aspect of Easter celebrations can be connected to her. It's sort of like Christmas trees, another pseudo-pagan tradition that actually comes out of the Victorian period and has no real connection to anything pre-Christian.
I agree. Particularly odd to me is why the obsession (I'm using that word lol) with ''purity'' and ''fertility.'' It has surprised me to learn that such ''values'' weren't exclusive to religious folk.