In a sense, of course I agree. I worship God, not Torah.
But Judaism is not a religion of pure internal experience. It is defined not merely by belief, faith, or personal relationship with God, but by communal responsibilities, personal duties to God, self, and others-- by our actions. And without Torah (in the widest sense of that term, including Oral Torah), how would we know what to do in the world in order to do right by God, to wrestle with our understandings of what we believe He wishes from us? It would be utter chaos, and Judaism would devolve into nothing but abstractions and vague generalities about God and humanity.
So while I certainly feel like, yes, what is truly at the core of Jewish belief is God, nonetheless, Judaism is about the covenant between God and Israel, which is embodied in Torah. That is why the Rabbis of the Talmud used to say Yisrael v'Oraita v'Kudsha Brich Hu chad hu ("Israel, the Torah, and God are One")-- obviously Israel is not God, nor is God Torah, but God, Israel, and Torah are inextricably bound up together in covenant. To remove even one from the equation is to collapse the entire structure of Judaism, which cannot survive without all three playing their roles.