I originally turned to math and science because of the 'certainty' they were supposed to give to our ideas.
What I have found is that science is filled with uncertainty. There is always a flux of different ideas and proposals for every phenomenon and not enough time, energy, or money to test each and every idea. Until the evidence is produced/found the default state is one of uncertainty. This is part of how we learn: we go from uncertainty to more certainty (note I did NOT say perfect certainty).
And, as we have learned more in the sciences, it has become clear that there are things we simply cannot know because of how the universe works. The Heisenberg Uncertainty Principle quantifies some particular cases where statistical uncertainty is inherent in nature.
But even in math, there are uncertainties. There are many unsolved problems and there is even the possibility that any given problem is unsolvable. In fact, we know with certainty that some problems are unsolvable. The work of Godel and Turing in the last century have proven that uncertainty must be present even in the most 'certain' of subjects.
For me, it is better to be uncertain that to be falsely 'certain'. It is far better to say we do not know than to claim knowledge where it doesn't yet exist. So uncertainty is the default in this wonderful life. Learn to live with it and relish it while also whittling away at it!