...but for we humans, there are other challenges besides just surviving....
But I worry for humanity when I see people presuming that the mystery of it all is negligible because they think science has or will have all the answers that matter. ...
...And functionality without value or purpose is a recipe for self-destruction.
I, too, worry for humanity. And yes, there are many, many challenges to face. But this is the fear that I am talking about. This is what you are afraid of. This is the fear that needs to be addressed.
Because like everything else, when we investigate it, it just leads us back down that endless chain of cause and effect, again. The origin and purpose of which remain a big mystery. The more we 'know', the more we don't know.
The big mystery you speak of is simply what I refer to as that which is unknown. You fail to appreciate how the boundary of what we know and don't know has changed throughout history. Your attempt to attach meaning and purpose for us to something residing in the unknown is no different than our earliest animistic ancestors. These early hunter-gatherers had an extremely limited understanding of their world and as a consequence, this boundary of known and unknown was much closer to home. Animism assigned consciousness to the inanimate objects in the hunter-gatherers life because they could not conceive how systems (weather, rivers, plant growth) moved and changed without it.
As humanity's knowledge grew, this boundary moved farther and farther afield until now, it rests at the Big Bang and the origin of life. The track record is clear: the gods did not live behind the clouds or under the sea. We must resist the urge to assign anything to the unknown, for all that is ever there is a deeper understanding of the reality in which we live. This is what you should not be afraid of.
Because all science can or ever will give humanity is increased functionality.
And here we need to be specific about what you are describing as outside of science. If you are referring to things like beauty and aesthetics, then yes, scientific methods are not needed. These fall under the category of individual preference or desire. They are relative to the specific individual only. There is no absolute or universal beauty, or best piece of music. It is all in the eye of the beholder. Additionally, it is highly influenced by the way you are socialized. Concepts of beauty and music vary by culture.
Morals and ethics are simply mutually agreed upon principles and values that help us live and interact together in large groups. And again, we see that this can vary from society to society.
Because the 'how' is an endless chain of causes and effects...
we still don't really know how it works, or why.
And this gets us to the big
why. Why are we here, why did this all happen, and what is the purpose of it all.
The simple answer is that we don't know. What we do know is that it doesn't really get us any closer to the truth of reality when we create an artificial construct of reality to fill in all the unknowns. The universe was chugging along for billions of years before life existed on this planet, and life existed for billions more before we human beings ever showed up. It's clear that it is not about us. The universe is indifferent to us. If we become extinct tomorrow, the rest of reality will keep chugging along.
The important thing for you to understand is, that if there is no god or supreme consciousness, then all the things you value still exist. There is still morality, ethics, aesthetic, and beauty. It is just that those things are derived from us, we human beings, ourselves. And this is where the focus should be if you are worried about humanity. It is about consensus, it is about the laws and rules that we make for ourselves, that have allowed us to live in larger and larger societal groups. We have well surpassed the instinctual behaviors that allowed our primitive ancestors to survive and live in their small family groupings.
And what are the downsides of imagining an artificial construct of reality to create a guide post for the direction of humanity? If you create an artificial construct that can't be verified and you promote that concept, you are giving anyone permission to put anything they want in that artificial construct, and no one can argue against it since it can never be verified. All artificial constructs become equally valid. And since anyone can put anything in the unverifiable artificial construct, these constructs are extremely vulnerable to creating social stagnation, oppression, and abuse.
Value and purpose is for us to determine and set. We need a system that adapts and grows as our knowledge and understanding of ourselves and the universe grows. A system that reevaluates and continually improves for the benefit of all its members.
This should be the goal. We should not be bound by the ancient artificial constructs of our ancestors.