I have been unconscious and I have been in deep sleep. That is the point. I exist in different forms but what is my true form? Water exists as solid, liquid or vapour. What is its true form? Swarupa?
You are using lingustic usage as a guide to ontological truths. By that criteria, love and emotion reside in the heart. Common language uses folk psychology which is dualistic and considers the self as a homunculus residing somewhere insider the body. Using common language as a guide to truth works only if folk psychology is found to be true, not otherwise.
Brain is an object of waking state phenomenon. It is not an object in other two forms of consciousness. When I observe a dreaming or sleeping man, it is my waking state observation. It does not correspond to the nature of consciousness from the first person perspectives.
Take time to contemplate on this. Consider the forms of awarenesses and forms of corresponding universes in waking, dreaming, and sleeping states from first party perspective.
If you do so, you may intuit how there is nothing solid and graspable actually. It is mind/awareness taking on different forms. There is nothing worthy of clinging to. And you will realise that forms that we consider to be solid and graspable are forms of awareness only.
And even as taste of mango cannot be explained, the aforesaid also cannot be explained. The point is not to score points but to gain a first person perspective of what our Swarupa, true form is.
You are arguing from idealism. I can construct a theory that is identical to materialism based on first person idealistic framework alone. In such a situation all "objects" are entities in the phenomenological space and my theory of how to categorize them is based on pragmatic considerations of self-interest. So external objects are seperated from internal object by virtue of emotional and interest valence (it hurts if my toe is crushed but does not when your toe is crushed etc.) Similarly the identity inference between the bones I feel directly and the pictures in the X-ray is based on similar pragmatic considerations. In such a situation I make no ontological commitments at all, rather every theory is a model whose "truthfulness" is based on its impact in the quality of my first person experience upon adopting it.
In such a stance, the self is also just another object in this phenomenological space. Its a persistent object, but so are many other things, like time.