There's a problem with the logic of the entire idea anyway. That is, the definition of "you". What do you consider "you"? Your consciousness? Your body? You "soul"? Ultimately the "soul" is what ends up being important to the ideas of an afterlife, so for the sake of argument, let's say it IS your soul that defines you... then what is that, exactly? Well, it doesn't come with any innate knowledge of its own - this is proven by the fact that we're born with nearly zero understanding outside of a few instincts. And then, our personality and mental/emotional traits are built upon from very little (think "baby") and we slowly become functional and knowledgeable about various facets of the world around us due to the way in which we are nurtured. Now, none of that can really be attributed to the "soul" either - this is proven by the fact that damage to the brain can have a profound impact on cognitive function - you can literally lose huge swaths of your nurtured "self" to brain damage. If the "soul" was the thing that held all of our parts of "self", then our personality, intelligence, understanding - all of those would remain intact even if the brain were damaged - but let's face facts - they DO NOT, necessarily, remain intact. Human experience has proven this.
Ultimately, my point is this - if your soul is not your personality - not your intelligence - not your knowledge-base - not your emotionality - not your memories - not anything that makes your human-self "YOU" - then what the hell do you care what happens to it?