Disagree. If you look at the fact that those who participate in aggressive behavior tend to put themselves at more physical risk of dying, while those who try to abstain from violence have a better chance of living to pass on their genes, the idea doesn't hold as much water as you might think.
Take a look at young people. There are those who become quite aggressive and may get into fights, assaults, even gangs. This lessens their chance of survival. They may be killed in the streets or wind up in prison where they may meet the same fate. Whereas, the young person who decides to avoid aggression and those situations at all cost have the greater ability to become educated and live productive lives and mate and reproduce, passing on their genes.
Aggression does not equate with survival, nor does non-aggression equate with being "weak". If anything, non-aggression equates more to being more intelligent as those who choose not to be aggressive are choosing not to put themselves at risk, which is the smart choice.