Population growth could be that extinction level event that puts us over the edge. Not directly, but for all the reasons you have listed and more. All that is required is that the ability of living things to adapt is slower than the rate of environmental change and it is bye bye. Population growth is part of the environment. I mention this, not because I think you are unaware, but that others are. People often think of the environment as the weather and maybe a geographical position, but it is all those things that effect living organisms including other living organisms and their own biology and impact.If the change is gradual, we'd easily adapt.
But if the population continues expanding, this would exacerbate
global warming, leading to massive population migration. That
sure sound worse than coping with a stable or declining population.