Yes. It's demonstrably wrong that all individuals are equally fit.
As for the part about "sudden change", that's relative and it depends what you mean by it.
Even if you mean it correctly, in the sense of things like punctuated equilibrium, then you're still incorrect, as even though mechanisms like PE are moments of bigger evolutionary shifts, slow gradual change is pretty much ongoing constantly.
And the "sudden" shifts in evolutionary pathways are only "sudden" in geological time. The changes themselves are still gradual. What actually shifts are selection pressures, allowing for more changes to be selected for, causing more "rapid" evolutionary change whereas in periods of environmental stability and species already having reached local optimums, selection will be more inclined to favor the status quo.
Consider it like this.... It's a bit simplistic, but the point is valid.
Every generation, there is a set of mutations that occurred. Every individual has a few dozen of them. Most do nothing, some might be beneficial, some might be harmful.
Let's say that in times of stability there's a chance of 0.001% of a mutation being beneficial (low, because selection favors the status quo - it's in balance and difficult to improve further)
Then some stuff occurs and the environment changes, making selection pressures shift. New niches open up. Now opportunities arise. Some food sources disappear, others appear. Some natural enemies migrate away / go extinct and some new ones appear.
Now, the chance of mutations being beneficial go up. Now, perhaps the chance is 0.1%.
This vastly enlarges the set of mutations that might be selected for. Meaning that changes more easily occur. Evolutionary change thus speeds up. But it's still gradual.
As the new reality gets established and species once again fill their niches and approach their local optimum, further "improvement" again becomes more difficult. The potential set of beneficial mutations thus goes down again. Evolution slows down with it.
The absence of mutations that would probably be fatal does coincide with all individuals being equally fit?
No.
Here's a simple present day example.
2 otherwise healthy kids catch covid.
1 dies from it, the other didn't even notice he was infected.
Which of these 2 was least fit?