If an external observer saw it take time, then it took time.
Okay, I'm going to try and use a useful analogy used by Professor Brian Cox as I remember it. Hopefully it will explain the issue.
First, I want you to imagine a ball of light. No matter what, this ball of light travels at a constant speed of exactly 1 metre per second, which it can do in any direction, indefinitely. Even bumping into an object will just cause it to bounce off but not lose any speed whatsoever.
Now, place that ball in a metal box that is exactly one metre tall, and imagine the ball bouncing inside of that box from the top to the bottom. Each time, it is travelling one metre up and one metre down, each time taking one second to go from the bottom of the box to the top, and then from the top of the box to the bottom. If you were looking at the ball of light through a small window on the side of the box, that is undeniably what you would see.
But, now, imagine we place that box on the back of a train heading east to west, and we place you on a hill to the south watching the train travel. Obviously, the speed of the ball hasn't changed - it is still bouncing inside the box at 1mps, moving directly up and directly down. However, from your position
relative to the train, this is no longer the case, because the ball of light is now
actually travelling east to west in
addition to up and down - it is moving
diagonally.
So, if we agree the ball moves exactly 1mps, and the box it is in is exactly 1m from top to bottom, how is it possible that the ball still continues to move and touch the bottom and top of the box respectively in 1 second intervals, considering that to do so - now that it is travelling diagonally within a box that is 1m tall - this means it should be taking
longer than 1 second to reach the top/bottom of the box, because obviously if you travel between two things 1m apart but while moving diagonally, you'd obviously take longer than if you did in a straight line.
If you can understand how the ball, moving in a box at 1mps, can still be moving at exactly that speed yet, from a certain position, actually be said to
technically travelling faster than 1m, as it MUST do if it is travelling diagonally, then you can understand how relativity is not contradictory to our experience of reality. It's just a really weird part of it.