When Muslims follow up by saying, "peace be upon him". The Prophet is a concept of Islam, and thus, to speak of him and not follow up is to use the Islamic context, and not pay him the respect he is due in that context.
I mean, I wouldn't put a Quran on the floor, so not paying respect to him...