"I am" is the one and only factual truth, more self evident than an apple on one's palm. All observations automatically prove "I Am", which however is not observable or graspable, unlike the apple.
So, when scriptures teach "I am" is the only God and all else is lesser (other gods, anya devata - in Sanskrit), IMO, they are not teaching worship of a fictional thing.
OTOH, worship-attachment to created objects due to the very existence of "I Am" is idolatry.
Subject open for dissection.
Therefore mortify [put to death] the deeds of the body that are of the earthly life: fornication, impurity, inordinate affections, evil lusts of the flesh, and covetousness, which is idolatry. Col 3:5
So, does anyone hold that destroying idols (murtis) in temples is equal to overcoming idolatry?