Interpretation or translation?
If you mean translation, obviously there's always the Stone edition Tanakh, put out by Artscroll, or Feldheim, or Mesorah...one of those guys. You can't get much more Orthodox than that in translation. If you really want to get specific, I think Nosson Scherman, who did the Stone Tanakh, has a Book of Yehoshua with translation and commentary that he did for Artscroll. Don't know if that's still around.
If you mean interpretation, like commentary, then get a set of Mikraot Gedolot (or if you're feeling very Ashkenazi, a set of Mikraos Gedolos) for Nevi'im/Ketuvim (or Kesuvim). Personally, I like the Maor edition Mikraot Gedolot. Nice clear printing, all the good commentators, good sturdy binding, pleasing to the eye. But as you please.
If you don't have a seforim store near you, I recommend
Jewish Books,Seforim and Judaica.. Again, can't get much more Orthodox.