Yes, you should have politely should not wear a dress shirt. Shorts or even wearing sandals, you should take off shoes before visiting the Palace or temple, I.
Yes, you should dress formally. Do not wear a T-shirt, shorts, or even wear slippers. You should take off your shoes before entering the palace or temple.