remove mine constantly....
i decided long ago to keep the pass side out....makes for easier tuning on the wastegate rod, plus now that I have an a2a, no worries about cutting....and it seems that my engine bay stays a bit cooler.
one thing though... I dont drive my truck in the rain. If you like a clean engine bay, you may want to consider keeping it in with minimal bolts.
plus, its not to healthy to have water spraying around on hot manifolds/turbo and DP.
If you plan to put it back, do like John said and "forgot" to put in a few bolts, it'll make life easy when you go to do it again.