I have couple domains that have a lot of daily traffic (several thousand hits a day) people being people, they will poke around, so I don't want to give them any reason to poke around. I know that I have very secure passwords and they can't get in, but why give them temptation.
Besides, bandwidth is not cheap and all the poking around uses up bites that cost me money.