I know there are outdoor panels, but it seems a pita to go outside in rain or snow and reset a breaker, why not build the house with service panel located in a room. What if your neighbor suspects you have a grow and doesn't like it and shuts off your power, I would put a tamper switch on the cover and let you know if someone opens the cover door.
Then you shoot him.