Talking Start Time

When should you leave for a marathon. We're thinking that if the weather is bad why would you want to be there early. On the other hand does it really matter if you are drenching wet for 4 hours or 4 1/2 hours?