You're a long way from Pt Fairy (about 2.5 - 3hrs at a guess), it'd be quicker to go to Geelong - Pt Henry if you're wanting flatwater (a bit over an hour). Depending on the swell, from memory the south-end of the bay isn't too bad, especially once you get behind the breakers...weather-permitting (as always).
Besides, you'll have more pressing matters...dirty-weekend away!