I think it's a fair statement to say there are few places in Australia where
you can get consistent side off waves... Cocos Islands, perhaps?
I was lucky to score 3 sessions in 5 days at Bridgewater Bay, Vic (slightly colder than Cocos - my 3/2 was enough). Check
SeaBreeze Charts - Vic - West - this place is always copping the fronts!
Westerly is the wind direction and "The Hole" about 3 kms East of Cape
Bridgewater surf lifesaving club is definitely the place to be. I sailed 2
out of 3 there and the wind is definitely less gusty and the waves slightly
bigger there than out infront of Cape Bridgewater cafe. On the non-windy days
there are plenty of surfing options or you can take a boat tour to see the
seals....