Hi Yuppy,
I'm a little concerned when you say Accommodation Huts and walk to the Beach.
The main sailing spot 'Tombstones'is accessed via a 12 foot limestone cliff onto a strip of sand next to a reef.
It is called 'Tombstones' because some sections of the cliff have broken away forming what looks like 'Tombstones' from the water.
The closest accom to Tombies is 3 mile camp, this 'campsite' is a dump (with fantastic water views) and the site of many relationship break downs.
The 'Huts' are at the Homestead and it's a 15min drive to Tombies from there.
On the water it is a magical place, on the land, more feral Mad Max
Go for it mate, just be prepared.