Ken and I used to sail Cloudy Bay in just about any swell as the further you go down the beach the smaller the beach break.
Cross shore is NW but it's pretty fickle so you need a strong forecast. Can also sail it on W and SW wind.
We sailed it a couple of times on an 8m swell forecast not recommended unless there's a helicopter handy luckily when Ken went missing......... that's a long story.
Have to say whether flat water or wave sailing it has to be one of the most beautiful spots on the planet