Memory cove is beautiful as long as it's not strong E or NNE, you could shoot across the thorny passage about 5nm to Hopkins island and take a safe swim with the Australian Sealions?
Aviod Thorny passage and Cape catastrophe when strong winds against tide.
You can anchor in the Main bay of North Neptune's in South west winds or light winds in 5 to 10 meters for lunch but any other winds you will have to anchor in 25 meters and is not advisable for yachts. North Neptune's is a marine park now so no fishing and I would not advise any Watersport activitys.
South Neptune's is pritty much the same however you can sneak into the sand in SSE out the front of the old weather station homestead.
A supermarket is currently getting built in Coffins not sure it will be finished when you arrive.