Hey newguy, listen to this.......
I was at wedge around 2 months ago surfing on my own with the missus, kids and dog on the beach. Wasn't great but it was a wave and we were all on our own. In the interest of painting a good picture we were north of the island with no one else in sight. I had had a look around before we stopped at this spot and there were other banks around, I picked this one for no other reason than kids were getting anxious to get out of the car. Set up the shade, picnic chairs, rug and then the bbq got put together.
Got a 40 min surf in before 2 cars and a moto X bike decided to park 10m away from us. Thought that was bad, they then put wetties on and 4 surfers paddled out to say hello

.
Then thier dog decided it didn't like our dog!

As you could imagine it was a bit harder than just throwing the board in the car and driving off.
Morale of the story is YES IT WILL HAPPEN TO YOU, again and again and again!!
At least i got 40 mins though hey?