if your thinking of kiting from woodies to garden island you are crossing a shipping channel, very strict rules go with that, need clearance from authorities.
as for how close you can go well the closer you get the easier it is for the navy to pop holes in your kite