Wind tends to be lighter in summer in SoCal so you're looking for an afternoon seabreeze to kick in (which might be 8-15kt). Also, if you're able to drive a couple of hours then options open up... This guy has some good videos from local areas:
1. Belmont Shores/Cabrillo (around Long Beach) are the closest i'm aware of. I went to Belmont 2x and did not have good winds, it's pretty urban and not that nice. Big kiting scene. I think you would want a 6-8m wing there most of the time and a big foil.
2. Lake Perris, Lake Piru, Lopez Lake, and Lake Isabella could have good afternoon wind patterns and are probably 1-3 hours drive (I haven't been there personally, but friends have).
3. Santa Barbara (Leadbetter Beach) and Avila Beach/Port San Luis are fun areas I've been to with good afternoon sea breezes or strong winds on the right weather patterns. There's several other areas to check out north of Santa Barbara (e.g. Pismo beach) that are more challenging. Water is colder there vs. SoCal so you would want a summer wetsuit.
Ventura coastline has a lot of beach access but probably tougher to find good conditions.