Best spot by far is Coronation beach, about 22km north of Geraldton. You can camp there for about $7 a night but there are no facilities other than toilets and no water for drinking, so you have to bring your own from town.
Point Moore gets decent wind too but hotels in town are very pricey, all in the $100/night region. There's also Back Beach, and Sunset. There is a good caravan park in Sunset (Big4) that has nice cabins on the beach, but we're sort of at the end of the windy season so you might get wind and then again you might not.
PM me if you need more info.