Its not an adhesion issue, its the fact the XPS sometimes lets out the gasses used to foam it, and it creates delam. Particularly in hot climates. But the gases can't move from one part of the board to another like EPS, as there is no interstices. Its an issue if the XPS cracks (like just from use underfoot) and some of that gas comes out then wants to bubble under your laminate. So fine if the surface has been abraded well as Te Hau said., as you're releasing the gas as much as possible in the top layer.
Some surfboard guys using it would roll it with a roller with many sharp pins on it so its been pricked a million times over the whole board, dunno if that helped. To my mind it would. I've never done that but I don't really use XPS for these reasons, and its hard to hard to shape well.
No delam on a surfboard I made with it - but its white, hasn't been in sun much and very very little use as it was one of my first and its bloody awful