As Mark says.

Just to clarify: They are not normally glued in. The hole is drilled for them so they are an interference fit. You press them in and they are tight enough to stay in and will still move enough to line the bolt up.
Over the years I have noted a few different size barrel nuts have been used by different fin manufacturers, so it is a good idea to measure them and know what you are buying. If you need to go to a larger one than the current, you need a drill just the right size hole in the fin to match it.
You can make your own barrel nuts fairly easily by sourcing the right diameter brass rod, and then drilling and tapping a hole through it. File a slight bevel on the ends of the new barrel nut so you can start it into the fin head hole.