I now look more at the energy of the wave in the forecasts than the height. The Energy is proportional to the height squared times the period.
I know that I need 30 kJ (kilo Joules) to catch waves, 50 to be able to do rollers with a dedicated small wave boards, prone shortboards need more than 100 kJ, and my regular spot begin to close out at 500 kJ, 1000 kJ is my limit, etc... And I knew that last sunday was going to be epic(*) at 13 000 kJ, and that I should not be in the water by fear of drowning :-)
This said, the reason to measure the "back" of the wave is to try to estimate the swell size (the one given by the buoys), because the wave face will depend a lot of the way the spot bottom will focus the swell. So you can compare waves across different spots. But I tend to use body-related wave face measures (head high, waist high, etc...) rather than speaking of actual height, as nobody uses the same scale when you speak in feet or meters.
(*) The same wave by Ben Sanchis, seen from the beach and by drone on my home spot last sunday...
www.facebook.com/ripitupprod/videos/2227485664141233/www.facebook.com/Billabong/videos/301901637200669/More of this 13 000 kJ session: Not SUP related but, what a sight...