Select to expand quote
tbwonder said..
Controlled side by side testing is one thing. But in the real world people stick their GPS devices in all sorts of places. Sometimes on their wrist, perhaps on their arm, they are prone to slipping out of position. Some stick them in their back packs or even under the wet suits. In my experience even Motion devices can report up to 0.3 kt differences when worn in different places. Usually, they are closer but differences of 0.1 are not uncommon between other approved devices.
Of course this is true about real world use. We have all seen some very poor results with poorly worn devices. Even the best devices will produce poor data if they are worn in a way that severely compromises their function, like in chest or back pockets of wet vests, or under the wetsuit sleeve, or what all too commonly happens when they can slip around under your arm.
For well worn and positioned Motions, errors of 0.1 Knots and above are very uncommon in all of the huge numbers of comparisons I have analysed. In my testing, with properly wrist worn identical watches on each arm, differences of up to 0.1 knots and sometimes slightly over 0.2 knots have been more common than I would have ideally liked, but I think they are still acceptable, given the availability bind the GPSTC find it's in, and the
huge step forward from previous Garmin Watches.
But the point is, that controlled side by side testing establishes the precision of the devices in good conditions. With the G255 watches it is demonstrably in the order of 0.1 knots or slightly better. With Motions it is the order of 0.02 knots or slightly better. So when they get used in 'real world' less than ideal conditions, the degradation of accuracy isn't starting from the same base, and so far I have seen nothing that suggests otherwise.
The GW-60 watch is a pertinent example. It tested at a very high level of side by side precision when tested in ideal orientation by myself and others. As did the GW-52 which used the same 'engine' (but different antenna). I have a lot of data on this! But of course, the GW-60 was primarily as wrist worn device (and is GPS only, and not multi band). It demonstrably suffered from wearing in its intended wrist position when underhand facing down to the water, and whipping around suddenly during gybes, and bouncing around with the wrist more than an upper arm mounted device did. And yes, I did see much greater differences between that and the upper arm and helmet mounted devices I wore at the same time. Yes, they could often be in the order of 0.1 knots, and even higher in extreme cases. Of all the inherently accurate multi Hz devices I have tested, those watches performed the worst in real world use when worn as intended on the wrist.
So I was very pleasantly surprised when your initial data showed quite good correlation with normally arm worn Ublox based devices and the Garmin 255 wrist worn watches. I agreed with you that this was something well worth looking into. And it seems that the advancement of the technology of the Airoha multi GNSS and Multiband chipset, and the way Garmin have implemented it in their Sports watch, has been a big step forward, largely mitigating the worst of the effects we saw with the GW-60 watches and other, previous generation gps watches.
But all my testing and analysis has clearly shown two things:
1. The Airoha Multi GNSS/Mutiband Garmin 255 watch is 'good enough' for the GPS-Teamchallenge competition.
2. It is NOT as accurate as the Motions and ESP's if you want a higher level of confidence and precision in your speed results.
And the third really important thing to emphasise: Any GNSS device will give much better and higher confidence accuracy, when it is worn with care in the best position that is practical and avoiding as much as possible those things that we know can compromise it's performance. One thing that this Garmin watch was got going for it, is that if it is worn on the
outside of your wetsuit sleeve, it should give consistent results, as it is hard for it to suffer some of the other more serious compromises mentioned.