halagear.com/products/4-5-gummy-finI have this fin from Hala gear that is a 4.5" flexible fin. Other companies sell the same fin in the 4.5" and shallower 3" as well. It fits most fin boxes. If you do a search for river fin for stand up paddling, you will probably get a hit from a company closer to you that sells a river fin.
Another option is to get a standard dolphin fin or touring option that has some flex/plastic construction and sand it down for shallow water use. Most inflatables come with these flexible dophin fins standard, and shops typically carry aftermarket dolphin fins.