I just don't find it very likely that this effect can "slow down" a swimmer to the point of exhaustion. (And if a swimmer exhausts
himself--past the point where he or she should switch to a different stroke--then any drowning becomes attributable to "pilot error").
It's ok to compare a swimmer moving through the water to a ship doing the same. To not consider displacement in the equation is sloppy.