Funny enough, the same theory works for racing. My fastest timed laps always felt slow to me, because it was smooth, and I was comfortable. The laps that felt fast to me, were actually slow, because I was off-line, correcting steering to much, working the pedals too much, etc...
Interesting observation. Thanks.