It returns more quickly because the rod isn't bent as far.

There is more to it than that. You can have a light duty rod that is “fast action” but still bends a lot with a big fish on - if it doesn’t snap, that is. “Action” is actually a function of taper design, AND mechanical resistance (damping / internal friction), AND flexibility (spring constant.)