Energy is proportional to velocity squared. A five percent gain in velocity is a 10 percent gain in energy.
That energy pushed the bullet forward and the rifle backwards. Not all the energy went to the bullet. Some of it resulted in greater recoil.
Would we not expect half in both directions, requiring 20% increase in energy for 5% increase in bullet velocity?