Every time I reinstall it, I go immediately to the update tab and turn it off, every time, yet it still updates. I've also heard to never click the Help/About Firefox tab because that will also auto update the software.
Now so far I have FF24 running and it hasn't updated, so I'm keeping my fingers and toes crossed (that's hard to do!).
Did you check out post 25 ?