What do you mean, 'us' - those stuck paying $4+/gal for gasoline? Those in other countries who can't afford to eat?
There are solid reasons for curbing speculation - namely to prevent the chaos uncontrolled speculation causes.
1. Nobody owes you gasoline at a price you prefer.
2. The price you pay at the pump would average higher over time without speculators.
3. Speculators don’t control the price of gasoline.