You don't need a CNC mill. You need to buy (or borrow) a jig:
http://www.cncguns.com/projects/ar15lower80tutorial-1.html
The rest comes from your local Home Depot. You don't even need to own the drill press (though it's handy) - there are often places where you can come and work for an hour for a small fee (or for a unit of beer.)
Hoping for the best!