My understanding (I DO NOT own a cell phone) is that removing the battery won't do it. The SIM (subscriber identity module) card, where all your info is stored, is powered by an internal, non-removable battery.
You must remove both the battery AND the SIM card to be untrackable.
Those with more/other knowledge please respond.
the phone is traceable if they know the number, they can poll the phone then triangulate with cell towers so long as the battery is in
the SIM doesn't communicate with the tower
SIM cards require no battery. Taking out the battery is enough to kill any tracking.