In most cases, when you turn your phone off—even if you do not remove the battery—it will stop communicating with nearby cell towers and can be traced only to the location it was in when it was powered down.
NSA growth fueled by need to target terrorists
From The Washington Compost. Supposedly though the NSA can track them even when turned off.