So the same dilemma rears its head: should you leave the toaster plugged in so it's tethered to the wall or do you unplug it so it won't have any juice?
You should leave it unplugged at all times, except when in use.
That way, you keep its energy drained down real low.
Minimize its mischief radius! That's the key!