Depends if it's an intelligent point the troll makes or not. This is so rare that it's almost not worth bothering with.
Sometimes you just get a pic of "tubgirl" -you don't want that to stay up, believe me.
I agree leave them up for a while.