If they have enough plutonium to scatter a significant amount of radiation they will not put it in a dirty bomb. It would be used to make the real thing instead.
A dirty bomb is much more likely to be a conventional bomb cased with readily available radioactive materials (like medical supplies, etc...). As such, the actual radiation problem is likely to be minor. The panic factor could be high, however.