I'm going to take a wild guess and say they must be recruiting them while they are in prison or as they get out.
Large muslim religion populations in prison and that's where Padilla was converted. Probably free tickets to Pakistan for the ones the recruiters think they can control indefinately.