Only those taking infidels with them can expect a reward of virgins.
So I guess the others get to be the virgins.