From the Article: They included photographs, and information on their families, backgrounds and contacts. Most were 'Afghan Arabs', Saudis, Yemenis and Egyptians who had fought with bin Laden against the Soviets in Afghanistan.
The rational reason for not wanting the Sudanese dossiers is that the CIA and MI6 already had the information.
That would be a rational reason for not investing great resources in trying to obtain it, but not for rejecting it when offered. You accept it, review it, see whether it adds to your knowledge/understanding (but I agree with you that they already knew most of it.)
Refusing to accept it is powerful evidence of evil intent on the part of the decision-makers, whoever they were, and I'm not willing to assume it was only Clinton