They wouldn't be able to do that.
The value of a list of passwords is to feed into a "brute-force" program that tries a bazillion passwords one at a time until it finds one that works.
A list like this narrows down the number of possible combinations a LOT and saves the crackers a lot of time, compared to trying every possible combination of characters and lengths.
So if they had my email or username, they could feed in batches of passwords to find one that might match?