Besides a possible credit card scam, they have your phone number and can lookup your address and send their pals to rob your house.
This is a bad idea.
Don’t worry. All their conversations will be recorded, monitored and suspicious activity red-flagged.