Yes, you are holding them against their will if, in fact, you let them into the house!
What? At most fraternity parties the door is unlocked so anyone can enter or leave. There is no indication they were being held against their will- no one, the father or police claimed this. Letting them enter the frat house and then refusing to give them a ride is not kidnapping. That is ridiculous.