Cowell has serious, serious FU money. And has the ability to do his own thing without need of Hollywood backing.
IIRC dude has an island. Probably protected with former IDF soldiers.