I can understand his indignation. Even 'towelhead' is preferable to 'sweetie/darling'.
He was upset because only his squealing lover is allowed to call him sweetie...