F^#$ing starve, then.
As a Roman Catholic who chooses to go meatless on Fridays, I've frequently eaten "just the hotdog bun" or the veggies (eating around the meat items). But I've never rudely refused a meal offered in good faith. There are ways to be polite (and quiet) and still adhere to your customs