The primary reasons for this are (1) it isn't aesthetically pleasing on its own and (2) it isn't an aesthetically pleasing addition to its neighborhood (i.e., it doesn't fit or complement its neighborhood and it could be argued it will cause a decline in neighborhood values).
You are overestimating the sensibility of the planning commission—and maybe New Yorkers in general.