If the mass is not a limited volume. A limited volume, if spherical, will act like a point source. Earth, for example would be such a volume, although it is lumpy, masswise, and the gravity vectors point in various directions slightly away from the center of mass.