1. It's not silent--especially at close range.
2. It doesn't/didn't make right angle turns at fantastic speeds far faster than any hints of it's real speed.
3. It's not shaped like a list of UFO craft are shaped.
4. It doesn't hover 50-150 feet over suburban houses silently.
5. A lot more is publically known about the SR-71 than about UFO's.