A justice can choose to care what Jefferson, Story or Washington said. But they are not required to. They are an independent branch, and have operated from the beginning precisely the way Brutus predicted they would. It's a design flaw in the Constitution that was obvious to him.
Which is of what consequence to this discussion?
The carry no more or less legal weight than the quotes you posted that they counterpoint.
All you have done is imply that one set of statements is to be disregarded while another is to be respected.
"[E]very act of a delegated authority, contrary to the tenor of the commission under which it is exercised, is void. No legislative act, therefore, contrary to the Constitution, can be valid. To deny this, would be to affirm, that the deputy is greater than his principal; that the servant is above his master; that the representatives of the people are superior to the people themselves; that men acting by virtue of powers, may do not only what their powers do not authorize, but what they forbid."
— Alexander Hamiltion
"It is every Americans' right and obligation to read and interpret the Constitution for himself."
— Thomas Jefferson