Part of I-87 and I-90 are tolled because they are on the New York Thruway. Various toll roads were grandfathered into the interstate system. Thus, you have tolls on I-90 in Massachusetts (MassTurnpike), parts of I-70 and I-76 in Pennsylvania (PATurnpike) and part of I-80 in Ohio (Ohio Turnpike).
As a point of interest, I believe the Pennsylvania Turnpike -- which was built before World War II -- was the first major limited-access road in the U.S.