More change was made evident by kottke.org's comparison of the site's robots.txt files from yesterday (rather lengthy) and today (two lines). Sites use the robots.txt file to shoo search engines away from things the site's keeper does not wish to be seen.
And with access to router line access codes we won’t even be able to navigate around the txt bots.