JeffOstroff - 1:27 am on Dec 23, 2012 (gmt 0)
For years we have had dozens of crawls of our site from Internet Wayback machine over at Archive org.
There normally we find screen shots every few weeks for all our pages of our site back to 1998 so we can see how the site looked in the past.
But there has been no screen shots at all this year, but a few in 2011 and I'm wondering if we are inadvertently blocking their robot for some unknown reason.
Does anyone know what they Internet Archive robot looks like? I want to make sure it's no excluded in our robots.txt file.