Forum Moderators: open
Scooter visited two times yesterday. First with this:
IP: 209.73.164.50 (AltaVista Company)
UA: Scooter/3.3_SF
21 hours later with this:
IP: 216.39.48.184 (AltaVista Company)
UA: Scooter/3.3
Just FYI. Both bots asked for "robots.txt" and did not violate.
/claus
buildrack38.sv.av.com - - [19/Aug/2003:22:06:49 -0400] "GET /robots.txt HTTP/1.0" 200 1357 "-" "Scooter/3.3"
And then a little later:
linux-perf3.sv.av.com - - [20/Aug/2003:14:23:09 -0400] "GET /robots.txt HTTP/1.0" 200 1357 "-" "FAST-WebCrawler/3.8 (atw-crawler at fast dot no; [fast.no...]which resolves to 216.39.51.16 (also AltaVista) and which proceeded to grab about 200 or so pages. Not complaining as said grabs were well spaced through the day.
Usually, I'd just search the forums and try to determine if this is still AllTheWeb or what. But I recently had a major mishap on my old computer and I'm slowly but surely getting back some files, plus I changed computers and the new one has nothign on it, plus I inadvertently upped my SpamAssassin settings and never got tons of e-mail including notifications from WebmasterWorld, plus I neglected to check my logs for like three weeks because of said mishap. It's like I lost my brain.
The FAST crawler you saw is odd. I think it's a FAST spider used by AV. Fast IPs are normally in this range:
66.77.73.0 - 66.77.73.255
There seems to have been something happening at FAST lately. A lot more pages indexed and new bot UA strings. Related:
[webmasterworld.com...]
/claus