Welcome to WebmasterWorld Guest from 22.214.171.124
Forum Moderators: bakedjake
You may recall my domain was one of the first ones crawled w-a-a-a-y back when MSN's bots were but fledglings.
However, msnbot/0.11 makes only two requests. One for robots and one for the most obsure page of my entire domain.
It's been doing this every day since it started a week ago.
126.96.36.199 - - [26/Nov/2003:13:38:08 -0800] "GET /robots.txt HTTP/1.0" 200 1524 "-" "msnbot/0.11 (+http://search.msn.com/msnbot.htm)"
188.8.131.52 - - [26/Nov/2003:13:38:09 -0800] "GET /FileWhereI"Cite"Something.html HTTP/1.0" 200 1432 "-" "msnbot/0.11 (+http://search.msn.com/msnbot.htm)"
In my readings thru WebmasterWorld, I don't recall seeing anything specifically related to msnbot/0.11 and I'd like to get back to being crawled....regularly.
Anyone seeing similar?
I guess there is the off-chance that was all the bot was/is looking for.....