Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- Now seeing Bingbot


jdMorgan - 3:15 am on Oct 9, 2010 (gmt 0)


That's what I see so far as well. The robots.txt fetcher is probably a different program, and its user-agent string probably hasn't been updated yet.

Jim


Thread source:: http://www.webmasterworld.com/search_engine_spiders/4208507.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com