Forum Moderators: open
The user agent shown as Mozilla/4.0+(compatible;+MSIE+6.0;+Windows+NT+5.1)
And the requests coming from a different ip class than the usual slurp ip range, but still starting with the 66
Requesting IPs are 66.94.233.XX and resolving to XXXX.search.scd.yahoo.com
Looks like a cloaking detection!
Has anybody else seeing this?
A complaint I have with Yahoo is with their http 404 error testing or whatever that is. Plus the handling of 301/302 redirects.
Wrt 404: I have a site where I chose to name the files using numbers, or a letter and numbers, e.g. b1562.html. On that particular site, 15% of all Slurp requests are 404s
why i'm thinking that it's a clocking? becuase the bot trying to check every page twice within a very short time (1 hour or less)
also it's seems to me that it's just for the new pages!(the pages that slurp find it for the first time)