Forum Moderators: open

Message Too Old, No Replies

Slurp showing as Browser!

may be a cloaking detection !

         

Abdelrhman Fahmy

2:04 pm on Jun 19, 2004 (gmt 0)

10+ Year Member



I just ran my webstats for last 2 days and found some hits from Ips resolving to yahoo.com , but the user agent showing as MSIE 6!, it's request the HTML only not the whole page and trying to request every page two times a day ,

The user agent shown as Mozilla/4.0+(compatible;+MSIE+6.0;+Windows+NT+5.1)
And the requests coming from a different ip class than the usual slurp ip range, but still starting with the 66
Requesting IPs are 66.94.233.XX and resolving to XXXX.search.scd.yahoo.com
Looks like a cloaking detection!
Has anybody else seeing this?

Brett_Tabke

2:46 pm on Jun 21, 2004 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



Anyone else seen this?

digitalv

3:18 pm on Jun 21, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Haven't seen this myself yet, but my guess would be that someone from Yahoo has been reading this board and is now checking to make sure people aren't cloaking :)

Sanenet

3:32 pm on Jun 21, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Just had a quick look though the last 7 days of logs from two different sites - couldn't find it, although lots of "normal" slurp visits.

jo1ene

4:21 pm on Jun 21, 2004 (gmt 0)

10+ Year Member



66.196.90.*** Mozilla/5.0 (compatible;Yahoo!Slurp;...)

Like this? I had 7 of these this morning.

dhatz

4:55 pm on Jun 21, 2004 (gmt 0)

10+ Year Member



No, I checked 3-4 domains and didn't find anything "suspicious" from these address blocks (didn't check all Y IPs though)

A complaint I have with Yahoo is with their http 404 error testing or whatever that is. Plus the handling of 301/302 redirects.

Wrt 404: I have a site where I chose to name the files using numbers, or a letter and numbers, e.g. b1562.html. On that particular site, 15% of all Slurp requests are 404s

fiestagirl

5:00 pm on Jun 21, 2004 (gmt 0)

10+ Year Member



Yes, starting at the beginning of June. IP's in the 209.131.59.XXX range though.

Abdelrhman Fahmy

6:11 pm on Jun 21, 2004 (gmt 0)

10+ Year Member



now i have searched for the Ip 66.94.233.XX [google.com] and found some of website statistics and proxy logs showing repeated visits from the same ip block,

why i'm thinking that it's a clocking? becuase the bot trying to check every page twice within a very short time (1 hour or less)

also it's seems to me that it's just for the new pages!(the pages that slurp find it for the first time)