Forum Moderators: open
66.249.16.*** - - [10/Aug/2008:20:43:30 -0400] "GET / HTTP/1.1" 403 666 "http://whois.domain-tools/example.com" "Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)"
"example.com" is the domain of my site. I inserted a hyphen in the referring domain and de-linked it, since we don't want to link there.
Aren't "Yahoo!" and "Slurp" registered trademarks? Time to activate the Y! legal department, IMHO...
Jim
[edited by: incrediBILL at 6:46 pm (utc) on Aug. 11, 2008]
[edit reason] fixed scrolling [/edit]
isn't the 66.249.16.*** just a proxy? I don't have the logs a front of me at this point but I have seen it being used as one, methinks.
Jim
I'd guess it's really google crawling through a proxy for nameintel's screen shot tool or something similar.
+ from IncrediBILL:
I caught it claiming to be a proxy that was forwarding information for my IP address when I was looking at the site so using it is far from anonymous!
The easiest way to figure out some of this stuff is instead of just dumping 403's is to kick out a page with their IP and user agent in very large letters (so you can read it in screen shots) and include a unique tracking code you can search for in G/Y/L just to see where that information ends up.
That's how I find this stuff ;)
I just throw a random number, followed by 403, and then email myself with all the jucy info like X-Forwarded-For and other headers to my self. The X-Forwarded-For IP gets 403 for the next week or so, or even more so....
