Every so often, I see WWWC has requested a few pages. Is this a crawl they initiate or would it be more likely that someone is using their tools to check my code?
PsychoTekk
10:25 am on Mar 24, 2002 (gmt 0)
this useragent W3C_Validator/1.183 libwww-perl/5.50 or this one Jigsaw/2.2.0 W3C_CSS_Validator_JFouffa/2.0 are the w3c's tools that can be used by anyone. i don't think the w3c crawls websites on its own?
keyplyr
10:41 am on Mar 24, 2002 (gmt 0)
It showed as: WWWC/1.01 and instead of "GET" it used "HEAD" to request the page.
Anyway, it caught my interest because I had never seen it in my logs before a week ago. Now it's every couple days. The IP is Japan. (some info replaced by XX)
(edited by: keyplyr at 10:52 am (utc) on Mar. 24, 2002)
PsychoTekk
10:52 am on Mar 24, 2002 (gmt 0)
hm that's weird. in case it was a crawl by w3c to test something then 1st: why do they use an old version and 2nd: w3c tools just make sense in combination with the body of a document so why should they just request the header? do you have an ip? i'll see which ip's i can find in my logfile.. <added> my it always takes me so long ;) k here's the ip from my log: 18.29.1.x (always the same) for the html validator --> MIT / U.S.A. and 138.96.249.x for the CSS validator --> somewhere in france it seems the services are spread all over the countries so there might be different ip's for different versions maybe? </added>
keyplyr
11:17 am on Mar 24, 2002 (gmt 0)
Maybe the reason the W3C Val only got the HEAD is because I currently am not using a DTD. Makes me wonder though, who is so interested in checking my code that they would take the time to use the W3C Val? Maybe I'll just leave the DTD off - LOL