I've been hited for Python-urllib twice yesterday. does it has something to do with google?
?
wkitty42
1:26 am on Sep 25, 2003 (gmt 0)
what is/was the entire user agent string and the ip number it came in from?
it is likely not google but cannot tell without additional info...
jdMorgan
1:57 am on Sep 25, 2003 (gmt 0)
Google uses Python-urllib for the Google Viewer [labs.google.com] feature in Google Labs [labs.google.com], and possibly for other features.
For Google, I have a special exception to my rule that normally blocks Python-urllib and Java/n.nn. Similarly, I permit libwww-perl from AltaVista, Inktomi, and IA Archiver only.
Jim
silverbytes
5:44 pm on Sep 25, 2003 (gmt 0)
I didn't know such a thing existed! Well if no one says other different thing, I'll take that spider as Google friend and leave it crawl...
claus
5:57 pm on Sep 25, 2003 (gmt 0)
the Java/x.x.x is also used by Google? ..i didn't bother to check IP's just banned it altogether a few days ago after someone made an unreasonable amount of requests with it in a short time frame... guess i have to re-check those logs, thanks for the tip :)
silverbytes
10:24 pm on Sep 25, 2003 (gmt 0)
why do you think java.x ... is a google thing too? I banned that one...
claus
1:48 pm on Sep 26, 2003 (gmt 0)
- just checked, the "Java/x.x.x" that i've seen did not have Google IP's. Then again, i will keep an eye on it.