Forum Moderators: open

Message Too Old, No Replies

Python-urllib

from google?

         

silverbytes

1:19 am on Sep 25, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I've been hited for Python-urllib twice yesterday.
does it has something to do with google?

?

wkitty42

1:26 am on Sep 25, 2003 (gmt 0)

10+ Year Member



what is/was the entire user agent string and the ip number it came in from?

it is likely not google but cannot tell without additional info...

jdMorgan

1:57 am on Sep 25, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Google uses Python-urllib for the Google Viewer [labs.google.com] feature in Google Labs [labs.google.com], and possibly for other features.

For Google, I have a special exception to my rule that normally blocks Python-urllib and Java/n.nn. Similarly, I permit libwww-perl from AltaVista, Inktomi, and IA Archiver only.

Jim

silverbytes

5:44 pm on Sep 25, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I didn't know such a thing existed!
Well if no one says other different thing, I'll take that spider as Google friend and leave it crawl...

claus

5:57 pm on Sep 25, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



the Java/x.x.x is also used by Google? ..i didn't bother to check IP's just banned it altogether a few days ago after someone made an unreasonable amount of requests with it in a short time frame... guess i have to re-check those logs, thanks for the tip :)

silverbytes

10:24 pm on Sep 25, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



why do you think java.x ... is a google thing too?
I banned that one...

claus

1:48 pm on Sep 26, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



- just checked, the "Java/x.x.x" that i've seen did not have Google IP's. Then again, i will keep an eye on it.