Forum Moderators: open

Message Too Old, No Replies

Java1.3.1 user agent

grabbing pages via wireless network?

         

idiotgirl

1:18 pm on Jul 18, 2002 (gmt 0)

10+ Year Member Top Contributors Of The Month



Lately I've had multiple page calls with no referer with the UA of Java1.3.1 and they appear to be coming from wireless networks.

Yesterday there were several - with rapid-fire requests (2-3 per second) from:

208.135.47.3

Is this to cache pages for wireless access or ?? Anyone know??

korkus2000

1:22 pm on Jul 18, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I get full crawls from these guys once a day. They do not respect robots.txt. I have no idea what it is for or from.

idiotgirl

1:36 pm on Jul 18, 2002 (gmt 0)

10+ Year Member Top Contributors Of The Month



I just sent the tech contact an email asking what the heck they're up to. If I hear a response, I'll post. I'm curious if it's just some self-serving portal search directory, or if it's specific to something else.