Forum Moderators: open

Message Too Old, No Replies

Getting deepcrawled!?

Deepcrawl on my sites

         

SEOPutte

2:32 pm on Mar 4, 2003 (gmt 0)

10+ Year Member



Just checked my logs and seeing 216.239.35.xx
216.239.37.xx and 216.239.39.xx on 2:nd 3.rd and today.
Did a dns check on these ip:s and google owns them.
Didnīt see those ip number in this thread: [webmasterworld.com...]

These ip:s must be from the deepcrawl i guess?
Very strange in that case..

ericjunior

2:45 pm on Mar 4, 2003 (gmt 0)

10+ Year Member



i saw 216.239.39.xx briefly today. Like you it's not one i recognise but smells like a deepcrawler - got me scarred enough to throw up the new files i'm working on whilst waiting for this update to finally appear

hetzeld

2:57 pm on Mar 4, 2003 (gmt 0)

10+ Year Member



These 216.239.... IP addresses most probalbly belong to the Google Proxy servers pool.
They are used whenever someone tries to reach your site after a seach on a handheld device (phone/pocketPC) using the WAP protocol.

They are totally unrelated to the DeepCrawlers.

Dan

SEOPutte

3:01 pm on Mar 4, 2003 (gmt 0)

10+ Year Member



Hundred of pages has been hit by this ip, doesenīt really sound like an ordinary wap-surfer..?

ericjunior

3:08 pm on Mar 4, 2003 (gmt 0)

10+ Year Member



yup & it was 1 page 1 "hit" which looks and barks like a bot to me

WebWalla

3:14 pm on Mar 4, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



If it was a bot it would have a user-agent string of Googlebot. If it doesn't have this UA identifier, it was possible somebody using the new Google Viewer, or even browsing your page with one of the translation tools.

hetzeld

3:21 pm on Mar 4, 2003 (gmt 0)

10+ Year Member



If it was a bot it would have a user-agent string of Googlebot. If it doesn't have this UA identifier, it was possible somebody using the new Google Viewer, or even browsing your page with one of the translation tools.

I forgot the new Google Viewer and tried on my site:
IP is 219.239.33.5 , Agent is Python-urllib/2.0a1 and server resolves to proxy.google.com

Could be one of those as they most probably have an IP range...

Dan

SEOPutte

3:24 pm on Mar 4, 2003 (gmt 0)

10+ Year Member



Ok, thank you for sorting this out for me guys :-)