Welcome to WebmasterWorld Guest from 54.226.25.231

Forum Moderators: open

Message Too Old, No Replies

"Inktomi Mercator"

We are conducting a performance crawl...

     

ulstrup

9:15 pm on Mar 20, 2001 (gmt 0)

10+ Year Member



Hi

I'm pretty confused and speculating on a connection.

About 10 days ago I did submit 6 pages from a customers site to Ink, via Position Tech. The pages were spidered by Slurp (only the submitted pages) and got indexed in MSN, AOL, etc.

In my stats I now have this site www.internap.com/measurements/readme.html as a heavy referer.
The page has no links to my site, and has a message:
"Dear Web Site Administrator:
We are conducting a performance crawl. The aim of this crawl is to improve access and performance from our customers to your web site, as well as to the rest of the internet...."
Internap is an Inktomi partner: [internap.com...]

Is this a "Inktomi Mercator" or can anybody figure out any relationship or impact of this constellation...

One guess is Inktomi anti cloak as the text goes on: "The impact on server load and traffic should be minimal as we only download a small portion of your main home page." and it actually only hits the main (index) page...

Well this is only guesswork and brobably some of you has a simple explanation...

littleman

9:21 pm on Mar 20, 2001 (gmt 0)

WebmasterWorld Senior Member littleman is a WebmasterWorld Top Contributor of All Time 10+ Year Member



odd..
Ulstrup, do you have a UA & IP?

msgraph

9:32 pm on Mar 20, 2001 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I don't have any IP's on hand but these guys were hitting A LOT of my sites back in Nov. 2000. They were visiting the same sites every day and it was getting pretty annoying. I do remember they were using a lot of different IP addresses for this task tho.

User agent then was

Mozilla/4.72 [en] (X11; U; Linux 2.2.12-20 i686)

I asked for them to stop hitting my sites immediately and they did. They responded pretty fast with this answer:

""InterNAP is developing a program in order to measure latency across the
internet to various sites around the world. There is no malicious intent
and we apologize for any inconvenience caused by this program.""

msgraph

9:36 pm on Mar 20, 2001 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I can see some good benefits if they license this program to various SE's out there. Would give them a chance to weed out sites that continually have poor bandwidth from their database. (would probably knock out half the sites in all the search engines :) )

ulstrup

9:40 am on Mar 21, 2001 (gmt 0)

10+ Year Member



Hi

As msgraph experienced, lots of IP's below are some of them (all within just 30 min!)

12.27.166.81 - GET /index.htm - Mozilla/4.75+[en]+(X11;+U;+Linux+2.2.16+i686) [internap.com...]
4.20.90.81 - GET /index.htm - Mozilla/4.75+[en]+(X11;+U;+Linux+2.2.16+i686) [internap.com...]
206.191.170.233 - GET /index.htm - Mozilla/4.75+[en]+(X11;+U;+Linux+2.2.16+i686) [internap.com...]
198.107.213.81 - GET /index.htm - Mozilla/4.75+[en]+(X11;+U;+Linux+2.2.16+i686) [internap.com...]
206.64.105.81 - GET /index.htm - Mozilla/4.75+[en]+(X11;+U;+Linux+2.2.16+i686) [internap.com...]
12.27.166.81 - GET /index.htm - Mozilla/4.75+[en]+(X11;+U;+Linux+2.2.16+i686) [internap.com...]
206.64.105.81 - GET /index.htm - Mozilla/4.75+[en]+(X11;+U;+Linux+2.2.16+i686) [internap.com...]
208.51.235.81 - GET /index.htm - 200 13214 368 160 80 Mozilla/4.75+[en]+(X11;+U;+Linux+2.2.16+i686) [internap.com...]
12.27.166.81 - GET /index.htm - 200 13214 368 170 80 Mozilla/4.75+[en]+(X11;+U;+Linux+2.2.16+i686) [internap.com...]

206.191.170.233 resolves to: performance.sea.pnap.net

The rest (all xxx.xxx.xxx.81) can't be resolved...

Interesting thought if it's a "slow server" checker, could be the next step in optimising searchresults...

 

Featured Threads

Hot Threads This Week

Hot Threads This Month