homepage Welcome to WebmasterWorld Guest from 23.23.12.202
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Advertising / Paid Inclusion Engines and Topics
Forum Library, Charter, Moderator: open

Paid Inclusion Engines and Topics Forum

  posting off  
"Inktomi Mercator"
We are conducting a performance crawl...
ulstrup

10+ Year Member



 
Msg#: 1148 posted 9:15 pm on Mar 20, 2001 (gmt 0)

Hi

I'm pretty confused and speculating on a connection.

About 10 days ago I did submit 6 pages from a customers site to Ink, via Position Tech. The pages were spidered by Slurp (only the submitted pages) and got indexed in MSN, AOL, etc.

In my stats I now have this site www.internap.com/measurements/readme.html as a heavy referer.
The page has no links to my site, and has a message:
"Dear Web Site Administrator:
We are conducting a performance crawl. The aim of this crawl is to improve access and performance from our customers to your web site, as well as to the rest of the internet...."
Internap is an Inktomi partner: [internap.com...]

Is this a "Inktomi Mercator" or can anybody figure out any relationship or impact of this constellation...

One guess is Inktomi anti cloak as the text goes on: "The impact on server load and traffic should be minimal as we only download a small portion of your main home page." and it actually only hits the main (index) page...

Well this is only guesswork and brobably some of you has a simple explanation...

 

littleman

WebmasterWorld Senior Member littleman us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 1148 posted 9:21 pm on Mar 20, 2001 (gmt 0)

odd..
Ulstrup, do you have a UA & IP?

msgraph

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 1148 posted 9:32 pm on Mar 20, 2001 (gmt 0)

I don't have any IP's on hand but these guys were hitting A LOT of my sites back in Nov. 2000. They were visiting the same sites every day and it was getting pretty annoying. I do remember they were using a lot of different IP addresses for this task tho.

User agent then was

Mozilla/4.72 [en] (X11; U; Linux 2.2.12-20 i686)

I asked for them to stop hitting my sites immediately and they did. They responded pretty fast with this answer:

""InterNAP is developing a program in order to measure latency across the
internet to various sites around the world. There is no malicious intent
and we apologize for any inconvenience caused by this program.""

msgraph

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 1148 posted 9:36 pm on Mar 20, 2001 (gmt 0)

I can see some good benefits if they license this program to various SE's out there. Would give them a chance to weed out sites that continually have poor bandwidth from their database. (would probably knock out half the sites in all the search engines :) )

ulstrup

10+ Year Member



 
Msg#: 1148 posted 9:40 am on Mar 21, 2001 (gmt 0)

Hi

As msgraph experienced, lots of IP's below are some of them (all within just 30 min!)

12.27.166.81 - GET /index.htm - Mozilla/4.75+[en]+(X11;+U;+Linux+2.2.16+i686) [internap.com...]
4.20.90.81 - GET /index.htm - Mozilla/4.75+[en]+(X11;+U;+Linux+2.2.16+i686) [internap.com...]
206.191.170.233 - GET /index.htm - Mozilla/4.75+[en]+(X11;+U;+Linux+2.2.16+i686) [internap.com...]
198.107.213.81 - GET /index.htm - Mozilla/4.75+[en]+(X11;+U;+Linux+2.2.16+i686) [internap.com...]
206.64.105.81 - GET /index.htm - Mozilla/4.75+[en]+(X11;+U;+Linux+2.2.16+i686) [internap.com...]
12.27.166.81 - GET /index.htm - Mozilla/4.75+[en]+(X11;+U;+Linux+2.2.16+i686) [internap.com...]
206.64.105.81 - GET /index.htm - Mozilla/4.75+[en]+(X11;+U;+Linux+2.2.16+i686) [internap.com...]
208.51.235.81 - GET /index.htm - 200 13214 368 160 80 Mozilla/4.75+[en]+(X11;+U;+Linux+2.2.16+i686) [internap.com...]
12.27.166.81 - GET /index.htm - 200 13214 368 170 80 Mozilla/4.75+[en]+(X11;+U;+Linux+2.2.16+i686) [internap.com...]

206.191.170.233 resolves to: performance.sea.pnap.net

The rest (all xxx.xxx.xxx.81) can't be resolved...

Interesting thought if it's a "slow server" checker, could be the next step in optimising searchresults...

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Advertising / Paid Inclusion Engines and Topics
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved