Forum Moderators: open

Message Too Old, No Replies

Ink crawlwers - they've come

Why ?

         

caine

3:43 pm on Aug 27, 2001 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



A site has been getting crawled reguarly, by a few ink spiders with a couple of letters then numbers.inktomi.com, then later in the logs *****.server.inktomi.com which i've thought were the deep crawling agents. No probs there !

However, i been away four days, come back, the logs indicate that ****.inktomi.com spiders (shallow crawlers or url verifiers) come in a big wave 46 of this particular breed of spider, which is unusual because i normally only get 10-15 per month of this breed. However there is only a minor increase in the .server.inktomi.com robots visiting.

Does this indicate anything, can it be a pre-requisite to a full listing of the site's pages within inks partner feeding - hooray !, or something more sinister, and possibly bad for the site ?

stcrim

2:00 am on Aug 28, 2001 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



caine,

Did you pay $$$ for your site to be listed??? If you didn't that's just INK teasing you - showing you a little spider-leg and hoping you'll pay up...

Steve

caine

8:58 am on Aug 28, 2001 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Paid for two LS.com partner listings, nothing directly to Ink.

If thats a tease, they are buggers.

Caine