Forum Moderators: open

Message Too Old, No Replies

Name of PT-Spider

         

oLeon

1:02 pm on Dec 4, 2000 (gmt 0)

10+ Year Member



I really donīt know:
what are the UA / IP of the position-tech spider (concerning the payperview-game for ink)?

msgraph

3:01 pm on Dec 4, 2000 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Is this the one you want?

IP: 209.185.141.249

UA:

Slurp/cat (slurp@inktomi.com; [inktomi.com...]

The UA listed above will come daily and gather all pages that were submitted to Position Tech.

oLeon

9:21 pm on Dec 4, 2000 (gmt 0)

10+ Year Member



yes, it is -
I wasnīt sure if the pt-spider has got the same name as the ink has. Itīs important for the cloaking, isnīt it? ;-)

Hope

2:29 pm on Dec 5, 2000 (gmt 0)

10+ Year Member



Very interesting!!! We are not part of the new pay program. I have seen this spider. It took 20 pages.

Can anyone tell me what "Slurp/si" might be? This one took over 80 pages.

msgraph

2:43 pm on Dec 5, 2000 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I sent Inktomi a mail asking about this spider, Slurp/si a few weeks back. They said that it visits the site often to check for any updates in the pages/site. This was in regards to sites submitted through Inktomi's parnters. (HotBot, Canada.com, etc.) The more often you update the page, the more often the robot visits.

Hope

2:48 pm on Dec 5, 2000 (gmt 0)

10+ Year Member



hmmm Ok, this spider just showed up last month. I am glad to know what he does. Can you tell me who Slurp.so is?

msgraph

3:06 pm on Dec 5, 2000 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Slurp.so will check your site less often than Slurp/si. Slurp.so is a deep crawler.

So to sum it up...

Slurp/si

Is the robot that will check your robots.txt file and root index page for any site updates. Like any new links to sub-pages, keywords, text, you name it they check for it.

Slurp.so

Is the spider that will visit your site on a weekly or monthly basis to grab all linked pages within the site. If there is a link to them somewhere then it will follow.

Hope

3:46 pm on Dec 5, 2000 (gmt 0)

10+ Year Member



Thank you. I have a better idea of who is who now. These damn spiders are enough to drive a woman mad.