Welcome to WebmasterWorld Guest from 54.167.157.247

Forum Moderators: open

Message Too Old, No Replies

Ink and Position Tech

is there another spider besides slurp?

   
12:30 pm on Jan 21, 2003 (gmt 0)

WebmasterWorld Senior Member steveb is a WebmasterWorld Top Contributor of All Time 10+ Year Member



Position tech claims my site was refreshed on the 19th, but I show slurp's last visit was the 16th. Is there another/different bot used for the position tech inktomi PFI?
3:44 pm on Jan 21, 2003 (gmt 0)

10+ Year Member



Hey Steve,

Did you check your server logs for crawlers on the 16th to see who all visited?
That may help you narrow the field of possibilities. I was also under the impression that PositionTech had their own crawler.
Also, for what its worth...I've used their service and found it to be quite useful.

4:15 pm on Jan 21, 2003 (gmt 0)

10+ Year Member



Also, for what its worth...I've used their service and found it to be quite useful.

No problems? I'm taking that statement as a recommendation for PositionTech? I'm just about to dump a little money their way for a client. Just wanted to make sure it's as good as it sounds.

Thanks.

- Chad

7:00 pm on Jan 21, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Steveb, Slurp is the only spider I see on my Inktomi pay-for-inclusion updates. Slurp/si seems to just check the robots.txt file, then Slurp/cat later grabs the page(s).
8:22 pm on Jan 25, 2003 (gmt 0)

WebmasterWorld Administrator brett_tabke is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



>I'm taking that statement as a recommendation for PositionTech?

Is there another company who's been able to get deals with many major search engines (competitors), and turn around and walk the line with seo's, and the general public? They are always on the hotseat.

10:34 pm on Jan 27, 2003 (gmt 0)

10+ Year Member



How long does it take to get deep crawled by Inktomi?

Our site has a couple of pages on PFI since November,
but the slurp robot comes and graps only the PFI pages,
it has never visited any other page.

Does it take a few months to get deep crawled?

TM

 

Featured Threads

Hot Threads This Week

Hot Threads This Month