Welcome to WebmasterWorld Guest from 54.198.185.204

Forum Moderators: open

Message Too Old, No Replies

Ink and Position Tech

is there another spider besides slurp?

     
12:30 pm on Jan 21, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member steveb is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:June 20, 2002
posts:4652
votes: 0


Position tech claims my site was refreshed on the 19th, but I show slurp's last visit was the 16th. Is there another/different bot used for the position tech inktomi PFI?
3:44 pm on Jan 21, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Sept 23, 2001
posts:78
votes: 0


Hey Steve,

Did you check your server logs for crawlers on the 16th to see who all visited?
That may help you narrow the field of possibilities. I was also under the impression that PositionTech had their own crawler.
Also, for what its worth...I've used their service and found it to be quite useful.

4:15 pm on Jan 21, 2003 (gmt 0)

Preferred Member

10+ Year Member

joined:Oct 18, 2001
posts:397
votes: 0


Also, for what its worth...I've used their service and found it to be quite useful.

No problems? I'm taking that statement as a recommendation for PositionTech? I'm just about to dump a little money their way for a client. Just wanted to make sure it's as good as it sounds.

Thanks.

- Chad

7:00 pm on Jan 21, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:June 29, 2000
posts:1133
votes: 0


Steveb, Slurp is the only spider I see on my Inktomi pay-for-inclusion updates. Slurp/si seems to just check the robots.txt file, then Slurp/cat later grabs the page(s).
8:22 pm on Jan 25, 2003 (gmt 0)

Administrator from US 

WebmasterWorld Administrator brett_tabke is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Sept 21, 1999
posts:38057
votes: 12


>I'm taking that statement as a recommendation for PositionTech?

Is there another company who's been able to get deals with many major search engines (competitors), and turn around and walk the line with seo's, and the general public? They are always on the hotseat.

10:34 pm on Jan 27, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Jan 1, 2003
posts:62
votes: 0


How long does it take to get deep crawled by Inktomi?

Our site has a couple of pages on PFI since November,
but the slurp robot comes and graps only the PFI pages,
it has never visited any other page.

Does it take a few months to get deep crawled?

TM