SEGuru2
msg:19815 | 3:44 pm on Jan 21, 2003 (gmt 0) |
Hey Steve, Did you check your server logs for crawlers on the 16th to see who all visited?
That may help you narrow the field of possibilities. I was also under the impression that PositionTech had their own crawler.
Also, for what its worth...I've used their service and found it to be quite useful.
|
SlyGuy
msg:19816 | 4:15 pm on Jan 21, 2003 (gmt 0) |
| Also, for what its worth...I've used their service and found it to be quite useful. |
|
No problems? I'm taking that statement as a recommendation for PositionTech? I'm just about to dump a little money their way for a client. Just wanted to make sure it's as good as it sounds. Thanks. - Chad
|
mayor
msg:19817 | 7:00 pm on Jan 21, 2003 (gmt 0) |
Steveb, Slurp is the only spider I see on my Inktomi pay-for-inclusion updates. Slurp/si seems to just check the robots.txt file, then Slurp/cat later grabs the page(s).
|
Brett_Tabke
msg:19818 | 8:22 pm on Jan 25, 2003 (gmt 0) |
>I'm taking that statement as a recommendation for PositionTech? Is there another company who's been able to get deals with many major search engines (competitors), and turn around and walk the line with seo's, and the general public? They are always on the hotseat.
|
tennismaster
msg:19819 | 10:34 pm on Jan 27, 2003 (gmt 0) |
How long does it take to get deep crawled by Inktomi? Our site has a couple of pages on PFI since November,
but the slurp robot comes and graps only the PFI pages,
it has never visited any other page. Does it take a few months to get deep crawled? TM
|
|
