Forum Moderators: open

Message Too Old, No Replies

Paid Spidering

What are the risks?

         

Hope

3:39 pm on Jan 22, 2001 (gmt 0)

10+ Year Member



Hello everyone,

We are looking into the paid spidering. I am concerned that paying for spidering will effect the current spiders that love our site.

Activity for the Month of December

Slurp - 33416
Slurp.so - 3506
slurp.so/1.0 - 1639
slurp/cat - 279
slurp.si - 14

Our webpages have been regularly updated in the Ink index. New pages are slowly being added as well. I am wondering if anyone who is currently using the paid spidering has seen a drop in the amount of spidering by Ink.

ihelpyou

12:23 am on Jan 23, 2001 (gmt 0)

10+ Year Member



As of right now, per Jim at PT, if your site is already in the Ink database, you might want to hold off on the paid submit.

Brett_Tabke

12:33 am on Jan 23, 2001 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



Slurp will continue slurping away Hope. Try it out on a few out of the way pages to get your feet wet. I've been trying it out now for awhile, still trying to figure out what I spent the money on. I don't get it.

stcrim

1:06 am on Jan 23, 2001 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Also Hope,

Don't pay for any pages that are already in the DB - as Brett said, pay only for out of the way pages - for us that means only new pages or pages that have never been in INK

David

2:01 am on Jan 23, 2001 (gmt 0)

10+ Year Member



Interesting, I paid for a hand full of key pages shortly after I launched my site (got them in quick and it is working just like Position tech says). I was already in Looksmart so my default page is the only page in the main Inktomi data base. Now I have never had slurp take any pages other then the paid for ones. Almost daily slurp takes my default page and moves no further (not including the paid for 48 hour spider cycle). Is it unusualy to not get a deep crawl after 4 months ?

>>Our webpages have been regularly updated in the Ink index. New pages are slowly being added >>
Does any one know if new pages are being added in sites that have paid for some pages?

David

Hope

12:18 pm on Jan 23, 2001 (gmt 0)

10+ Year Member



>>Slurp will continue slurping away Hope. Try it out on a few out of the way pages to get your feet wet.>>

We are a Non-Profit, which translates out to NO BUDGET. I need to go to the board of directors with proof that we need a budget before getting any money to "get my feet wet." I would love to play with it just to see, but at this time it isn't allowed.

>>>>Our webpages have been regularly updated in the Ink index. New pages are slowly being added >>>>
>>Does any one know if new pages are being added in sites that have paid for some pages?>>

This is what I really want to know. Since we are not losing any pages and some are being added, is it a waste of time to pay?

ihelpyou

12:45 pm on Jan 23, 2001 (gmt 0)

10+ Year Member



Since you are in the database, and since you do have pages being added, I would definitely just sit tight for now.