Welcome to WebmasterWorld Guest from 54.159.143.84

Forum Moderators: open

Message Too Old, No Replies

Spidering Schedule: Paid vs. free

Effect of paid inclusion on free spidering

   
4:24 pm on Jul 5, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I am already listed pretty well in FAST and Lycos, but I have some pages that have 'current news' type items. It would be helpful to have those spidered every 48 hours.

If I pay for a couple of pages, but not my whole site, will the rest of the site get spidered as it has in the past?

5:40 pm on Jul 5, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I ask this question about a month ago BEFORE I paid for inclusion with no answer. Now I've paid.
Still no answer?
7:16 pm on Jul 5, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Buried again.
I think this is the 'Intimidation Factor' you were talking about.
Forgive me for my persistence.
7:25 pm on Jul 5, 2002 (gmt 0)

10+ Year Member



Maybe nobody has an idea.
If I had, I would've said something useful here.

Trust me, these people ARE helpful, but they also have other things to do.

7:30 pm on Jul 5, 2002 (gmt 0)

WebmasterWorld Administrator jatar_k is a WebmasterWorld Top Contributor of All Time 10+ Year Member



dvduval,

I would love to have the answer too, I just put one site into Fast PFI. I am just starting to look at results. It will take a while to figure it all out so maybe then I can give you an answer.

7:55 pm on Jul 5, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



dvduval,

I think that would be a correct assumption to make, as the pfi is the 48' hour based spidering program that ATW offers, hence if the pages are not submitted to the PFI, and left on the old crawl cycles, then some pages will be updating fast and others will be upadting with the rest of the index.

I think the real question is there a back door to getting the other pages, not submitted to the PFI, on a 48 hour crawl cycle, defintely a question for heini & Rumbas.

8:43 pm on Jul 5, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I would like to follow up by asking:

What happens when you replace one URL with another? Specifically, does the other page get completely dropped like it does in Inktomi?

BTW, I'm already seeing some traffic and improved SERP. I just want to know a little bit about the details of how the system works.

10:02 pm on Jul 5, 2002 (gmt 0)

WebmasterWorld Administrator 10+ Year Member



`
If I pay for a couple of pages, but not my whole site, will the rest of the site get spidered as it has in the past?

Short answer: YES :)

5:59 am on Jul 6, 2002 (gmt 0)

10+ Year Member



dvduval

in response to caine:
<I think that would be a correct assumption to make, as the pfi is the 48' hour based spidering program that ATW offers, hence if the pages are not submitted to the PFI, and left on the old crawl cycles, then some pages will be updating fast and others will be upadting with the rest of the index.>

I have three pages in alltheweb thru PFI. They were indexed w/in 48 hours, although the page rank was not as I expected with my search terms as they ranked with Google, etc.

Also, a page that I never submitted through PFI ranked actually higher than those I had submitted.

Since my initial submission I "swapped" one of my pages for another page and it was immediately listed...the other page has dropped from site.
But...in the last week (I assume there has been an update of the entire index) I am now ranking higher for the search terms and on the first page.

So...in a nutshell...from my own personal experience:

*PFI pages get indexed and placed quickly.

*Some pages will get indexed that are not PFI.

*Swapping pages on PFI will index the new page and in my case possibly loose the old page listing.

*After an entire update...you may see your position change dramatically from the first results after PFI.

Like I said...this is what I am seeing since I opted for PFI...
overall experience...very pleased with my decision to PFI with Lycos...

Linda (still a newbie and still learning and lovin' it)

Tor

10:02 am on Jul 6, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I totally agree with you Linda, we have exactly the same experience as you have had with the PFI- program. Everything has been working perfect so far :)
7:43 am on Jul 7, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Just a small cautionary note:

I have had pages in other engines (specifically AV) which were in for free dropped when I decided to include a couple of frequently updated pages in a PFI.

It was almost as though they looked at the domain and decided to exclude all pages which weren't paid for.

I would love to know if anyone has had this experience with Fast?

5:41 pm on Jul 7, 2002 (gmt 0)

10+ Year Member



markd
I have both paid and free listings in Fast - Alltheweb and none of my free listings have been dropped. The only experience I have with a "page" dropping, is one that I had as a paid listing that I swapped with a new page.

I have 10 total pages:
>7 pages are listed in alltheweb
>3 pages are PFI pages
>4 pages are free listings
>3 pages are not listed

Linda

12:31 pm on Jul 8, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Thanks Linda - I think this makes Fast's PFI a useful option for certain pages.

I have experienced 'free' pages dropped after I have signed up just a few for PFI.

Good on Fast!

1:05 pm on Jul 8, 2002 (gmt 0)

WebmasterWorld Senior Member fathom is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



From a personal and professional opinion (most sites, not all, but most) waste their hard earn revenue for paid inclusion since it doesn't guarantee top billing.

With but a few exceptions Yahoo is really the only Search Engine/Directory (web sites listings) you can't get into for free that's worth the fee but only after the fact....

See post #8

[webmasterworld.com...]

Save money and get better results!

9:17 am on Jul 15, 2002 (gmt 0)

10+ Year Member



Hi, thi s is what i've experienced:

I've 3 pages in the 48 hours crawl. The other pages i've in the free crawl, spidered as in the past.
When you update the 48 crawl url the page replaced will resume the free crawl title & description, but is not definitively dropped.

My big question is: can fast spider some pages following the 48h crawl? And how fast can check my link popularity without following the links on my 48h crawl pages?