homepage Welcome to WebmasterWorld Guest from 54.205.14.21
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Yahoo / Deprecated - Altavista, Alltheweb.com
Forum Library, Charter, Moderator: open

Deprecated - Altavista, Alltheweb.com Forum

    
Spidering Schedule: Paid vs. free
Effect of paid inclusion on free spidering
dvduval




msg:225289
 4:24 pm on Jul 5, 2002 (gmt 0)

I am already listed pretty well in FAST and Lycos, but I have some pages that have 'current news' type items. It would be helpful to have those spidered every 48 hours.

If I pay for a couple of pages, but not my whole site, will the rest of the site get spidered as it has in the past?

 

dvduval




msg:225290
 5:40 pm on Jul 5, 2002 (gmt 0)

I ask this question about a month ago BEFORE I paid for inclusion with no answer. Now I've paid.
Still no answer?

dvduval




msg:225291
 7:16 pm on Jul 5, 2002 (gmt 0)

Buried again.
I think this is the 'Intimidation Factor' you were talking about.
Forgive me for my persistence.

BrunoDillen




msg:225292
 7:25 pm on Jul 5, 2002 (gmt 0)

Maybe nobody has an idea.
If I had, I would've said something useful here.

Trust me, these people ARE helpful, but they also have other things to do.

jatar_k




msg:225293
 7:30 pm on Jul 5, 2002 (gmt 0)

dvduval,

I would love to have the answer too, I just put one site into Fast PFI. I am just starting to look at results. It will take a while to figure it all out so maybe then I can give you an answer.

caine




msg:225294
 7:55 pm on Jul 5, 2002 (gmt 0)

dvduval,

I think that would be a correct assumption to make, as the pfi is the 48' hour based spidering program that ATW offers, hence if the pages are not submitted to the PFI, and left on the old crawl cycles, then some pages will be updating fast and others will be upadting with the rest of the index.

I think the real question is there a back door to getting the other pages, not submitted to the PFI, on a 48 hour crawl cycle, defintely a question for heini & Rumbas.

dvduval




msg:225295
 8:43 pm on Jul 5, 2002 (gmt 0)

I would like to follow up by asking:

What happens when you replace one URL with another? Specifically, does the other page get completely dropped like it does in Inktomi?

BTW, I'm already seeing some traffic and improved SERP. I just want to know a little bit about the details of how the system works.

Rumbas




msg:225296
 10:02 pm on Jul 5, 2002 (gmt 0)

`
If I pay for a couple of pages, but not my whole site, will the rest of the site get spidered as it has in the past?

Short answer: YES :)

lindavh




msg:225297
 5:59 am on Jul 6, 2002 (gmt 0)

dvduval

in response to caine:
<I think that would be a correct assumption to make, as the pfi is the 48' hour based spidering program that ATW offers, hence if the pages are not submitted to the PFI, and left on the old crawl cycles, then some pages will be updating fast and others will be upadting with the rest of the index.>

I have three pages in alltheweb thru PFI. They were indexed w/in 48 hours, although the page rank was not as I expected with my search terms as they ranked with Google, etc.

Also, a page that I never submitted through PFI ranked actually higher than those I had submitted.

Since my initial submission I "swapped" one of my pages for another page and it was immediately listed...the other page has dropped from site.
But...in the last week (I assume there has been an update of the entire index) I am now ranking higher for the search terms and on the first page.

So...in a nutshell...from my own personal experience:

*PFI pages get indexed and placed quickly.

*Some pages will get indexed that are not PFI.

*Swapping pages on PFI will index the new page and in my case possibly loose the old page listing.

*After an entire update...you may see your position change dramatically from the first results after PFI.

Like I said...this is what I am seeing since I opted for PFI...
overall experience...very pleased with my decision to PFI with Lycos...

Linda (still a newbie and still learning and lovin' it)

Tor




msg:225298
 10:02 am on Jul 6, 2002 (gmt 0)

I totally agree with you Linda, we have exactly the same experience as you have had with the PFI- program. Everything has been working perfect so far :)

markd




msg:225299
 7:43 am on Jul 7, 2002 (gmt 0)

Just a small cautionary note:

I have had pages in other engines (specifically AV) which were in for free dropped when I decided to include a couple of frequently updated pages in a PFI.

It was almost as though they looked at the domain and decided to exclude all pages which weren't paid for.

I would love to know if anyone has had this experience with Fast?

lindavh




msg:225300
 5:41 pm on Jul 7, 2002 (gmt 0)

markd
I have both paid and free listings in Fast - Alltheweb and none of my free listings have been dropped. The only experience I have with a "page" dropping, is one that I had as a paid listing that I swapped with a new page.

I have 10 total pages:
>7 pages are listed in alltheweb
>3 pages are PFI pages
>4 pages are free listings
>3 pages are not listed

Linda

markd




msg:225301
 12:31 pm on Jul 8, 2002 (gmt 0)

Thanks Linda - I think this makes Fast's PFI a useful option for certain pages.

I have experienced 'free' pages dropped after I have signed up just a few for PFI.

Good on Fast!

fathom




msg:225302
 1:05 pm on Jul 8, 2002 (gmt 0)

From a personal and professional opinion (most sites, not all, but most) waste their hard earn revenue for paid inclusion since it doesn't guarantee top billing.

With but a few exceptions Yahoo is really the only Search Engine/Directory (web sites listings) you can't get into for free that's worth the fee but only after the fact....

See post #8

[webmasterworld.com...]

Save money and get better results!

nicco




msg:225303
 9:17 am on Jul 15, 2002 (gmt 0)

Hi, thi s is what i've experienced:

I've 3 pages in the 48 hours crawl. The other pages i've in the free crawl, spidered as in the past.
When you update the 48 crawl url the page replaced will resume the free crawl title & description, but is not definitively dropped.

My big question is: can fast spider some pages following the 48h crawl? And how fast can check my link popularity without following the links on my 48h crawl pages?

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Yahoo / Deprecated - Altavista, Alltheweb.com
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved