homepage Welcome to WebmasterWorld Guest from 54.167.174.90
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Yahoo / Deprecated - Altavista, Alltheweb.com
Forum Library, Charter, Moderator: open

Deprecated - Altavista, Alltheweb.com Forum

    
Spidering Schedule: Paid vs. free
Effect of paid inclusion on free spidering
dvduval

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 537 posted 4:24 pm on Jul 5, 2002 (gmt 0)

I am already listed pretty well in FAST and Lycos, but I have some pages that have 'current news' type items. It would be helpful to have those spidered every 48 hours.

If I pay for a couple of pages, but not my whole site, will the rest of the site get spidered as it has in the past?

 

dvduval

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 537 posted 5:40 pm on Jul 5, 2002 (gmt 0)

I ask this question about a month ago BEFORE I paid for inclusion with no answer. Now I've paid.
Still no answer?

dvduval

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 537 posted 7:16 pm on Jul 5, 2002 (gmt 0)

Buried again.
I think this is the 'Intimidation Factor' you were talking about.
Forgive me for my persistence.

BrunoDillen

10+ Year Member



 
Msg#: 537 posted 7:25 pm on Jul 5, 2002 (gmt 0)

Maybe nobody has an idea.
If I had, I would've said something useful here.

Trust me, these people ARE helpful, but they also have other things to do.

jatar_k

WebmasterWorld Administrator jatar_k us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 537 posted 7:30 pm on Jul 5, 2002 (gmt 0)

dvduval,

I would love to have the answer too, I just put one site into Fast PFI. I am just starting to look at results. It will take a while to figure it all out so maybe then I can give you an answer.

caine

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 537 posted 7:55 pm on Jul 5, 2002 (gmt 0)

dvduval,

I think that would be a correct assumption to make, as the pfi is the 48' hour based spidering program that ATW offers, hence if the pages are not submitted to the PFI, and left on the old crawl cycles, then some pages will be updating fast and others will be upadting with the rest of the index.

I think the real question is there a back door to getting the other pages, not submitted to the PFI, on a 48 hour crawl cycle, defintely a question for heini & Rumbas.

dvduval

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 537 posted 8:43 pm on Jul 5, 2002 (gmt 0)

I would like to follow up by asking:

What happens when you replace one URL with another? Specifically, does the other page get completely dropped like it does in Inktomi?

BTW, I'm already seeing some traffic and improved SERP. I just want to know a little bit about the details of how the system works.

Rumbas

WebmasterWorld Administrator 10+ Year Member



 
Msg#: 537 posted 10:02 pm on Jul 5, 2002 (gmt 0)

`
If I pay for a couple of pages, but not my whole site, will the rest of the site get spidered as it has in the past?

Short answer: YES :)

lindavh

10+ Year Member



 
Msg#: 537 posted 5:59 am on Jul 6, 2002 (gmt 0)

dvduval

in response to caine:
<I think that would be a correct assumption to make, as the pfi is the 48' hour based spidering program that ATW offers, hence if the pages are not submitted to the PFI, and left on the old crawl cycles, then some pages will be updating fast and others will be upadting with the rest of the index.>

I have three pages in alltheweb thru PFI. They were indexed w/in 48 hours, although the page rank was not as I expected with my search terms as they ranked with Google, etc.

Also, a page that I never submitted through PFI ranked actually higher than those I had submitted.

Since my initial submission I "swapped" one of my pages for another page and it was immediately listed...the other page has dropped from site.
But...in the last week (I assume there has been an update of the entire index) I am now ranking higher for the search terms and on the first page.

So...in a nutshell...from my own personal experience:

*PFI pages get indexed and placed quickly.

*Some pages will get indexed that are not PFI.

*Swapping pages on PFI will index the new page and in my case possibly loose the old page listing.

*After an entire update...you may see your position change dramatically from the first results after PFI.

Like I said...this is what I am seeing since I opted for PFI...
overall experience...very pleased with my decision to PFI with Lycos...

Linda (still a newbie and still learning and lovin' it)

Tor

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 537 posted 10:02 am on Jul 6, 2002 (gmt 0)

I totally agree with you Linda, we have exactly the same experience as you have had with the PFI- program. Everything has been working perfect so far :)

markd

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 537 posted 7:43 am on Jul 7, 2002 (gmt 0)

Just a small cautionary note:

I have had pages in other engines (specifically AV) which were in for free dropped when I decided to include a couple of frequently updated pages in a PFI.

It was almost as though they looked at the domain and decided to exclude all pages which weren't paid for.

I would love to know if anyone has had this experience with Fast?

lindavh

10+ Year Member



 
Msg#: 537 posted 5:41 pm on Jul 7, 2002 (gmt 0)

markd
I have both paid and free listings in Fast - Alltheweb and none of my free listings have been dropped. The only experience I have with a "page" dropping, is one that I had as a paid listing that I swapped with a new page.

I have 10 total pages:
>7 pages are listed in alltheweb
>3 pages are PFI pages
>4 pages are free listings
>3 pages are not listed

Linda

markd

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 537 posted 12:31 pm on Jul 8, 2002 (gmt 0)

Thanks Linda - I think this makes Fast's PFI a useful option for certain pages.

I have experienced 'free' pages dropped after I have signed up just a few for PFI.

Good on Fast!

fathom

WebmasterWorld Senior Member fathom us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 537 posted 1:05 pm on Jul 8, 2002 (gmt 0)

From a personal and professional opinion (most sites, not all, but most) waste their hard earn revenue for paid inclusion since it doesn't guarantee top billing.

With but a few exceptions Yahoo is really the only Search Engine/Directory (web sites listings) you can't get into for free that's worth the fee but only after the fact....

See post #8

[webmasterworld.com...]

Save money and get better results!

nicco

10+ Year Member



 
Msg#: 537 posted 9:17 am on Jul 15, 2002 (gmt 0)

Hi, thi s is what i've experienced:

I've 3 pages in the 48 hours crawl. The other pages i've in the free crawl, spidered as in the past.
When you update the 48 crawl url the page replaced will resume the free crawl title & description, but is not definitively dropped.

My big question is: can fast spider some pages following the 48h crawl? And how fast can check my link popularity without following the links on my 48h crawl pages?

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Yahoo / Deprecated - Altavista, Alltheweb.com
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved