homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Yahoo / Deprecated - Altavista, Alltheweb.com
Forum Library, Charter, Moderator: open

Deprecated - Altavista, Alltheweb.com Forum

Question about Fast & PFI
Question about PFI for Fast

 7:42 pm on Jan 5, 2003 (gmt 0)

If i submit a url and on that URL i have 8000 links will those 8000 links get spidered from Fast?

I see single URL submissions but i dont know whether they add only that single URL of it will spider URLs on that page as long as they're linked to pages within the domain name it is spidering?



 7:43 pm on Jan 5, 2003 (gmt 0)


some experts on fast in this Forum (i am not 1 of them)

but in answer to your question:


only the single URL will be spidered by paying the fee.


(fellow members may be able to shed light whether Fast crawls other pages found on the web, which have not paid)


 8:05 pm on Jan 5, 2003 (gmt 0)

Most of my pages in Fast are unpaid. Links on those pages do get followed, but they don't get spidered nearly as frequently as my paid pages. More frequent spidering is part of the PFI deal, as advertised.

I'd assume that there must be different spiders involved -- the "PFI bot" just asks for the paid pages and leaves; whereas the regular bot does a more conventional crawl, following links and so on. But Fast hasn't been a big enough traffic generator for me to dig into that topic and know the different IP addresses, schedules, etc.


 8:23 pm on Jan 5, 2003 (gmt 0)


I understand that the paid url will be spidered more often than not but what i am trying to figure out is that if i submit [mydomain.com...] for indexing, via a paid solution, would those engines follow the links on my paid submission url to the URLs i link to on that page?

While it is nice to have [mydomain.com...] in index if the links to mu products dont get spiders it isnt worth it to submit via that method and im better off to pay a site with a solid foundation in the SE's to link to my site.

The only reason to submit [domain.com...] for me is to get [domain.com...] and everything else into the index.


 8:31 pm on Jan 5, 2003 (gmt 0)

>would those engines follow the links on my paid submission url to the URLs i link to on that page?

No, the PFI spider will not follow the links. It is paid inclusion for the pages you pay for.


 7:50 pm on Jan 6, 2003 (gmt 0)

Up until the last few weeks my entire site has been spidered more or less as per Google - in fact, showing more hits on my logs than Google - and I never even realized Fast did PFI!

I must be lucky, dumb, or both.

Global Options:
 top home search open messages active posts  

Home / Forums Index / Yahoo / Deprecated - Altavista, Alltheweb.com
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved