Welcome to WebmasterWorld Guest from

Forum Moderators: open

Message Too Old, No Replies

Question about Fast & PFI

Question about PFI for Fast



7:42 pm on Jan 5, 2003 (gmt 0)

10+ Year Member

If i submit a url and on that URL i have 8000 links will those 8000 links get spidered from Fast?

I see single URL submissions but i dont know whether they add only that single URL of it will spider URLs on that page as long as they're linked to pages within the domain name it is spidering?


7:43 pm on Jan 5, 2003 (gmt 0)


some experts on fast in this Forum (i am not 1 of them)

but in answer to your question:


only the single URL will be spidered by paying the fee.


(fellow members may be able to shed light whether Fast crawls other pages found on the web, which have not paid)


8:05 pm on Jan 5, 2003 (gmt 0)

WebmasterWorld Senior Member tedster is a WebmasterWorld Top Contributor of All Time 10+ Year Member

Most of my pages in Fast are unpaid. Links on those pages do get followed, but they don't get spidered nearly as frequently as my paid pages. More frequent spidering is part of the PFI deal, as advertised.

I'd assume that there must be different spiders involved -- the "PFI bot" just asks for the paid pages and leaves; whereas the regular bot does a more conventional crawl, following links and so on. But Fast hasn't been a big enough traffic generator for me to dig into that topic and know the different IP addresses, schedules, etc.


8:23 pm on Jan 5, 2003 (gmt 0)

10+ Year Member


I understand that the paid url will be spidered more often than not but what i am trying to figure out is that if i submit [mydomain.com...] for indexing, via a paid solution, would those engines follow the links on my paid submission url to the URLs i link to on that page?

While it is nice to have [mydomain.com...] in index if the links to mu products dont get spiders it isnt worth it to submit via that method and im better off to pay a site with a solid foundation in the SE's to link to my site.

The only reason to submit [domain.com...] for me is to get [domain.com...] and everything else into the index.


8:31 pm on Jan 5, 2003 (gmt 0)

>would those engines follow the links on my paid submission url to the URLs i link to on that page?

No, the PFI spider will not follow the links. It is paid inclusion for the pages you pay for.


7:50 pm on Jan 6, 2003 (gmt 0)

10+ Year Member

Up until the last few weeks my entire site has been spidered more or less as per Google - in fact, showing more hits on my logs than Google - and I never even realized Fast did PFI!

I must be lucky, dumb, or both.


Featured Threads

Hot Threads This Week

Hot Threads This Month