Forum Moderators: open
I see single URL submissions but i dont know whether they add only that single URL of it will spider URLs on that page as long as they're linked to pages within the domain name it is spidering?
some experts on fast in this Forum (i am not 1 of them)
but in answer to your question:
NO.
only the single URL will be spidered by paying the fee.
Shak
(fellow members may be able to shed light whether Fast crawls other pages found on the web, which have not paid)
I'd assume that there must be different spiders involved -- the "PFI bot" just asks for the paid pages and leaves; whereas the regular bot does a more conventional crawl, following links and so on. But Fast hasn't been a big enough traffic generator for me to dig into that topic and know the different IP addresses, schedules, etc.
I understand that the paid url will be spidered more often than not but what i am trying to figure out is that if i submit [mydomain.com...] for indexing, via a paid solution, would those engines follow the links on my paid submission url to the URLs i link to on that page?
While it is nice to have [mydomain.com...] in index if the links to mu products dont get spiders it isnt worth it to submit via that method and im better off to pay a site with a solid foundation in the SE's to link to my site.
The only reason to submit [domain.com...] for me is to get [domain.com...] and everything else into the index.
No, the PFI spider will not follow the links. It is paid inclusion for the pages you pay for.
I must be lucky, dumb, or both.
