Forum Moderators: open
How do I find how many pages FAST has indexed from my site?
Enter the Advanced search page (http://www.alltheweb.com/advanced)
Under “Domain Filters” enter the url, and then do a search.
The FAST FAQ ( [alltheweb.com...] ) states:
url.host:name Finds pages on a specific site. url.host:www.fastsearch.com will find pages on the fastsearch.com site.
There seem to be a couple methods and I can't seem to determine the accurate count.
1) Standard search for "url.host:yoursite.com"
2) Standard search for "yoursite.com" then click "more hits from" (assumes you have your site name on all pages of your site)
3) Advanced search empty query with word filter set to "must include" and "in the URL" for "www.yoursite.com"
4) Advanced search domain filter - only include "yoursite.com"
1 & 4 seem to give the same number of results. Unfortunately in each case my site has over 4,000 results (ATW cuts off your results at 4K), making it difficult to compare sets.
Which is more accurate?
How do you mean: "ATW cuts off your results at 4K"
This search [alltheweb.com] gives 9910 for Lycos.
That would be accurate enough for me?
includes all subdomains.
gives 5,815,647 for lycos.com
>3) Advanced search empty query with word filter set to "must include" and "in the URL" for "www.yoursite.com"
no subdomains
gives 9,910 for lycos.com
>2) Standard search for "yoursite.com" then click "more hits from" (assumes you have your site name on all pages of your site)
gives 44 for lycos.com
bad query, should be rewritten to "lycos"
thus returning 3,663
>1) Standard search for "url.host:yoursite.com"
includes domains like search.lycos.com.cn
gives 5,795,630
That leaves me with one more determination now for each site; for which sites do I include subdomains in the comparison? It probably depends on the structure of each site.
By "cut off" at 4,000 I mean that you can follow links to more results on AllTheWeb to the 4,000th result at which point there are no more links to additional results.
