I have seen some evidence that FAST will ignore any sub-domain which is www2.mysite.com while it won't ignore anyotherword.mysite.com Has anyone else seen this? By ignore I mean that WebCrawler refuses to even crawl the site, let alone index it.
2_much
9:03 pm on May 30, 2001 (gmt 0)
I haven't looked into this Physics...maybe someone else has followed this? Does anyone have experience with this?
physics
9:53 pm on May 30, 2001 (gmt 0)
It seems that this is the case. I looked into it a bit more and a spot check on alltheweb is very revealing. A search for URLs that contain [www2....] gives 20 results, but these are not actually www2 subdomains ... these just have this string in the url somewhere.
Conclusion FAST ignores www2 subdomains
BTW, the same search for URLs containing [www....] returns 446,881,753 documents so it is not my search syntax that is off.
