Page is a not externally linkable
whoisgregg - 2:50 am on Jan 17, 2005 (gmt 0)
One issue though, from SearchEngineWorld's The Robots.txt Our Big Crawl [searchengineworld.com]: Depending on how many layers of tin foil you use for your hat, you may wish to make each site unique in ways that eliminate the use of some of the described methods.
Great post -- flagged for future reference.
An easy way for search engines to detect server or domain farms (huge groups of sites), is to look at the robots.txt. We found huge farms of 400-500 domains that were all using the same unique robots.txt file. That alone is a tip off to search engines that the sites are all related.