Page is a not externally linkable
- Search Engines
-- UK & Ireland Search Engines
---- Worth Building a UK Search Engine?
mojeek - 7:47 am on May 1, 2012 (gmt 0)Thread source:: http://www.webmasterworld.com/uk_ireland_search_engines/4447195.htm
Hi jmcc, I think you're spot on. Blindly crawling everything in sight is definitely not the way to go for smaller engines, it's then just a matter of deciding what to crawl or not, either algorithmically or manually.
Brought to you by WebmasterWorld: http://www.webmasterworld.com