Forum Moderators: open
Hi Melanie, this forum is about Search Engine Spiders. Search Engine spiders are robotic programs that go out onto the web and download websites. Search Engines then use that data as the basis for their search engine listings (much the same way you found this forum via the search engine [yahoo.com] on Yahoo).
We try to identify which spider is from which search engine so that we know which search engine is indexing our sites. It helps us run better sites and promote them through all of the Search Engines.
Just to mention a few... :)
Edited by: ettore
[eou.edu...]
It is a searchable database about spiders and to Ident. ones that have 8 legs not 256 ip's :)
Thanks also for all of you who helped out with book ideas and website addresses. That was great. I couldn't find Emerton's Canadian Spider (1916) either retailed or in the library but I did find his book on spiders of the US which looks like it would be interesting to follow up on as well as some others, a combination of which should probably be the answer.