Welcome to WebmasterWorld Guest from 220.127.116.11 , register , free tools , login , search , pro membership , help , library , announcements , recent posts , open posts Become a Pro Member
Spider Names I need the names of some SEs usernames The Young One msg:1527128 1:52 am on Jan 8, 2004 (gmt 0) Does anybody know of a good site, or have a list of search engine spider usernames? Any help would be appreciated.
pendanticist msg:1527129 2:15 am on Jan 8, 2004 (gmt 0)
Welcome to WebmasterWorld [ webmasterworld.com], The Young One :) Here [ webmasterworld.com] is about the best place to start your sojourn. You'll note that forum is now deprecated, so posts are no longer accepted. These threads [ webmasterworld.com] go hand-in-hand [ webmasterworld.com] with the information in that forum.
Hope this helps.
pageoneresults msg:1527130 2:47 am on Jan 8, 2004 (gmt 0)
In addition to the above referenced topics, here's a pretty comprehensive list that appears to have a last modified date of 11/29/2003 07:52:34. Database of Web Robots [ robotstxt.org]