Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

Spider Names

I need the names of some SEs usernames


The Young One

1:52 am on Jan 8, 2004 (gmt 0)

Inactive Member
Account Expired


Does anybody know of a good site, or have a list of search engine spider usernames? Any help would be appreciated.
2:15 am on Jan 8, 2004 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Apr 27, 2002
votes: 0

Welcome to WebmasterWorld [webmasterworld.com], The Young One :)

Here [webmasterworld.com] is about the best place to start your sojourn. You'll note that forum is now deprecated, so posts are no longer accepted. These threads [webmasterworld.com] go hand-in-hand [webmasterworld.com] with the information in that forum.

Hope this helps.

2:47 am on Jan 8, 2004 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member pageoneresults is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Apr 27, 2001
votes: 51

In addition to the above referenced topics, here's a pretty comprehensive list that appears to have a last modified date of 11/29/2003 07:52:34.

Database of Web Robots [robotstxt.org]