homepage Welcome to WebmasterWorld Guest from 54.226.80.196
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

    
Spider Names
I need the names of some SEs usernames
The Young One




msg:1527128
 1:52 am on Jan 8, 2004 (gmt 0)

Does anybody know of a good site, or have a list of search engine spider usernames? Any help would be appreciated.

 

pendanticist




msg:1527129
 2:15 am on Jan 8, 2004 (gmt 0)

Welcome to WebmasterWorld [webmasterworld.com], The Young One :)

Here [webmasterworld.com] is about the best place to start your sojourn. You'll note that forum is now deprecated, so posts are no longer accepted. These threads [webmasterworld.com] go hand-in-hand [webmasterworld.com] with the information in that forum.

Hope this helps.

pageoneresults




msg:1527130
 2:47 am on Jan 8, 2004 (gmt 0)

In addition to the above referenced topics, here's a pretty comprehensive list that appears to have a last modified date of 11/29/2003 07:52:34.

Database of Web Robots [robotstxt.org]

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved