homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

Robots list service?
Looking for a service provider or subscription service

 7:36 pm on Jan 31, 2006 (gmt 0)

Looking for a firm or reliable consultant that will provide updated bot lists on a regular basis.

I'm only interested in keeping up with the top 30-40 engines. Feedback or PM on individual recomendations appreciated.

Thanks in advance.



 1:41 am on Feb 1, 2006 (gmt 0)

Any reliable stats program will give you names and rankings. If you have an active site (with a few thousand non-robot hits/week, I'd say), or you have tech people, install a good one and look at your own logs' data. The most active 30-40 bots you see will be the top U.S.-based and international engines.

Global Options:
 top home search open messages active posts  

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved