homepage Welcome to WebmasterWorld Guest from 50.19.33.5
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Subscribe to WebmasterWorld
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

    
Robots list service?
Looking for a service provider or subscription service
xbase234




msg:1529546
 7:36 pm on Jan 31, 2006 (gmt 0)

Looking for a firm or reliable consultant that will provide updated bot lists on a regular basis.

I'm only interested in keeping up with the top 30-40 engines. Feedback or PM on individual recomendations appreciated.

Thanks in advance.

 

Pfui




msg:1529547
 1:41 am on Feb 1, 2006 (gmt 0)

Any reliable stats program will give you names and rankings. If you have an active site (with a few thousand non-robot hits/week, I'd say), or you have tech people, install a good one and look at your own logs' data. The most active 30-40 bots you see will be the top U.S.-based and international engines.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About
© Webmaster World 1996-2014 all rights reserved