| Welcome to WebmasterWorld Guest from 126.96.36.199 |
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
|Become a Pro Member|
|Shopping Search Engine|
List of shopping-related robots
Another one, crawler-based, follows robots.txt:
(pls notify me if I am not following rules)
What happened with Dulance btw... I don't think they were crawler-based...
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved