homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Code, Content, and Presentation / Apache Web Server
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL & phranque

Apache Web Server Forum

Simulating bots/crawlers ?

 9:14 am on Jul 13, 2009 (gmt 0)

I run a image heavy site, and Yahoo, Microsoft, Google image bots/crawlers visit me frequently. All 3 of them have indexed many thousand of my images.

I've been thinking about this and I want to replace the images I serve to the bots with watermarked images which include my domain name on the image.

This is simply added by using mod rewrite checking on the useragents extracted from my access log files. However how do I test this ? How can I browse my website with a specific useragent so I can see what a bot will see ?

Thanks in advance.



 1:34 pm on Jul 13, 2009 (gmt 0)

Use the Firefox Browser with the UA Plugin.


 1:40 pm on Jul 13, 2009 (gmt 0)

If you are a webmasterworld supporter member - use the SimSpider to change the agent.

Aside from UA checkers, you can run proxies like Proxomitron to run local. (proxo is freeware and no longer supported)

Global Options:
 top home search open messages active posts  

Home / Forums Index / Code, Content, and Presentation / Apache Web Server
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved