homepage Welcome to WebmasterWorld Guest from 54.237.95.6
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Pubcon Website
Visit PubCon.com
Home / Forums Index / Code, Content, and Presentation / Apache Web Server
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL & phranque

Apache Web Server Forum

    
Simulating bots/crawlers ?
darkage




msg:3951400
 9:14 am on Jul 13, 2009 (gmt 0)

I run a image heavy site, and Yahoo, Microsoft, Google image bots/crawlers visit me frequently. All 3 of them have indexed many thousand of my images.

I've been thinking about this and I want to replace the images I serve to the bots with watermarked images which include my domain name on the image.

This is simply added by using mod rewrite checking on the useragents extracted from my access log files. However how do I test this ? How can I browse my website with a specific useragent so I can see what a bot will see ?

Thanks in advance.

 

wilderness




msg:3951515
 1:34 pm on Jul 13, 2009 (gmt 0)

Use the Firefox Browser with the UA Plugin.

Brett_Tabke




msg:3951518
 1:40 pm on Jul 13, 2009 (gmt 0)

If you are a webmasterworld supporter member - use the SimSpider to change the agent.

Aside from UA checkers, you can run proxies like Proxomitron to run local. (proxo is freeware and no longer supported)

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Code, Content, and Presentation / Apache Web Server
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About
© Webmaster World 1996-2014 all rights reserved