homepage Welcome to WebmasterWorld Guest from 184.73.40.21
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Code, Content, and Presentation / Apache Web Server
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL & phranque

Apache Web Server Forum

    
Simulating bots/crawlers ?
darkage

5+ Year Member



 
Msg#: 3951398 posted 9:14 am on Jul 13, 2009 (gmt 0)

I run a image heavy site, and Yahoo, Microsoft, Google image bots/crawlers visit me frequently. All 3 of them have indexed many thousand of my images.

I've been thinking about this and I want to replace the images I serve to the bots with watermarked images which include my domain name on the image.

This is simply added by using mod rewrite checking on the useragents extracted from my access log files. However how do I test this ? How can I browse my website with a specific useragent so I can see what a bot will see ?

Thanks in advance.

 

wilderness

WebmasterWorld Senior Member wilderness us a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



 
Msg#: 3951398 posted 1:34 pm on Jul 13, 2009 (gmt 0)

Use the Firefox Browser with the UA Plugin.

Brett_Tabke

WebmasterWorld Administrator brett_tabke us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 3951398 posted 1:40 pm on Jul 13, 2009 (gmt 0)

If you are a webmasterworld supporter member - use the SimSpider to change the agent.

Aside from UA checkers, you can run proxies like Proxomitron to run local. (proxo is freeware and no longer supported)

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Code, Content, and Presentation / Apache Web Server
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved