homepage Welcome to WebmasterWorld Guest from 54.211.97.242
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    

Froggyman



 
Msg#: 739 posted 7:21 am on Jun 5, 2001 (gmt 0)

Reporting new (?) bot. Not quite sure what it's for. Looks like an url filter but why would an entry be made? Hit index.html and ignored robots.txt.

host2.webwasher.com (195.162.240.2)
Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 4.0)

Referal looks like:
[webwasher.com...]

xx=("entry number")

[webwasher.com...]

 

skirril

10+ Year Member



 
Msg#: 739 posted 10:24 am on Jun 7, 2001 (gmt 0)

WebWasher is a Personal Firewall, used to block ads. It filters, afaik, images that have the typical banner-ad size, but can also filter based on url (containing certain substrings..)

Now since rhe online advertising market is (as any market) constantly "evolving" they need a way to keep up to date (or how do you know that www.foo.com is an advertising company?)

I can well imagine that this keeping up to date is done by a fully-automated robot (or perhaps a directed one)

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved