Welcome to WebmasterWorld Guest from 107.22.106.136

Forum Moderators: DixonJones & mademetop

Message Too Old, No Replies

Website Stripper?

I'm getting strange readings as browsers

     
6:57 pm on Mar 1, 2005 (gmt 0)

New User

10+ Year Member

joined:Mar 1, 2005
posts:3
votes: 0


Okay.

So, my site's not public yet..but lately I've been getting a bunch of hits and they all appear to be coming from someone/something using a browser called "Website Stripper". Can anyone fill me in as to who/what uses this browser? Should I be worried?

7:10 pm on Mar 1, 2005 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member ogletree is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Apr 14, 2003
posts:4307
votes: 35


If your site is public at all people will find it. It is just a program to download your site. There are a lot of bots out there. There are all kinds of reasons for people to be doing it. Most often it is some person making a scraper site. Look at www.webmasterworld.com/robots.txt [webmasterworld.com] or A close to perfect .htaccess ban list [webmasterworld.com].

As always don't just copy things like this unless you understand them. What might be good for somebody might hurt you. Like WebmasterWorld's robots.txt will take your site out of the wayback machine forever. That could upset some people and make other very happy.

7:57 pm on Mar 1, 2005 (gmt 0)

New User

10+ Year Member

joined:Mar 1, 2005
posts:3
votes: 0


I'm sorry..I'm extremely new at this. What is a scraper site? And thanks for your reply.
3:19 am on Mar 5, 2005 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Sept 17, 2002
posts:2251
votes: 0


Website Stripper is a property in the browscap.ini file I offer for download on my website. I mark certain user agents as Website Strippers if they have a reputation for doing naughty things on your website like not respecting robots.txt. Then webmasters can look for that property and redirect the bot or whatever they want to do to it. Most of the web that uses browscap.ini is using my file since it's the only one that's regularly updated. Is the actual browser name showing up as Website Stripper?
3:42 am on Mar 5, 2005 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Nov 4, 2002
posts:1687
votes: 0


What is a scraper site?

There are a lot of crap websites that present themselves as directories, or search engines, to get Adsense money. From what I've seen, they use the ODP to kick-start things a lot of the time, but however they do it, they consist of no original content, just scraped data and sh*tloads of links out to many sites.

That's my definition, but others here might have a better one, (almost worth a new thread).

5:39 pm on Mar 5, 2005 (gmt 0)

New User

10+ Year Member

joined:Mar 1, 2005
posts:3
votes: 0


Ah, alright. I see.

I think a scraper site picked me up then, that may explain the website stripper listings. (And when I think about it, it does make sense - I've had some strange URLS in my referring links page.)

And yes, Website Stripper is showing up as the browser.

6:20 pm on Mar 5, 2005 (gmt 0)

Full Member

10+ Year Member

joined:Nov 3, 2003
posts:325
votes: 0


The title of this thread is completely misleading... :)