Forum Moderators: open

Message Too Old, No Replies

Stop people stealing my pages using Server.CreateObject("Microsoft.XMLHTTP")

         

stevelibby

9:15 am on Apr 30, 2008 (gmt 0)

10+ Year Member



how can stop people stealing my pages using
Server.CreateObject("Microsoft.XMLHTTP")?

Ocean10000

3:17 am on May 1, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



There are a few solutions. I am going to assume you are using Microsoft IIS for the web server. But to be really help you we need to know a little more. Are they trying to scrap a specific page or all pages? Are your pages dynamic or static? If dynamic what language are they written in, VBscript, C# etc..

stevelibby

4:03 pm on May 1, 2008 (gmt 0)

10+ Year Member



i want to protect all pages, they are dynamic and writtin in asp. Hope this help. I tried using a request servername but that doesnt wont on the scraper site

Ocean10000

1:19 am on May 2, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Ok here is another question for you. Are you on a dedicated server or shared server?

If you are on a dedicated computer you could buy ISAPI_Rewrite, and used that to help filter out a great deal of the scraping of your content by unwanted bots.

With a shared host you have to get it approved and installed which is usually much harder. But you might also get lucky and they might of already installed it, and they can just turn it on for you.

Another option is spend time and money coding up your global.asa in Asp classic to filter bot requests. But I can tell you this much its a great deal of work I know from personal experience.

And last option if you are running on Windows 2008/IIS 7 is you could use Asp.Net modules to help filter out the unwanted traffic easier, without rewriting your site.