Forum Moderators: LifeinAsia

Message Too Old, No Replies

Stop Your Content Being Scraped

         

nomis5

7:49 pm on May 31, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Looking at the most popular thread at the moment (1st June account shutdowns), many posters are concerned about their content being scraped, it worries me too. One thought though, if your site is mainly .asp or any other server side technology, does that give your site some protection from scraping?

My thinking is that if some of your content is generated server side depending on variables that aren't available to a scraper then the scraper will not get full funtionality if he / she piches your site. Maybe they steer clear of dynamic sites. Any thoughts?

eddy22

5:12 am on Jun 1, 2007 (gmt 0)

10+ Year Member



Report the scraper to adsense!

zCat

6:33 am on Jun 1, 2007 (gmt 0)

10+ Year Member



One thought though, if your site is mainly .asp or any other server side technology, does that give your site some protection from scraping?

Scrapers see your site in exactly the same way legitimate bots do. Doesn't matter if you have .asp, .php or .html at the end of your filenames. Try surfing your site with JavaScript switched off to get a feel for how it will look to a bot.

Or put the other way round: the only content a bot is (currently) not able to see is content post-loaded into a page via AJAX-type technologies. Which would hinder the scrapers, but also not be available to the legitimate bots.