Welcome to WebmasterWorld Guest from 18.207.136.184

Forum Moderators: LifeinAsia

Message Too Old, No Replies

Stop Your Content Being Scraped

     
7:49 pm on May 31, 2007 (gmt 0)

Senior Member from GB 

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month

joined:Apr 29, 2005
posts:2112
votes: 122


Looking at the most popular thread at the moment (1st June account shutdowns), many posters are concerned about their content being scraped, it worries me too. One thought though, if your site is mainly .asp or any other server side technology, does that give your site some protection from scraping?

My thinking is that if some of your content is generated server side depending on variables that aren't available to a scraper then the scraper will not get full funtionality if he / she piches your site. Maybe they steer clear of dynamic sites. Any thoughts?

5:12 am on June 1, 2007 (gmt 0)

Junior Member

10+ Year Member

joined:Sept 17, 2004
posts:138
votes: 0


Report the scraper to adsense!
6:33 am on June 1, 2007 (gmt 0)

Preferred Member

10+ Year Member

joined:Oct 1, 2004
posts:607
votes: 0


One thought though, if your site is mainly .asp or any other server side technology, does that give your site some protection from scraping?

Scrapers see your site in exactly the same way legitimate bots do. Doesn't matter if you have .asp, .php or .html at the end of your filenames. Try surfing your site with JavaScript switched off to get a feel for how it will look to a bot.

Or put the other way round: the only content a bot is (currently) not able to see is content post-loaded into a page via AJAX-type technologies. Which would hinder the scrapers, but also not be available to the legitimate bots.

 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members