Page is a not externally linkable
- Google
-- Google AdSense
---- Why does Google AdSense sponsor "scraper" spam sites


hyperkik - 7:06 pm on Mar 29, 2005 (gmt 0)


You don't have to submit your sites to search engines for them to do their scraping. The Robots.Txt standard says that if you are not dissallowed then you can scrape all you want.

I don't think anybody could honestly confuse indexing by search engines with scraping. Nor the indexing by a search engine using its own robot with scraping by a content pirate who masquerades as somebody else's robot.


Thread source:: http://www.webmasterworld.com/google_adsense/5761.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com