Page is a not externally linkable
-- Google AdSense
---- Scraper sites are GOOD
hyperkik - 8:03 pm on May 9, 2005 (gmt 0)Thread source:: http://www.webmasterworld.com/google_adsense/6568.htm
|I've told a webmaster that if they don't want a site indexed, create a robots.txt file to prevent it. |
You use a unique name for your spider, such that he can ban just you?
Brought to you by WebmasterWorld: http://www.webmasterworld.com