Page is a not externally linkable
atlrus - 9:31 pm on May 9, 2007 (gmt 0)
I would not call anyone a webmaster if they don't know about robots.txt, but then again I call a webmaster a person who builds and/or maintains a website. I guess your definition of webmaster is a little broader than mine. And again - it's simple as hell to make Google stop "ripping off" your content. I am personally OK with Google "ripping off" my content, so my robots.txt is empty. My main website gets scraped about 10-15 times a day and I have never been banned by Google, or seen my content on other websites in the index. Most of the Google guidelines are also fine by me.
it's about webmasters that don't know about robots.txt;
If you don't know the basics - you should stay out of it. I can call myself mechanic all day long, but if I don't know what a "starter" is - am I a mechanic? You seem to think that it's OK to rip off my content for free, and that that's all public domain stuff.
I never said that. I said that if your content has no copyright - it's not protected.
And I don't think Google rips off your content. Let's not forget that unless you are running a website on the latest NASA discoveries - someone has written "your" content long before you re-wrote it. So don't get too testy about ripping off - everything new is a well forgotten old thing.