Page is a not externally linkable
- Google
-- Google SEO News and Discussion
---- Today's Webmaster & Their Relationship with Google


atlrus - 9:31 pm on May 9, 2007 (gmt 0)


it's about webmasters that don't know about robots.txt;

I would not call anyone a webmaster if they don't know about robots.txt, but then again I call a webmaster a person who builds and/or maintains a website. I guess your definition of webmaster is a little broader than mine.
If you don't know the basics - you should stay out of it. I can call myself mechanic all day long, but if I don't know what a "starter" is - am I a mechanic?

You seem to think that it's OK to rip off my content for free, and that that's all public domain stuff.

I never said that. I said that if your content has no copyright - it's not protected.
And I don't think Google rips off your content. Let's not forget that unless you are running a website on the latest NASA discoveries - someone has written "your" content long before you re-wrote it. So don't get too testy about ripping off - everything new is a well forgotten old thing.

And again - it's simple as hell to make Google stop "ripping off" your content.

I am personally OK with Google "ripping off" my content, so my robots.txt is empty. My main website gets scraped about 10-15 times a day and I have never been banned by Google, or seen my content on other websites in the index. Most of the Google guidelines are also fine by me.


Thread source:: http://www.webmasterworld.com/google/3334098.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com