Forum Moderators: open

Message Too Old, No Replies

Why does WebmasterWorld block all robots?

         

mikomido

11:55 am on Aug 8, 2007 (gmt 0)



Not only does every page have "noindex" in the meta, but robots.txt has blocked ALL robots. BTW... there is a secret "blog" in the robots.txt. Funny stuff...

Anyway... why would he who runs this site not want to be indexed? He/she hates free search engine traffic?

engine

5:10 pm on Aug 8, 2007 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



I hope it's not too late to say, welcome to WebmasterWorld.

For a number of years, WebmasterWorld has fought a constant battle with rogue bots.

You'll find the interesting thread on the matter here.

[webmasterworld.com...]