Why the "noindex" on the WebmasterWorld pages?

Forum Moderators: open

Message Too Old, No Replies

Why the "noindex" on the WebmasterWorld pages?

I'm curious why Bret did this

walkman

11:29 pm on Jan 3, 2005 (gmt 0)

"<META NAME="ROBOTS" CONTENT="NOINDEX">"
http://www.google.com/search?hl=en&lr=&c2coff=1&q=+site:www.webmasterworld.com+WebmasterWorld [google.com]
does anyone know why? Personally I found it easier searching on Google.

on edit: this is weird. Before it had just some 250 pages indexed, now it's over 450K...google moving data around I guess.

Brett_Tabke

1:31 pm on Jan 4, 2005 (gmt 0)

there is not a general noindex tag on WebmasterWorld. Why would you think that?

walkman

2:58 pm on Jan 4, 2005 (gmt 0)

example from: [webmasterworld.com...]
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html><head>
<META NAME="ROBOTS" CONTENT="NOINDEX">
<LINK REL="SHORTCUT ICON" HREF="/favicon.ico">

<title>Float and Image Question</title>
<STYLE TYPE="text/css">

Brett_Tabke

3:08 pm on Jan 4, 2005 (gmt 0)

That's indexed just fine:

[google.com...]

Some stuff is marked that way for isp's to get rid of unwanted rogue bots. It is surprising how many of those support robots.txt and a simple no index fed to those isps will stop the abuse.

That is true for big bot running and high abuse isps like the cable companies (rr, verizon, shaw, el, netcom...etc).

shri

7:15 am on Jan 5, 2005 (gmt 0)

Brett, Is this done by the ISPs or by the software on WebmasterWorld? Very clever ...

Brett_Tabke

5:07 pm on Jan 5, 2005 (gmt 0)

Oh, it's by us shri. We get sooo abused by bots, that I have to take every action possible to stop them...