WebmasterWorld robots.txt

[phpmaven]

I've been spending some time working on my robots.txt file and looking at the one Brett set-up here. I notice this morning that is blocking all bots:

User-agent: *
Disallow: /

I don't think Brett wants to block all bots. He may be pulling the UAs out of a DB like I am and building robots.txt on the fly. Perhaps there is a problem there. I though someone should let him know.

[stever]

Oh yes he does! [webmasterworld.com]

[phpmaven]

Wow! I used to find it annoying that he didn't let his pages get cached, but not being able to find any of the pages on Google or elsewhere is going to make it hard to find useful posts, especially since the on site search feature here works so poorly.

Oh well, I guess if Brett wants to commit SE suicide, that's his call.

[incrediBILL]

<deleted>

[oddsod]

I though someone should let him know.

I'd always use a sticky for something like that ;)