Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

Robots.txt on phpbb forums

it worked! thanks for the tip

1:52 pm on Jul 29, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Sept 28, 2001
votes: 0

I have a site that's running a phpbb forum, and google seems to index specific number of pages from the site no matter what I do. The problem is that many of the pages google was indexing were worthless such as the login for private messages. Following the advice of this post...
...I created my own robots.txt file:
User-agent: *
Disallow: /groupcp.php
Disallow: /login.php
Disallow: /modcp.php
Disallow: /privmsg.php
Disallow: /search.php
It worked like a champ and now Google is getting at the good stuff and leaving the spider poop alone.
Thanks for the tip!

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members