My phpbb forum index page has been indexed by Yahoo thousands of times
mikeD
1:56 pm on Feb 29, 2004 (gmt 0)
I have a problem. Currently my phpbb forum index page has been indexed by Yahoo thousands of times. How do I stop this happening. Should I be using my robots.txt to ban Yahoo from my forum?
Version phpBB 2.0.6
Tim
2:11 pm on Feb 29, 2004 (gmt 0)
Please send a snip of your logs to webmasterworldfeedback@yahoo.com and we can diagnose why the crawler is getting stuck. Thanks, Tim
mikeD
2:23 pm on Feb 29, 2004 (gmt 0)
sent the email Tim, hope you can find the reason
2_much
12:30 am on Mar 1, 2004 (gmt 0)
mikeD, did Yahoo index your other pages, or just the index page?
mikeD
12:44 pm on Mar 1, 2004 (gmt 0)
just the index page of my forum. My site only has about 600 pages at most. But yahoo is stating 661 - 680 out of about 21,200.
ScottM
1:56 pm on Mar 1, 2004 (gmt 0)
Possibly a sessions problem?
mikeD
3:07 pm on Mar 1, 2004 (gmt 0)
seems that way Scott, because the index page has a different url extension for every session. Any ideas for a solution. Google doesn't have this problem with phpbb
