Forum Moderators: goodroi

Message Too Old, No Replies

How to disallow getlastpost

         

annelisabeth

2:09 pm on Apr 20, 2005 (gmt 0)

10+ Year Member



I would like to disallow some URL's on my IPB forum
index.php?showtopic=464&view=getlastpost
index.php?showtopic=486&view=getnewpost

In which the post number is changing for each post.

Is that possible in robots.txt?

And if it isn't, is there something else I can do? Given I want these to be indexed:

index.php?showtopic=433

Forgot to add:
I'd like these excempted too:
index.php?act=Print&client=printer&f=4&t=374
Several different URL's for each thread, all starting with
index.php?act=

ThomasB

9:19 am on Apr 21, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



annelisabeth, currently not all spiders support dynamic URLs in robots.txt. You might think about limiting the indexing via meta-tags or switching to URL rewritting to be able to add certain pages to robots.txt