Welcome to WebmasterWorld Guest from 188.8.131.52
I know Google and maybe others do not like pages that redirect, so I want to use ModRewrite to redirect everyone except top bots to the real forum.
While I have a basic knowledge of ModRewrite, I'm not up to this. Any help is appreciated.
i see that you write perl scripts. i loaded shed loads of spider c-blocks into my database then wrote a script that checked if the visitor was a spider or not. depending on this check you can serve different content.
you can maintain a table of visitorips which you can purge say every half an hour.
i actually used this for logging purposes rather than serving different content but the principle is the same. i now have a system where i have visits and pageviews for both humans and spiders.
why not implement something like this in perl? just remember to update your spider list every now and then.