Welcome to WebmasterWorld Guest from 18.104.22.168
Forum Moderators: rogerd
if (!empty($SID) &&!preg_match('#sid=#', $url) )
global $SID, $HTTP_SERVER_VARS;
if (!empty($SID) &&!eregi('sid=', $url) &&!strstr($HTTP_SERVER_VARS['HTTP_USER_AGENT'] ,'Googlebot') &&!strstr($HTTP_SERVER_VARS['HTTP_USER_AGENT'] ,'firstname.lastname@example.org;'))
Now Googlebot quite happily spiders my fora and results appear in the SERPS.
If you wish you can PM me and I'll send you some SE friendly pre modded files as well as details on other mods which should be added.
I made some changes to the Make_Clickable function in bbcode so that any dropped URL's go via a redirect script (which also incorporates a domain ban list), and email addresses get disguised rather than set to a "MailTo:".
If you're making it easier for bots to navigate, you need to start thinking about the kinds of bots that will be in there but that you don't really want to be able to "see" much.....