Forum Moderators: coopster

Message Too Old, No Replies

How to check if sessions are truly disabled for googlebot

         

cmendla

7:13 pm on Aug 18, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I've been having some problems with googlebot hammering my phpbb boards.

The problem was that the googlebot does not like session ids. It seems to go into a sort of endless loop. I found that needed to do a mod so that the googlebot does not get session ids. I tried one mod and that didn't work. (because the logs were showing googlebot still churning well after the mod was done. ) There was a warning with the mod that it might not work with the newer versions of php.

I tried another mod and I think it is working. I have firefox so I downloaded the extension that lets me change the user agent of the browser. I set a user agent of googlebot and browsed my sites. If I set the user agent to googlebot and load the discussion page, I can mouse over the admin link at the bottom and see a session id. However, if I reload the page the link totally disappears.

If I change to the default agent, everything seems to work normally. In other words I can log in as an admin to phpbb and all of the links will show the session ids when moused over.

Questions

1. Does this sound like the mod is really working and getting rid of the session id? I'm not sure because I see a session id on the admin link when I load the page.

2. Is there any better way to check how your page is presented to the googlebot and if the googlebot will see session ids?

Sorry if this has been covered before. However the googlebot is consuming two months of bandwidth in 4 days. I have to get this right yesterday.

Thanks

CG

jatar_k

8:51 pm on Aug 19, 2005 (gmt 0)

WebmasterWorld Administrator 10+ Year Member



it does sound like it is working from what you describe.

I can't think of any better way off the top of my head, people usually suggest various mods that do the same thing.

>> admin link

it always has the sessid on the link, that's part of how it works. I've dug through the code on that bit before.