With info from here and another forums I was doing some changes to my phpbb forum to eliminate the session id and make it more spider friendly removing some garbage links, mod_rewrite, etc when the user is anonymus or not loged in.
All that looks working fine when I'm browsing it from my PC. But, how am I sure the the spiders are seeing what they like? .. let's say GG has been picking up only robots.txt and index page only for the last few days when I just completed my changes. How am I sure that the reason because is not going further is just time a low income links and not because I miss something?
If a I see the cache index page of my forum in GG and all of the links looks clean (no session Ids added to the URL), does it means that I am fine?
Thanks for any help. CS.
[edited] some typos.. for sure not all of them :-)[/edited]
For starters, Caspita, I'd evaluate the spiderability of the forum by using Xenu or a similar tool to spider it yourself. Xenu is dumber than more sophisticated SE bots, and if you get good results you can be fairly certain the SE bots will do fine.
If you have satisfied yourself that there are no technical barriers to spidering, then the next step would be to concentrate on getting more inbound links. This will raise your spidering priority, and should result in deeper spidering and indexing.
The natural tendency of your forum to build content will help over time, too.