Google won't index anything in my cgi-bin

site's been up for about 2 years, googlebot's never visited...

[PFOnline]

Hi, I'm wondering why Google wont crawl/visit/index anything in my cgi-bin. I would especially like my forum (and all the threads within) to be indexed.

The forum software i use is Ikonboard, if that has to do with anything.

Anyone know why Googlebot wouldn't index anything in my cgi-bin? Or how to get Googlebot to visit?

My robots.txt file looks like this:

User-agent: *
Disallow:

Any ideas?
Thanks

[edited by: PFOnline at 5:13 am (utc) on Dec. 12, 2002]

[martinibuster]

I bot needs a link to get from place to place. Many actions related to cgi-bins are triggered by an action, like javascript. It's really not supposed to go there because all that's usually there is boring old perlscripts.

[PFOnline]

I link to it from my main page and many pages within. For example:

'http://www.mydomain.com/cgi-bin/ikonboard/ikonboard.cgi

is linked to from many pages. But google still wont visit.

[PFOnline]

The site linking to the forum in the cgi-bin is a PR 5 by the way. (thought I should add)

Do you mean it has to have direct links from other sites? Cause I don't think any sites would be interesting in linking to my message board.

Thanks

[sun818]

Reason 1: If you downloaded this and implemented this robots.txt on your domain as-is, you will notice cgi-bin is disallowed: [webmasterworld.com...]

Reason 2: Default version Ikonboard contain the session ID in the URL (s=xxx) which can cause issues. I am sure you will be able to find some threads if you do a search on Ikonboard on here.

[PFOnline]

Ahhh sun818.... Beautiful, thanks!