Forum Moderators: open

Message Too Old, No Replies

Google won't index anything in my cgi-bin

site's been up for about 2 years, googlebot's never visited...

         

PFOnline

3:59 am on Dec 12, 2002 (gmt 0)

10+ Year Member



Hi, I'm wondering why Google wont crawl/visit/index anything in my cgi-bin. I would especially like my forum (and all the threads within) to be indexed.

The forum software i use is Ikonboard, if that has to do with anything.

Anyone know why Googlebot wouldn't index anything in my cgi-bin? Or how to get Googlebot to visit?

My robots.txt file looks like this:

User-agent: *
Disallow:

Any ideas?
Thanks

[edited by: PFOnline at 5:13 am (utc) on Dec. 12, 2002]

martinibuster

4:13 am on Dec 12, 2002 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



I bot needs a link to get from place to place. Many actions related to cgi-bins are triggered by an action, like javascript. It's really not supposed to go there because all that's usually there is boring old perlscripts.

PFOnline

4:23 am on Dec 12, 2002 (gmt 0)

10+ Year Member



I link to it from my main page and many pages within. For example:

'http://www.mydomain.com/cgi-bin/ikonboard/ikonboard.cgi

is linked to from many pages. But google still wont visit.

PFOnline

4:58 am on Dec 12, 2002 (gmt 0)

10+ Year Member



The site linking to the forum in the cgi-bin is a PR 5 by the way. (thought I should add)

Do you mean it has to have direct links from other sites? Cause I don't think any sites would be interesting in linking to my message board.

Thanks

sun818

5:31 am on Dec 12, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Reason 1: If you downloaded this and implemented this robots.txt on your domain as-is, you will notice cgi-bin is disallowed: [webmasterworld.com...]

Reason 2: Default version Ikonboard contain the session ID in the URL (s=xxx) which can cause issues. I am sure you will be able to find some threads if you do a search on Ikonboard on here.

PFOnline

5:35 am on Dec 12, 2002 (gmt 0)

10+ Year Member



Ahhh sun818.... Beautiful, thanks!