I have read a few threads on .cgi crawls.
After about 6 months I am still having a tough time getting Google to crawl a .cgi
I have a message board that has 2 main directories. One is the cgi-bin and the other is where the data resides.
Both have read / write access.
Am I missing anything?