Welcome to WebmasterWorld Guest from

Forum Moderators: open

Message Too Old, No Replies

How to get a message board crawl?

How do you get Google to crawl a message board?

8:27 pm on Jun 30, 2002 (gmt 0)

Junior Member

10+ Year Member

joined:Mar 10, 2002
votes: 0

I have read a few threads on .cgi crawls.

After about 6 months I am still having a tough time getting Google to crawl a .cgi

I have a message board that has 2 main directories. One is the cgi-bin and the other is where the data resides.

Both have read / write access.

Am I missing anything?

8:39 am on July 1, 2002 (gmt 0)

Administrator from US 

WebmasterWorld Administrator brett_tabke is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Sept 21, 1999
votes: 11

Cut down on the number of parameters and the length of the cgi string. It would probably be good to get it out of cgi-bin too. Google isn't fond of grabbing stuff in there and it never seems to rank well. I think for it to get a page out of cgi-bin, it has to have some decent external inbound links.