Welcome to WebmasterWorld Guest from

Forum Moderators: open

Message Too Old, No Replies

How to get a message board crawl?

How do you get Google to crawl a message board?



8:27 pm on Jun 30, 2002 (gmt 0)

10+ Year Member

I have read a few threads on .cgi crawls.

After about 6 months I am still having a tough time getting Google to crawl a .cgi

I have a message board that has 2 main directories. One is the cgi-bin and the other is where the data resides.

Both have read / write access.

Am I missing anything?


8:39 am on Jul 1, 2002 (gmt 0)

WebmasterWorld Administrator brett_tabke is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

Cut down on the number of parameters and the length of the cgi string. It would probably be good to get it out of cgi-bin too. Google isn't fond of grabbing stuff in there and it never seems to rank well. I think for it to get a page out of cgi-bin, it has to have some decent external inbound links.

Featured Threads

Hot Threads This Week

Hot Threads This Month