Welcome to WebmasterWorld Guest from 54.145.55.135

Forum Moderators: open

Message Too Old, No Replies

Does Google Spider cgi? or cgi-bin?

     
10:19 pm on Sep 21, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:May 16, 2003
posts:109
votes: 0


I have a forum which I am trying to get spidered. I have removed the session from the URL and submitted a URL like this:

[mysite.org...]

Will Google visit this URL? Thanks.

3:36 pm on Sept 22, 2003 (gmt 0)

New User

10+ Year Member

joined:Aug 9, 2003
posts:8
votes: 0


It may or may not. They spider dynamic pages, but I don't know about semicolons. I had a site I switched over to use semicolons, but Google didn't grab any of the dynamic pages. I switched it back to ampersands, and the next day Google tried to grab some semicolon pages, whatever that means.
3:38 pm on Sept 22, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:May 29, 2003
posts:166
votes: 0


Check logs for googlebot at that page, if don't, consider something like mod_rewrite
4:34 pm on Sept 22, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member googleguy is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Oct 8, 2001
posts:2882
votes: 0


That looks pretty good to me, guillermo5000, but I'll try to ask around as well. Yeah, judging from the results for
inurl:ikonboard inurl:act
it's at least possible--I see lots of similar url patterns indexed.

If you want other search engines to crawl you, you might thing about what another poster suggested too--having static-looking urls might help for other engines. But I think you'll be fine for Google.