Msg#: 1939 posted 12:19 pm on Feb 25, 2003 (gmt 0)
I have developed a page named www.mydomain.com/login.asp. Basically i need to know the best way to submit this to the search engines. i know that SE robots will not index URL's when they are followed by a question mark (i.e. www.mydomain.com/login.asp?country=us) but does this same rule apply to simple .asp pages?
Msg#: 1939 posted 12:41 pm on Feb 25, 2003 (gmt 0)
You can use questionmarks just fine. Just not a ton of variables, is all.
You may run into trouble with a pagename like "login.asp" for the simple fact that the Googlebot is pretty smart and it might realize that since it's a robot, it can't possibly login, so it may not bother with that page.
Well, you have to link to the url from a page it has already found. There is no magic. The spider will not try all possible permutations of parameters.
But, if it spiders a page and sees a link to a dynamic page with, say "...?page=3&sn=a", then it will probably spider that page. If you have another page with "...?page=3&sn=b", but the spider never sees a link with those parameters, that page will not be spidered or indexed.
Yeah, you need some sort of a crawlable map not a search box or anything like that. If you look at the site in my profile, you'll see I've got "What's New" stuff on the middle of the front page along with links to a MAP page for each type of thing sorted by newest updates to oldest. The bot moves along this map to find stuff.