Welcome to WebmasterWorld Guest from 54.147.63.124

Forum Moderators: incrediBILL

Message Too Old, No Replies

     

wayne_c

1:25 pm on Jan 10, 2001 (gmt 0)

Inactive Member
Account Expired

 
 


Hello i was wondering what would be the best way to compile the "?" on an asp page . I ahve been told that spiders , once they see it will leave since they dont understand that symbol. so how can i set it up so they will be able to pass on through the site with that problem
Thanks

Wayne

GWJ

2:57 pm on Jan 10, 2001 (gmt 0)

Full Member

joined:June 21, 2000
posts:339
votes: 0


Hi Wayne,

Welcome to WebmasterWorld. I am sure someone will give you more detailed information. I have always heard the same thing. So much that when getting ready to go to dynamic product pages that I spent way to much time thinking of alternate ways to get spidered.

Then last night I was checking my rankings. I got to Yahoo. I clicked on the "more results" to see what pages were in thier DB and what do I see? [mydomain.com...] So now I am scratching what hair I have left on top of my head, confusion set in.

Brian

wayne_c

2:58 pm on Jan 10, 2001 (gmt 0)

Inactive Member
Account Expired

 
 


Thanks for the reply , lets hope someone can help us out here

Cheers

scberg

11:31 pm on Jan 10, 2001 (gmt 0)

Inactive Member
Account Expired

 
 


I was told that submitting ASP pages to spiders could cause a problem. I do not see why. I am not submitting any querystrings attached to the asp. Just a simple URL like www.domain.com/page.asp. [url edited by tedster] Anyone ever hear of this?

Regards,

Shawn Berg

Edited by: tedster

11:56 pm on Jan 10, 2001 (gmt 0)

Senior Member

WebmasterWorld Senior Member tedster is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:May 26, 2000
posts:37301
votes: 0


This thread [webmasterworld.com] has 6 or seven excellent links to discussions about dynamic URLs and some resources for dealing with them.
Hope you can find something helpful there.

GWJ

12:31 pm on Jan 11, 2001 (gmt 0)

Full Member

joined:June 21, 2000
posts:339
votes: 0


Thanks for the pointer Tedster. NT server here.
12:45 pm on Jan 11, 2001 (gmt 0)

Administrator from GB 

WebmasterWorld Administrator engine is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:May 9, 2000
posts:22318
votes: 240


I'd just add, in short, spiders will stop at asp because of the infinite number of possibilities and the spider would simply lock-up.

I'd suggest static html pages for the key aspects (doorways). This is not spamming if you construct the pages to reflect the content - spamming is abusing it with many, many pages of doorways delivering little or no content.

Woz

11:46 pm on Jan 11, 2001 (gmt 0)

Senior Member

WebmasterWorld Senior Member woz is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Aug 13, 2000
posts:4823
votes: 0


As I understand the situation,

Search Engines do not have any trouble with the ASP suffix, it is the ? that follows that causes the problem. The "?" signifies that the content of the page could change at any time depending on the cirteria specified after the "?". Hence, and engine says, this could create an "infinite number of possibilities"

Imagine if you will coming to a crossroad and asking your navigator which way to turn. Your navigator then says "Well if you want to go to London, turn left, but if you want to got to Paris, straight ahead, but if you want to go to Milan, turn right, but if you want to go to Sydney, turn hard right, but if you want to go to ....."

Thats the same as the "?".

One solution is to write scripts that rewrite the dynamic pages as static pages, either on the fly or on a schedule. (this is beyond me at the moment..)

Another solution is to set up static doorway pages as engine suggests, and these can be asp pages.

Lets suppose you are setting up a directory. You would need to set up pages for each section of the directory that automatically gets the first set of information and sets up links for a true dynamic page that retrieves the subsections. Or a page that automatically gets the first 10 results with a link for the next ten results. Of course you decide how far down into the directory you go with your "autodoorway pages". It is important however that these intro pages do not have the "?" and that the information qualification information is hard coded into the ASP code.

The analogy is coming to a crossroad and seeing a sign that says "Turn Left for UK cities, Straight ahead for European Cities, Right for Asian Cities, and Hard Right for Australian cities and prepare for a long swim...."

After travelling down the UK road a little you then come to a crossroad where the navigator asks "London? Brmingham? Glasgow? etc"

Follow? Help? Hope so.

Onya
Woz

scberg

11:55 pm on Jan 11, 2001 (gmt 0)

Inactive Member
Account Expired

 
 


I didn't think that the ASP extension would cause any problem. Do you know for sure that this is the case? If not I will need to resubmit all the pages I submitted yesterday.

Thanks,

Shawn

Woz

1:21 am on Jan 12, 2001 (gmt 0)

Senior Member

WebmasterWorld Senior Member woz is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Aug 13, 2000
posts:4823
votes: 0


scberg
>I didn't think that the ASP extension would cause any problem. Do you know for sure that this is the case?

page.asp - no problem
page.asp?criteria=something - problem

Onya
Woz