Forum Moderators: open

Message Too Old, No Replies

ASP Pages

Search Engine Spiders

         

newuser

11:08 pm on Apr 13, 2001 (gmt 0)

10+ Year Member



Hello - Does anyone know how search engine spiders interpret ASP pages? My site uses ASP and has multiple pages that I would like to add Meta Tags to, but will they be spirdered? Thanks in advance!

Woz

11:35 pm on Apr 13, 2001 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Hi newuser,

ASP pages are exactly like any other dynamic page, .php .jsp .shtml .cfm etc., in that they are all spidered normally by the Search Engines as long as there is no "?" in the url. In most cases this will stop the spider, although I believe Google and Alta Vista are spidering URLs with a "?". Someone correct me if I am wrong please.

This is a subject that has attracted ongoing discussion in these fora, check out these threads:-

[webmasterworld.com...]
[webmasterworld.com...]
[webmasterworld.com...]
[webmasterworld.com...]
[webmasterworld.com...]

hope this helps.

Onya
Woz

newuser

11:53 pm on Apr 13, 2001 (gmt 0)

10+ Year Member



Hi Woz,

My ASP pages do use a ? in the URL. Does this mean that they will not be spirdered? That would leave only my main page.

jimmykav

9:57 am on Apr 14, 2001 (gmt 0)

10+ Year Member



My site makes extensive use of ASP pages with arguments in the url link and google is handling them okay.

Woz

10:14 am on Apr 14, 2001 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



newuser,

yes, basically if you have a "?" in your url they won't be spidered with the exception of Google and (I think) AltaVista.

What I do is when setting up a directory is make sure the first page in each catagory does not have a "?" and so will be spidered.

Onya
Woz