Welcome to WebmasterWorld Guest from 126.96.36.199
Forum Moderators: martinibuster
the challenge is not where the links come from, but rather how they are formatted. You can build a page from a database and include links quite easily, and if they are hard linked as in somesite.com/somepage.htm thet you are OK. But if they are formatted as yoursite.com/link.asp?ID=number, then that is less effective.
Some spiders may follow the links with ?= etc, but they will probably not apply any linking factor in the search algorightm. As an example, have a look at either site in my profile, all the links in the directory sections are geneerated from a databse in real time but they are formatted as hard links.
If you have your links in the HTML portions of the page, search engines don't seem to have much difficulty in finding them.
If you are generating them on the fly based upon input from cookies, the search engine will probably not find them.
Not necessarily. I was actually just investigating how multiple pages of a client's ASP site got crawled by Google.
Try this search [google.com] on Google - you'll see toward the end of the second page URLs ending with .asp?AppID=number, and multiple pages of these were spidered & indexed.
The next step, though, to allow the content to be found by searchers more easily - I'm thinking that when these types of items are input into the database, the <TITLE> and <description> tags should be somehow filled in automatically, so they reflect the content of the page more accurately.
the ability of SE spiders reading dynamic pages all depends on how you build them to write the files, so that dynamic content appears to be static (ie, pulling it into html pages in a short amount of time)
spiders are stupid, but that doesn't mean FAST, inktomi don't have the ability to read past the ? - it is just a matter of resource consumption - that's why you'll see that using PFI programs like Ink's or Fast's will get more dynamic content spidered.
The only reason google will do it is if they deem the pages a 'quality' resource.