ASP site maps

[Ronnie]

Hi
I'm thinking about using the asp FileSystemObject as a way of building the navigation for a customer's website í.e. they can drop articles in a folder and the navigation will update automatically.

What i need to know is

1, Will Google and other search engines spider the linked pages
2, How do i detect the page title of the linked page

Thanks

[Dijkgraaf]

Well all any spider will see is what you actually server up to them. So if your asp code serves a generated page with links in them, then the spiders will see those links.

You would have to parse the file and extract the text between the title tags. I would recomend doing this in such a way so that it only has to do it the first time it detects a new file, and store it in a database table with the lookup key of the file name.