How do I count the number of URLs on my domain?

Counting static and dynamic pages

[perf1]

I have a question for you kind folks:

Given I have a domain which contains both static and dynamic pages (and thus some URLs have dynamic parameters), does Apache have any means of telling me what all the LEGAL URLs are for my site? I'm trying to figure out exactly how many URL's I have on my domain, and I'm new to Apache.

Obvious question: is there any way to get around knowing what are all the legal combinations of parameters to a given script? Does apache have a running log of what all the non-404 pages it has ever served are (or can I process that information from some log?)?

Thank you!

[jdMorgan]

Even log files are rotated out every day, week, or month.

The only entity that 'knows' what dynamic URLs exist is the script that you use to generate those dynamic pages -- the information exists in the database that underlies that script.

I don't know of any easy way to count the existing URL and attached query string combinations. I suppose you could set a spider loose on the site and wait for it to spider the whole thing to find out... Something like Xenu Link Sleuth, for example.

Jim

[g1smd]

Xenu LinkSleuth could give you a list of all URLs that it can see.... but more than a few thousand will take a very long time to produce a report...