XML sitemap geneatation for PHP Dynamic Big website!

[sandeep india]

Hi,

My site have page over 100,000 & increasing day by day. I am using htaccess so there is no directory. also the Xml-sitemap generators scripts is not working showing the memory errors because the data is too much.

Do you know any Idea how to make the xml sitemaps. also is there any technique so that i dont hav to make sitemap again & again rather I can append the new links to existing sitemap.

Any help is really appreciated.

Regards
Sandeep

[OMZen]

Here's your homework :)

[google.com...]

( personally, i use Gsitecrawler )

[rocknbil]

You use no directories, so I am presuming it is database-based.

Use the same methods you use to parse URL's from the .htaccess. That is, remember the goal is to generate valid URL's. So if you have something like

rewrite_rule ^Green\-Widets$ somescript.php?cat=1234

Your sitemap script should generate

http://example.com/Green-Widgets

as the sitemap URL.

You basically want to parse all the active items in your database. Start by category, drill down to specific products/pages, making sure if you have an inactivated filed to skip any inactive URL's. Then at the end (or beginning) pick up any static pages that may exist that are not part of the dynamic page sets.