Forum Moderators: coopster
Long shot this one..
I have a 1000+ page links directory that is php based. I regularly create manually generated html mirror pages for purposes of increase search engine visibility. The time overhead on this process is a problem.
Does anyone know of any software which will take the source from a dynamically generated site, create a html doc from it and then ftp it back to the parent domain, creating a html mirror.
Process should be automated and regular.
Any options?
Dave
we do the same using the programme wget and a cronjob.
wget is like a website copier - you give it the starting url and it runs through all links it finds and save the pages in the directory you specify.
i only know how to do this with linux, but i am sure it would be possible with windows too.
just to whet your appetite - wget runs through all 500 pages of our site and saves them to our /htdocs folder in under a minute ;-)
you could then use a cronjob to run it automatically once a day
p.s. be careful about javascript links to pages (e.g. pop-ups) - wget can only follow standard links. you might have to manually specify other links