Welcome to WebmasterWorld Guest from 22.214.171.124
Forum Moderators: martinibuster
I also use it to get an exhaustive list of URLs for a domain (my client, a competitor, etc.) which I can then feed into a PHP tool that I wrote to request each URL and extract key elements from the resulting URLs including like <title>, <h1>, meta description, meta robots, meta keywords, etc. and write them to a CSV file so it can be loaded into Excel to be further processed and evaluated.