Forum Moderators: mack

Message Too Old, No Replies

How do I find all the URLs on my website

         

TravelDog

7:07 pm on Mar 1, 2005 (gmt 0)

10+ Year Member



Hello,

I have 4 large websites over 4000 pages each from which I need to get all the URLs into a spreadsheet.

Is there an easy way to do this other than to copy and paste forever?

Maybe a URL only google command or another trick?

TD

ogletree

7:14 pm on Mar 1, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Do you mean all the URL's that make up your site? Do you want only the ones in Google? Or do you mean all the outgoing URL's on your site?

TravelDog

7:25 pm on Mar 1, 2005 (gmt 0)

10+ Year Member



Sorry yes .. after thinking about it I want to find all the URLs on my websites not just the ones google knows about.

TravelDog

7:27 pm on Mar 1, 2005 (gmt 0)

10+ Year Member



I must have my thick hat on today.

All the URLs on my domain so: www.widget.com www.widget.com/wiget1.htm etc

Corey Bryant

8:15 pm on Mar 1, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



You can use Xenu maybe to check some things but as far as URLs that are not linked - are you able to view your web via an FTP browser or something?

-Corey

TravelDog

8:18 pm on Mar 1, 2005 (gmt 0)

10+ Year Member



Yes I should be able to get FTP..

ogletree

8:26 pm on Mar 1, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Sitemap sofware might help you do this.