Forum Moderators: phranque

Message Too Old, No Replies

Extracting URL from Database Id

Need Friendly URL

         

jimmartinji

1:10 pm on Jul 16, 2005 (gmt 0)

10+ Year Member



I want to extract links and all the URLs from a site. But since all the URLs are listed under a Database with an Id, I cant capture them in bulk. For eg. of the URL is [rhode-island.uscity.net...] I want to get all the URLs hidden inside those IDs, like in this eg. probably from 0-2000. How can I extract the url from these Ids from the db and use it?
I am just hunting desperately over so many forums and I found a similar query in this forum.
Can anybody help? I am lost.

arran

1:17 pm on Jul 16, 2005 (gmt 0)

10+ Year Member



You will have to find which page(s) these URLs are referenced from. Once you have identified these pages, you can write a parsing script to capture the complete list of URLs.

Another solution would be to use brute force - write a script that loops round and tries to to access example.com/blah.php?id=x where 0 < x < 10000. If the page exists, record it.

You're not allowed to drop URLs on this forum.

jimmartinji

1:50 pm on Jul 16, 2005 (gmt 0)

10+ Year Member



Thank you very much for the solution arran. but the thing is i m not at all a programmer. i m into content management and development. and so i obviously would not know the scripting procedures. however i will try to find out from my friends who are programmers about the term 'parsing'. but if you can give me a solution in a layman's terms and tell me in simple words i would be happier.
anyways thanks once again.