Forum Moderators: Robert Charlton & goodroi

Message Too Old, No Replies

Check specific link structure only?

Find all indexed links after index.php?

         

financialhost

12:26 am on Feb 7, 2006 (gmt 0)

10+ Year Member



Is there a specific way to query Google & possible other engines to see which pages have been indexed or spidered?

I have noticed some URL's appearing from my forums & i do not know where the links originated from - since my forums have suddenly been dropped from the index, i want to rule out duplicate content. An example of one of the URL's is below,

www.widgets.com/forums/index.php?s=5b6278db496c5a852fd2952a88b43203&

What i am looking for is a function to pull all pages that the search engine has listed after www.widgets.com/forums/index.php?

So it might pull back,
www.widgets.com/forums/index.php?3435432432
www.widgets.com/forums/index.php?s=4546543
www.widgets.com/forums/index.php?454uiheuifhui4

For example...

Does anyone know a way i can do that?

Iv'e got way too many pages to go through them all using a site: command.

Any help appreciated