Forum Moderators: Robert Charlton & goodroi
I have noticed some URL's appearing from my forums & i do not know where the links originated from - since my forums have suddenly been dropped from the index, i want to rule out duplicate content. An example of one of the URL's is below,
www.widgets.com/forums/index.php?s=5b6278db496c5a852fd2952a88b43203&
What i am looking for is a function to pull all pages that the search engine has listed after www.widgets.com/forums/index.php?
So it might pull back,
www.widgets.com/forums/index.php?3435432432
www.widgets.com/forums/index.php?s=4546543
www.widgets.com/forums/index.php?454uiheuifhui4
For example...
Does anyone know a way i can do that?
Iv'e got way too many pages to go through them all using a site: command.
Any help appreciated