Forum Moderators: goodroi

Message Too Old, No Replies

www.example.com/view.php

How to avoid spidering of anything with this prefix

         

nuevojefe

3:18 am on Sep 17, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



If i've got a site with tons of www.example.com/view.php?id=400%E2%8C%A9=en type of URLs in the index of Y!, MSN and G, is there anything I can add to robots.txt to get them all removed from the index quickly?

LowLevel

10:26 pm on Sep 19, 2004 (gmt 0)

10+ Year Member



A simple:


User-agent: *
Disallow: /view.php

...should work for most search engines.