| Robots.txt exclusion
Google keeps crawling page |
anxvariety
msg:1526552 | 8:30 am on Apr 19, 2004 (gmt 0) |
In my robots.txt file I have: User-agent: *
Disallow: alert.asp Google keeps crawling this page and has it indexed.. anyone know why? Thanks
|
barn_de
msg:1526553 | 2:27 pm on Apr 19, 2004 (gmt 0) |
Hi anxvariety, i would change it to Disallow: /alert.asp add the slash to the filename. barn
|
|
|
