Yahoo and robots.txt........their own instructions
are confusing!
crobb305
2:02 am on Jan 2, 2005 (gmt 0)
I want to exclude some files, but the instructions that yahoo gives regarding robots.txt suggests that using a leading slash will cause index page to be excluded as well. What do you think?
