Welcome to WebmasterWorld Guest from 54.226.46.6

Forum Moderators: goodroi

Message Too Old, No Replies

Robots.txt exclusion

Google keeps crawling page

     

anxvariety

8:30 am on Apr 19, 2004 (gmt 0)

10+ Year Member



In my robots.txt file I have:

User-agent: *
Disallow: alert.asp

Google keeps crawling this page and has it indexed.. anyone know why?

Thanks

barn_de

2:27 pm on Apr 19, 2004 (gmt 0)

10+ Year Member



Hi anxvariety,

i would change it to

Disallow: /alert.asp

add the slash to the filename.

barn

 

Featured Threads

Hot Threads This Week

Hot Threads This Month