Crawlers and protected directories

Forum Moderators: open

Message Too Old, No Replies

4:52 pm on Apr 29, 2009 (gmt 0)

Hi there,

Just a quickie ...

When an IIS folder has anonymous authentication disabled and Windows authentication enabled, can bots still crawl those folders?

Thanks!

2:38 am on Apr 30, 2009 (gmt 0)

nope

2:12 pm on Apr 30, 2009 (gmt 0)

... unless they have the correct credentials for authentication and access.

9:28 pm on Apr 30, 2009 (gmt 0)

Most bots can't log in.

4:59 pm on May 6, 2009 (gmt 0)

Great, thanks!