Forum Moderators: goodroi

Message Too Old, No Replies

https on google and robots.txt

         

concepts99

3:26 pm on Jan 23, 2007 (gmt 0)

10+ Year Member



I found an earlier post here on how only google will recognize a string in robots.txt to block https SSL content.

I can no longer find it, does anyone have any info on this or is it really possible to block the https via robots.txt in google?

goodroi

1:54 pm on Jan 24, 2007 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



I think you might be referring to Google allowing pattern matching aka wildcards in robots.txt. [google.com...]