Forum Moderators: goodroi

Message Too Old, No Replies

robots.txt and SSL

         

AlpacaAnnie

5:46 pm on Jan 11, 2006 (gmt 0)



Hello,
I feel really baffled by, what appears to be, and issue with bots and spiders looking past my site because I have installed an SSL cert on the "whole" site. I have done this extra step for the comfort factor of my customers. The validator does not like https: protocol in it's validation. I seem to be having issues relating to this. Can anyone shed light here?

Lord Majestic

5:58 pm on Jan 11, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Generally bots and spiders prefer to avoid HTTPS links - what exactly is your problem with the bots?

mycutegoddess

8:24 am on Feb 3, 2006 (gmt 0)

10+ Year Member



And what about robot have indexed our https version? Generally in my log file it seem that some robot request pages vie port 443 regularly...

Any suggestions will be appreciate...