I am sure this has been discussed here but would like info on how to make a services site with many pages which are all payment access only by secure login friendly to search engines.
Deab
7:50 am on May 24, 2005 (gmt 0)
I'm still newish to all this, but my initial thoughts..
Well I guess you could check the user agent.. but anyone could fake that. Maintaining a list of crawler ip's would be the next step, but that sounds like a lot of work.