Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Google spidering past secure server


xbase234 - 9:53 pm on Jan 29, 2004 (gmt 0)


The Googlebot has been spidering my client's site, which is hosted on a secure server (string begins with HTTPS), and the legal team wants it out of there.

Anything besides a robots.txt to get rid of Googlebot?


Thread source:: http://www.webmasterworld.com/robots_txt/259.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com