Oops, hmm - Google indexed our robots.txt [google.com]. That's the first time I've ever seen that.
starec
10:56 am on Aug 21, 2001 (gmt 0)
Well, you put a link to it some time ago in one of the forums, didn't you?
(www.webmasterworld.com/forum27/239.htm)
With the pagerank this site has anything that is linked from here gets indexed easily :)
Key_Master
11:17 am on Aug 21, 2001 (gmt 0)
Brett_Tabke, did you add the HTML or did Google?
highman
11:52 am on Aug 21, 2001 (gmt 0)
'Please, no more that 1 hit per minute and use off peak hours.' .... lol, must remember to add it to our robots.txt along with 'please rank us very highly'
It still perplexes me that a robots.txt would be indexed. hmmm
Anyone else got a robots.txt index?
SmallTime
9:38 am on Jun 24, 2002 (gmt 0)
Google, CNN, W3.org, your in good company
Woz
9:40 am on Jun 24, 2002 (gmt 0)
funny, first time I clicked on the link in the first post it came up showing zero responses. Then, on second attempt, it came up. Perhaps still quivering after the aborted update.