| Welcome to WebmasterWorld Guest from 18.104.22.168 |
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
|Become a Pro Member|
Well, you put a link to it some time ago in one of the forums, didn't you?
With the pagerank this site has anything that is linked from here gets indexed easily :)
Brett_Tabke, did you add the HTML or did Google?
'Please, no more that 1 hit per minute and use off peak hours.' .... lol, must remember to add it to our robots.txt along with 'please rank us very highly'
Nah, it's a pure text file KM.
a few links [google.com].
Your robots.txt has got a PR of 4 ;)
It still perplexes me that a robots.txt would be indexed. hmmm
Anyone else got a robots.txt index?
Google, CNN, W3.org, your in good company
funny, first time I clicked on the link in the first post it came up showing zero responses. Then, on second attempt, it came up. Perhaps still quivering after the aborted update.
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved