Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Mr. Roboto

CaveToad - 3:57 pm on Jan 31, 2001 (gmt 0)


Well, test site #1 was submitted to AV yesterday, it's in the rest fine, it was stalling in AV so hence my interest in the robots file. Now all they have to do is crawl and I'll be ok. I'll post if I come across any revalations with this.

Thread source:: http://www.webmasterworld.com/robots_txt/409.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com