Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Looking for complicated borderline Robots.txt
Brett_Tabke - 2:48 am on Apr 5, 2001 (gmt 0)Thread source:: http://www.webmasterworld.com/robots_txt/99.htm
If anyone has some really complex Robots.txt, they would send me for running through the new validator over at the other site, I would appreciate it. . Need some test foder...
Brought to you by WebmasterWorld: http://www.webmasterworld.com