hakre - 3:49 pm on Mar 3, 2003 (gmt 0) hi larry_c, some very nice spiders ;) only crawl your site if they find a robots.txt. so it's good to have one allowing what should be allowed.
hi larry_c, some very nice spiders ;) only crawl your site if they find a robots.txt. so it's good to have one allowing what should be allowed.