Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Robots.txt question

YoungstownWebMan - 1:41 pm on Aug 19, 2002 (gmt 0)


As far as major search engines,

all the major search engines at the latest Search Engone Strategies 2002 conference in San Jose, CA said they all read the robots.txt as that question as brought up.

Scott Emick
WebMaster, Programmer, Analyst
Youngstown, OH

Thread source:: http://www.webmasterworld.com/robots_txt/94.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com