Page is a not externally linkable
- Advertising
-- Paid Inclusion Engines and Topics
---- Slurp/cat and Slurp/si
mcavic - 4:34 pm on Jul 11, 2003 (gmt 0)
Slurp/si just reads robots.txt, and Slurp/cat does everything else.
Thread source:: http://www.webmasterworld.com/paid_inclusion/2213.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com