Welcome to WebmasterWorld Guest from 54.205.119.93

Forum Moderators: open

Message Too Old, No Replies

Slurp/cat and Slurp/si

What's the difference?

   
3:01 pm on Jul 11, 2003 (gmt 0)

10+ Year Member



Noticed both crawling my site yesterday.
4:34 pm on Jul 11, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Slurp/si just reads robots.txt, and Slurp/cat does everything else.
 

Featured Threads

Hot Threads This Week

Hot Threads This Month