Welcome to WebmasterWorld Guest from

Forum Moderators: open

Message Too Old, No Replies

Slurp/cat and Slurp/si

What's the difference?

3:01 pm on Jul 11, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Jan 4, 2003
votes: 0

Noticed both crawling my site yesterday.
4:34 pm on July 11, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Mar 31, 2003
votes: 0

Slurp/si just reads robots.txt, and Slurp/cat does everything else.

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members