mogwai - 9:35 am on Jan 24, 2004 (gmt 0)

Hi all,

My robots.txt is very basic and valid and it doesn't cause problems for other bots so I don't think its keeping slurp out.

I checked another sites logs and found that slurp is indexing pages with (Slurp/cat) and robots files with (Slurp/si).

Looks like I need to wait for Slurp/si's big brother to visit. Hopefully it's only a matter of time.

Cheers