Yadows Crawler

Forum Moderators: open

Message Too Old, No Replies

here's a new one

2:16 pm on Jul 6, 2005 (gmt 0)

UA: "YadowsCrawler (http://www.yadows.com)"
IP: 213.186.46.88

3:21 am on Jul 7, 2005 (gmt 0)

I've seen this one for a few weeks, really have not looked at though, thanks for the info.

3:53 am on Jul 7, 2005 (gmt 0)

The site looks really, well, um, new and incomplete. ;)

Was their bot well behaved?

8:20 am on Jul 7, 2005 (gmt 0)

Was their bot well behaved?

It seemed to do a good job, I have now blocked it via robots.txt and we'll see if the bot obeys it.