Forum Moderators: open

Message Too Old, No Replies

New Yahoo Crawler?

         

Marval

1:00 pm on Apr 13, 2004 (gmt 0)

10+ Year Member



Just noticed this this morning - did a site search and can't find any info on it - wondering it's purpose?
CrawlConvera0.1 CrawlConvera@yahoo.com

robotsdobetter

4:24 am on Apr 14, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I seen the same thing, but I don't think it's Yahoo. It comes to my sites all the time and it seems to go by the Robots.txt rules. It doesn't crawl my site to hard.