Welcome to WebmasterWorld Guest from 188.8.131.52 , register , free tools , login , search , subscribe , help , library , announcements , recent posts , open posts Subscribe to WebmasterWorld
CrawlConvera0.1 CrawlConvera@yahoo.com Has anyone seen CrawlConvera? Recognize it? cjtripnewton msg:904783 2:45 pm on Apr 13, 2004 (gmt 0) Just spotted CrawlConvera0.1 CrawlConvera@yahoo.com in my logs. Does anyone have any info about it?
dcrombie msg:904784 6:31 pm on Apr 13, 2004 (gmt 0)
I think it's fairly new (not many G matches) - I'd start at convera.com:
CONVERA BRW-11953-CONVERA 184.108.40.206 - 220.127.116.11
Pikin_It_Up msg:904785 6:33 pm on Apr 27, 2004 (gmt 0)
CrawlConvera0.1 just crawled my site yesterday.
Been to Convera.com but it doesn't give a lot away.
Anyone else have any clues on what the spider is used for?
silentlamb msg:3606504 4:53 pm on Mar 20, 2008 (gmt 0)
Yes, they harvest information from your site for "vertical searching". I work for a university and we've caught them reselling our professor's research in this manner. For this reason, their robot is specifically disallowed from crawling our site. Despite that, they continue to crawl us. I'd totally label them as a "bad bot".