Welcome to WebmasterWorld Guest from

Forum Moderators: DixonJones & mademetop

Message Too Old, No Replies

CrawlConvera0.1 CrawlConvera@yahoo.com

Has anyone seen CrawlConvera? Recognize it?

2:45 pm on Apr 13, 2004 (gmt 0)

Full Member

10+ Year Member

joined:May 12, 2002
votes: 0

Just spotted CrawlConvera0.1 CrawlConvera@yahoo.com in my logs. Does anyone have any info about it?


6:31 pm on Apr 13, 2004 (gmt 0)

Inactive Member
Account Expired


I think it's fairly new (not many G matches) - I'd start at convera.com:


"RetrievalWare" ;)

6:33 pm on Apr 27, 2004 (gmt 0)

Junior Member

10+ Year Member

joined:Mar 4, 2004
votes: 0

CrawlConvera0.1 just crawled my site yesterday.

Been to Convera.com but it doesn't give a lot away.

Anyone else have any clues on what the spider is used for?


4:53 pm on Mar 20, 2008 (gmt 0)

New User

5+ Year Member

joined:Mar 20, 2008
posts: 2
votes: 0

Yes, they harvest information from your site for "vertical searching". I work for a university and we've caught them reselling our professor's research in this manner. For this reason, their robot is specifically disallowed from crawling our site. Despite that, they continue to crawl us. I'd totally label them as a "bad bot".

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members