TeragramCrawler

how to block this search engine crawler

[mswiryn]

Anyone have experience with TeragramCrawler? This bot is crawling my site so fast and often that it is having a severe impact on performance. I tried blocking it with the standard stuff in the robots.txt file, but no luck.

Anyone have ideas on how to get this bot to stop crawling your site?

Anyone have the url to the TeragramCrawler site?
thx

[wilderness]

Nobody will be able to assit you unless you provide the full IP and the UA?

[Pfui]

mswiryn, if you Google TeragramCrawler, you'll find good info -- in a January, 2006, WebmasterWorld thread.

(What goes around, comes around:)

Looks like you'll need to use more than robots.txt to make it go away. What's your server software?