twentyfourseven.com is crawling me like ants at a picnic.
I disallowed LinkWalker in robots and they keep on.
I thought I read the other day that they were hurting and going under or something.
littleman
8:14 am on Feb 27, 2001 (gmt 0)
Maybe they laid off their IT department and the bot was left running with no one to stop it?
You could exclude them via htaccess.
Xoc
9:00 pm on Mar 4, 2001 (gmt 0)
What's interesting about 24/7 is that they claim on their site that they don't index graphics. But my server log shows them downloading every graphic on the site. Almost banned them, but didn't.
