Welcome to WebmasterWorld Guest from 18.104.22.168
I can't find ANY info on this IP... the OS is undefined, it doesn't seem to register any concrete browser info, and there's no referrer. A traceroute traced it back to it's own IP... no name on the server.
Here's a clip of one of it's hits from my access logs: 22.214.171.124 - - [06/Dec/2000:07:22:59 -0900] "GET //main.html HTTP/1.1" 200 2848 "-" "Mozilla"
Does anyone have ANY idea who this obnoxious little beast is? Is it someone important, or should I just ban it from my site?
"I have notified the client, Employon.com, and they have stopped this activity. Employon.com is developing spiders which search for companies that post their jobs on the internet, and I'm told that they inadvertently
launched an errant spider, which was operating on a domain database that included your domain. Please let me know if this behavior persists, and I will take additional action.
Digibahn Tech Support"
If you see any super obnoxious 63.X IPs spidering your sites, and reverse IP lookup points to digibahn.com, it's probably the same folks (Employon.com)... But Digibahn is very responsive to the problem!
Netblock: 126.96.36.199 - 188.8.131.52
If they do it again I'd go to grassisgreener.com and right a letter claiming that they are doing a DOS attack. They'll be nice to you after that and exclude your IP out of their crawling.
I sent the same letter to grassisgreener.com... haven't heard back from them. Perhaps the NIC technical contact hadn't the foggiest idea what I was talking about?
Since Digibahn (the ones who seem to be "top dog" over the IP block in question) were so quick to respond, and offered to "take further action" if necessary, I'll probably go to them first if the spider is back tomorrow and just Cc: a copy of the message to grassisgreener.com If Digibahn is in the position to stomp on grassisgreener, they're the ones I want to talk to.
Funny, I always thought that the most obnoxious bots were generally looking for email addresses... now it's job listings.