Does anyone have the IP for this spider? Fitlering spider1.portalb.com, etc. doesn't work.
-Lee
msgraph
9:30 pm on Oct 31, 2001 (gmt 0)
Hi Leer555, and welcome to WebmasterWorld!
IP for spider1.portalb.com is 209.10.169.15
Not sure how many versions there are.
Here is some more info.... www.robotstxt.org/wc/active/html/portalb.html
Leer555
9:45 pm on Oct 31, 2001 (gmt 0)
Thanks. I just tried that IP and I'm still getting hits. Any other suggestions? Its very aggressive.
-Lee
Will
10:48 am on Nov 1, 2001 (gmt 0)
Leer - are you trying to block this spider? If so, most servers are configured by default so that you can check the IP address being used. If your server is recording the hostname, odds are you will also be able to access the ip.
volatilegx
7:47 pm on Nov 1, 2001 (gmt 0)
209.10.169.15
(oops just noticed somebody already posted the IP :) )
However I did also come up with
209.10.169.16 209.10.169.17
Leer555
3:17 pm on Nov 6, 2001 (gmt 0)
I want to filter the spiders from my Webtrend reports. I've been going through the logs manually to get the IP addresses.