Toggle navigation
Dashboard
Dashboard Tracker
Add / Edit My Forums
System Announcements
Discussion
Active Thread Feed
Top Threads Today
Top Threads This Week
Top Threads Library
Go!
View All
View All
Login
Logout
Home
Forums Index
General SEO Issues
/
Crawler, Spider, and User Agent ID
8:24 pm May 4, 2026
This page requires javascript.
Forum Moderators:
open
Message Too Old, No Replies
imrd
Pfui
Msg#:4167407
8:40 pm on Jul 9, 2010
(gmt 0)
67.23.121.23*
imrd/1.0 tobor@imrd.com
robots.txt? Yes BUT this self-propelled data miner promptly ignored it --
Day One
09:30:48 /robots.txt (200)
09:31:00 / (403)
Day Two
06:27:09 /robots.txt (200)
06:27:48 / (403)
keyplyr
Msg#:4167485
12:14 am on Jul 10, 2010
(gmt 0)
SliceHost 67.23.0.0/19
Pfui
Msg#:4167545
1:56 am on Jul 10, 2010
(gmt 0)
GMTA:) 67.23.0.0/19 also includes .cloud-ips.com, an increasingly (in)famous hide-behind.
Related block-worthy 'slices' --
67.207.128.0/19
(includes)
.slicehost.net
.slicehost.com
173.45.224.0/19
Slicehost.com rWHOIS is (wait for it) --
72.32.0.0/16
(.rackspace.com)
Those companies' CIDRs are all over the place but the above earned spots on my "Worst" list.
keyplyr
Msg#:4167584
5:04 am on Jul 10, 2010
(gmt 0)
Thanks Pfui. Had all the Slicehost ranges but not their rackspace home.
Pfui
Msg#:4167816
7:49 pm on Jul 10, 2010
(gmt 0)
One more for good measure...
174.143.91.224/27
(.rackspacecloud.com)
(After
AWS
[webmasterworld.com], methinks "cloud" in any Hostname warrants redirecting.)
keyplyr
Msg#:4167818
8:08 pm on Jul 10, 2010
(gmt 0)
Excellent, thanks
dstiles
Msg#:4167845
9:52 pm on Jul 10, 2010
(gmt 0)
The whole of 174.143/16 is rackspace. Not known to me before so thanks for the heads-up, pfui! :)
For SliceHost I have:
67.23.0.0-67.23.47.255
173.45.224-173.45.255.255
208.78.96.0-208.78.103.255
209.20.64-209.20.95.255
For Rackspace (may include slicehost ranges):
67.192.0.0-67.192.255.255
67.207.128.0-67.207.223.255
69.20.0.0-69.20.127.255
72.3.128.0-72.3.255.255
72.32.0.0-72.32.255.255
74.205.0.0-74.205.127.255
89.234.0.0-89.234.63.255
92.52.64.0-92.52.127.255
94.236.0.0-94.236.127.255
98.129.0.0-98.129.255.255
173.203.0.0-173.203.255.255
174.142.0.0-174.143.255.255
204.232.128.0-204.232.255.255
212.100.224.0-212.100.255.255 (this one in UK)
Join The Conversation
Register
For Free! -
Become a
Pro Member
!
See forum categories
-
Enter the Forum
Moderators and Top Contributors
Moderator List
| Top Contributors:
This Week
,
This Month
,
Apr
,
Mar
,
Archive
,
Top 100 All Time
,
Top Voted Members
Hot Threads This Week
April 2026 Google Search Observations
May 2026 Google Search Observations
AdSense Earnings and Observations - April 2026
AdSense Earnings and Observations - May 2026
I'm having some ranking issues after changes
what do they want?
I need some SEO help
picture code for responsive headerimage and preloading it
SEO question
Quite quiet in here, anyone know why?
Home
Forums Index
General SEO Issues
/
Crawler, Spider, and User Agent ID
8:24 pm May 4, 2026