homepage Welcome to WebmasterWorld Guest from 54.161.191.254
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
AOL spider?
ACB998C0.ipt.aol.com
icehousedesigns




msg:398585
 1:21 pm on Jun 6, 2001 (gmt 0)

ACB998C0.ipt.aol.com ( 172.185.152.192 ) came last night and grabbed 1 file, my robots.txt and left.

acb998c0.ipt.aol.com - - [06/Jun/2001:05:06:35 -0400] "GET /robots.txt HTTP/1.1" 200 171

America Online, Inc. (NETBLK-AOL-172BLK)
12100 Sunrise Valley Drive
Reston, VA 20191
US

Netname: AOL-172BLK
Netblock: 172.128.0.0 - 172.191.255.255
Maintainer: AOL

Coordinator:
America Online, Inc. (AOL-NOC-ARIN) domains@AOL.NET
703-265-4670

Domain System inverse mapping provided by:

DAHA-01.NS.AOL.COM152.163.159.233
DAHA-02.NS.AOL.COM205.188.157.233

ADDRESSES WITHIN THIS BLOCK ARE NON-PORTABLE

Record last updated on 28-Mar-2001.
Database last updated on 5-Jun-2001 22:54:32 EDT.

> ping 172.185.152.192
172.185.152.192 is alive

> traceroute 172.185.152.192
traceroute to 172.185.152.192 (172.185.152.192), 30 hops max, 40 byte packets
1 portr1 (205.219.188.1) 1.036 ms 1.169 ms 0.788 ms
2 Serial3-4.GW3.BOS1.ALTER.NET (157.130.222.185) 6.634 ms 6.592 ms 6.679 ms
3 126.ATM2-0.XR2.BOS1.ALTER.NET (146.188.177.222) 6.900 ms 6.803 ms 6.686 ms
4 190.at-1-1-0.TR2.NYC8.ALTER.NET (152.63.20.174) 14.597 ms 27.863 ms 14.616 ms
5 124.at-6-2-0.TR2.DCA8.ALTER.NET (146.188.141.189) 23.039 ms 19.798 ms 20.091 ms
6 0.so-4-3-0.XR2.DCA8.ALTER.NET (152.63.144.30) 20.354 ms 23.716 ms 20.175 ms
7 188.ATM6-0.GW1.IAD1.ALTER.NET (152.63.36.237) 20.900 ms 19.967 ms 19.739 ms
8 pop1-rtc-P4-1.atdn.net (204.148.98.25) 20.804 ms 21.042 ms 20.536 ms
9 204.148.97.81 (204.148.97.81) 24.103 ms 21.149 ms 21.369 ms
10 bb1-vie-P2-0.atdn.net (204.148.103.54) 17.950 ms 17.249 ms 17.928 ms
11 bb1-nye-P1-0.atdn.net (204.148.98.250) 21.846 ms 21.694 ms 22.463 ms
12 bb2-nye-P6-0.atdn.net (204.148.101.218) 21.905 ms 21.640 ms 21.520 ms
13 bb2-fra-P3-3.atdn.net (64.236.2.158) 105.701 ms 105.748 ms 105.642 ms
14 pop4-fra-P6-1.atdn.net (204.148.103.142) 105.827 ms 105.605 ms 105.751 ms
15 accessf2-fra-P0-1.atdn.net (198.81.1.54) 105.966 ms 106.359 ms 105.825 ms
16 supportf1-fra-P0-1.router.aol.com (195.93.68.46) 106.071 ms 105.952 ms 105.801 ms
17 rt-fra06.proxy.aol.com (195.93.64.225) 107.373 ms 106.002 ms 106.741 ms
18 ACB998C0.ipt.aol.com (172.185.152.192) 152.082 ms 174.475 ms 174.613 ms

Added:

Found this at webmaster.aol.com

AOL Client IP Addresses

172.128.0.0/10 202.67.64.0/19 195.93.0.0/17 64.236.128.0/17

Maybe just a user running a spider?

 

bobriggs




msg:398586
 1:52 pm on Jun 6, 2001 (gmt 0)

Just somebody wanting to see your robots.txt. AOL will use those types of IP addresses if a user is connected to AOL and using a browser other than the one built in the AOL software.

If the visitor shows something like:
cache-ntc-aa08.proxy.aol.com, then the visitor is using the built in browser.

I have an AOL account and I can see this in my logs.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved