homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum


 10:18 pm on Jan 21, 2009 (gmt 0)

Didn’t raise any flags but just happened to see this in the log:

Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv: Gecko/2008120122 Firefox/3.0.5 (.NET CLR 3.5.30729)

172.19.35.xx (, IANA-BBLK-RESERVED)

No reverse DNS and did not read robots

Came in on the root domain and navigated to a “History” page keeping the previously established session – behaved like a human.

Just curious, does IANA make it a practice to either spider sites or browse sites? Maybe just an employee at IANA hitting the site? Maybe another IANA hack?




 2:42 am on Jan 23, 2009 (gmt 0) to is a private IP range, no? Someone on the same local network as the server? It's not from IANA as such, as the IP range is not routable on the public internet.


 3:35 am on Jan 23, 2009 (gmt 0)

Yes, the proper reading of the WHOIS record is, "Reserved by IANA for use in private networks." As encyclo said, it is an unroutable IP address range, just like 192.168.x.x and 10.x.x.x (and several others), and is reserved for use inside a LAN, similar to the way that 127.x.x.x is reserved for 'loopback' within a single machine. These addresses cannot pass through routers; They are meant only for use inside LANs. The reason they are not routable is so that anyone and everyone can use these ranges for their private networks; If they were routable, there would be a massive number of "collisions" because so many LANs use them.

OK, so that was about five ways to say the same thing... :)

So, it appears that someone at your hosting company is navigating your site from inside their network.



 10:54 am on Jan 23, 2009 (gmt 0)

in the log
access_log or output from your statistics program?

That IP is most likely extracted from X-Forwarded-For. Please throw away your buggy statistics program!

Global Options:
 top home search open messages active posts  

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved