homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

from Internap

 9:49 pm on Jun 9, 2014 (gmt 0)

Caught a dozen HEAD requests for image files from the UA: ICAP-IOD
No robots.txt request. All these files are noindexed via X-Robots-Tag (of course the file header would need to be read for the tag to be found.)

ICAP-IOD making requests from Internap: -

Regardless of intent, I blocked them via UA and IP range.

Other Internap ranges I have blocked are: - - - - - - - -



 4:36 am on Jun 10, 2014 (gmt 0)

Last June and October I found various HEAD requests from internap , actually a "Private Customer" INAP-SJE-PALOALTOTECHOPS -
in this net
Internap Network Services Corporation PNAP-SEA-BLOCK4 -

Not the same UA though, it was "'Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; Trident/5.0)'" (yes, with the extra single quote).


 5:03 am on Jun 10, 2014 (gmt 0)

Thanks for the info and additional range.


 5:54 am on Jun 10, 2014 (gmt 0)

I have more ranges, they don't involve this UA and they aren't noted as "HEAD" requests so I didn't include them all before.

This list is from last January here in the forum:
Internap: - - - - - - - - - - - - - - - - - -

And a few more from my big list and some log notes:
Internap Network Services Corporation (PNAP) -
INTERNAP-SEA (NET-206-253-192-0-1) -


 8:42 am on Jun 10, 2014 (gmt 0)

Great, thanks again


 5:05 pm on Jun 10, 2014 (gmt 0)

yes, with the extra single quote

I see those superfluous quotation marks now and then. (Query: Does there exist any legitimate UA that either begins or ends with a quotation mark?) It now occurs to me to wonder if the originator is copy-and-pasting from some standard UA list, and accidentally included the enclosing quotes.

Global Options:
 top home search open messages active posts  

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved