homepage Welcome to WebmasterWorld Guest from 50.17.79.35
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Visit PubCon.com
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
Elisabot 1.0 user agent and IP information
keyplyr




msg:4668406
 6:16 pm on May 4, 2014 (gmt 0)



UA: Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.0) (Elisabot 1.0 unforgettable)
Robots txt: no (or I didn't detect it)
Host: xs.nl 80.246.176.0/20

 

incrediBILL




msg:4668613
 2:07 pm on May 5, 2014 (gmt 0)

Robots txt: no (or I didn't detect it)


It's quite common these days for the robots.txt probe to be a blank user agent and possibly a different IP due to cloud networks or shady crawlers using proxies.

Expand your search :)

lucy24




msg:4668647
 4:27 pm on May 5, 2014 (gmt 0)

Is "unforgettable" part of the UA string? I used to have an "And the winner is..." thread for names like that :)

### it, Elisabot, now I've got an earworm.

keyplyr




msg:4668671
 6:20 pm on May 5, 2014 (gmt 0)



Is "unforgettable" part of the UA string?

Yup... as posted.

keyplyr




msg:4671213
 8:28 am on May 15, 2014 (gmt 0)



It's quite common these days for the robots.txt probe to be a blank user agent and possibly a different IP due to cloud networks or shady crawlers using proxies.

Expand your search :)

Well, first I'm aware of that.
Second, blank UAs get blocked.
And lastly, I have a bit of code that pulls all requests for "whatever" and no request was detected from IP or zone related to this agent.

Hence... what I posted :)

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved