homepage Welcome to WebmasterWorld Guest from 54.205.119.163
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Subscribe to WebmasterWorld
Visit PubCon.com
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
Electricfiber.net
Nuance/Tegic Linguistics Team
keyplyr




msg:4441616
 7:20 pm on Apr 16, 2012 (gmt 0)

Electricfiber.net is on several black lists.

UA: "Python-urllib/2.6" for robots.txt
UA: "Nuance/Tegic Linguistics Team" for HTML files.


Sidera/electricfiber.net
67.208.160.0 - 67.208.191.255
67.208.160.0/19

 

dstiles




msg:4441690
 10:19 pm on Apr 16, 2012 (gmt 0)

Interesting. I have the range listed since last June as business broadband (probably including statics?) and haven't seen any adverse action since that time.

The UAs you mention should have triggered warnings/blocks if they showed up.

keyplyr




msg:4441716
 11:41 pm on Apr 16, 2012 (gmt 0)


The UAs you mention should have triggered warnings/blocks if they showed up


The "Python*" UA got through because I allow all to get robots.txt. That's all it asked for. The "Nuance/Tegic Linguistics Team" got 1 page then its behavior triggered a block (using requested URI as referring URI.)

dstiles




msg:4442170
 9:01 pm on Apr 17, 2012 (gmt 0)

Sorry, keyplr, I meant MY traps should have warned ME about the UA. I got a bit careless there. :(

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved