homepage Welcome to WebmasterWorld Guest from 54.161.220.160
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
New UA: Mozilla/4.0 (compatible; mark.blonin.bot;)
has a weird Referer
Mokita

5+ Year Member



 
Msg#: 3003644 posted 6:46 am on Jul 12, 2006 (gmt 0)

70.231.34.82 - - [12/Jul/2006:13:48:17 +1000] "GET /robots.txt HTTP/1.1" 200 1749 "Edmond, OK" "Mozilla/4.0 (compatible; mark.blonin.bot;)"

It asked for, and got, robots.txt but nothing else. Googling it only produced other sites' logs/stats. Couldn't see any useful information. Anyone seeing it or know what it is?

 

wilderness

WebmasterWorld Senior Member wilderness us a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



 
Msg#: 3003644 posted 4:58 pm on Jul 12, 2006 (gmt 0)

This caught and old rewrite I had for "ending with" and ate a 403.

fiestagirl

10+ Year Member



 
Msg#: 3003644 posted 8:14 pm on Jul 12, 2006 (gmt 0)

Go to the ip address, and click the link at the bottom of the page. They claim to obey the robots.txt exclusion.

jdMorgan

WebmasterWorld Senior Member jdmorgan us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 3003644 posted 8:24 pm on Jul 12, 2006 (gmt 0)

Obeyed robots.txt here (so far...)

Jim

Mokita

5+ Year Member



 
Msg#: 3003644 posted 11:05 pm on Jul 12, 2006 (gmt 0)

Thanks for the hint fiestagirl! I didn't think of trying to load the IP in a browser.

More specifically for other people loooking for this info, it is the Copyright and Disclaimer link you need to click.

[edited by: Mokita at 11:06 pm (utc) on July 12, 2006]

thetrasher

5+ Year Member



 
Msg#: 3003644 posted 6:44 pm on Jul 13, 2006 (gmt 0)

After that click on "Copyright and Disclaimer" you are on the domain 747seminars.com. Now search for the domain owner. He's living in Minsk, Republic of Belarus. Seems to be just another MFA-page creator.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved