Welcome to WebmasterWorld Guest from 54.198.134.32

Forum Moderators: Ocean10000 & incrediBILL & keyplyr

Message Too Old, No Replies

Nokia6300/ (botmobi)

didn't ask for robotos text, has Amazon IP

     
1:26 pm on Jun 22, 2008 (gmt 0)

Preferred Member

10+ Year Member

joined:July 6, 2001
posts:410
votes: 0


This little critter showed up with a default list of directories to scan, and dined on a quick list of 404's for breakfast. The IP is under Amazon.Com. find.mobi/bot.html says it asks for robots.txt, but not that I can see. Haven't seen this one before. I thought bypassing robots.txt seemed a little unfriendly...

67.202.23.* - - [21/Jun/2008:23:49:02 -0400] "GET / HTTP/1.0" 200 5718 "-" "Nokia6300/2.0 (05.50) Profile/MIDP-2.0 Configuration/CLDC-1.1 (botmobi find.mobi/bot.html find@mtld.mobi)"
67.202.23.* - - [21/Jun/2008:23:49:02 -0400] "GET /css/style.css HTTP/1.1" 200 4585 "http://www.exampledomain.com/" "Nokia6300/2.0 (05.50) Profile/MIDP-2.0 Configuration/CLDC-1.1 (botmobi find.mobi/bot.html find@mtld.mobi)"
67.202.23.* - - [21/Jun/2008:23:49:03 -0400] "GET /wap/ HTTP/1.0" 404 1101 "-" "Nokia6300/2.0 (05.50) Profile/MIDP-2.0 Configuration/CLDC-1.1 (botmobi find.mobi/bot.html find@mtld.mobi)"
67.202.23.* - - [21/Jun/2008:23:49:03 -0400] "GET /m/ HTTP/1.0" 404 1101 "-" "Nokia6300/2.0 (05.50) Profile/MIDP-2.0 Configuration/CLDC-1.1 (botmobi find.mobi/bot.html find@mtld.mobi)"
67.202.23.* - - [21/Jun/2008:23:49:04 -0400] "GET /mobi/ HTTP/1.0" 404 1101 "-" "Nokia6300/2.0 (05.50) Profile/MIDP-2.0 Configuration/CLDC-1.1 (botmobi find.mobi/bot.html find@mtld.mobi)"
67.202.23.* - - [21/Jun/2008:23:49:04 -0400] "GET /mobile/ HTTP/1.0" 404 1101 "-" "Nokia6300/2.0 (05.50) Profile/MIDP-2.0 Configuration/CLDC-1.1 (botmobi find.mobi/bot.html find@mtld.mobi)"
67.202.23.* - - [21/Jun/2008:23:49:04 -0400] "GET /imode/ HTTP/1.0" 404 1101 "-" "Nokia6300/2.0 (05.50) Profile/MIDP-2.0 Configuration/CLDC-1.1 (botmobi find.mobi/bot.html find@mtld.mobi)"
67.202.23.* - - [21/Jun/2008:23:49:05 -0400] "GET /xhtml/ HTTP/1.0" 404 1101 "-" "Nokia6300/2.0 (05.50) Profile/MIDP-2.0 Configuration/CLDC-1.1 (botmobi find.mobi/bot.html find@mtld.mobi)

[edited by: incrediBILL at 6:48 pm (utc) on June 22, 2008]
[edit reason] Obscured IPs [/edit]

7:18 pm on June 22, 2008 (gmt 0)

Senior Member

WebmasterWorld Senior Member g1smd is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:July 3, 2002
posts:18903
votes: 0


Odd that it claims to be coming from a Nokia mobile phone too...
8:49 pm on June 22, 2008 (gmt 0)

Senior Member

WebmasterWorld Senior Member jdmorgan is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Mar 31, 2002
posts:25430
votes: 0


It is typical of robots crawling mobile sites (or looking for mobile sites) to spoof a "typical" mobile device such as a Nokia phone. You'll notice that Googlebot-Mobile and Yahoo's YahooSeeker/M1A1-R2D2 do exactly the same thing.

I've also got my eye on this one, but it looks like a link checker for the dot mobi directory so far, and I have backlinks from that directory.

Jim

6:27 am on June 23, 2008 (gmt 0)

Preferred Member

10+ Year Member

joined:July 6, 2001
posts:410
votes: 0


The weird thing is, this site that was visited has nothing in the dot mobi directory, nor do the directories the bot requested even exist. It came in, didn't look for rorbots text, quickly checked a pre-determined list of directories, then scrammed. And the IP block it came from belongs to Amazon, or so it appears.
9:05 am on June 23, 2008 (gmt 0)

Moderator This Forum from US 

WebmasterWorld Administrator keyplyr is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Sept 26, 2001
posts:10122
votes: 551


It's been showing at my sites requesting the same directories.
2:16 pm on July 2, 2008 (gmt 0)

Preferred Member

10+ Year Member

joined:Nov 26, 2002
posts:520
votes: 0


This stupid bot from .mobi has been hammering my non-mobile site for the last couple hours from all of these IPs. It looks like they're trying to drum up .mobi domain name registrations by spamming my logs.

67.202.17.***
67.202.22.***
67.202.30.***
67.202.36.***
67.202.41.***
67.202.46.***
67.202.53.***
67.202.55.***
67.202.58.***
67.202.60.***
67.202.61.***
75.101.193.***
75.101.195.***
75.101.206.***
75.101.212.***
75.101.218.***
75.101.223.***
75.101.232.***
75.101.233.***
75.101.235.***
75.101.236.***
75.101.240.***

1:04 am on July 4, 2008 (gmt 0)

Senior Member

WebmasterWorld Senior Member jdmorgan is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Mar 31, 2002
posts:25430
votes: 0


If you read their robot info page, they explain that they try to 'discover' mobile pages on sites by trying m.example.com, mobi.example.com, example.com/m/, example.com/mobi, and several other variations. While this may be annoying, please realize that the mobile Web is not "developed" like the "old" Web is. In many cases (including some sites of mine), the only backlinks are from directories, because there are no other relevant mobile sites** to link to or to get links from. So I can understand why they're doing this.

However, on my sites, they *did* check robots.txt, so I dunno what;s going on if they are not checking it on some sites... maybe a glitch.

Anyway, the "Nokia" in the user-agent, and the fetches of "mobile-related" subdomains and subdirectories is not mysterious.

** If you're looking for a niche market, get in now!

Jim

 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members