homepage Welcome to WebmasterWorld Guest from 54.198.140.148
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
Bing blows a gasket
wilderness




msg:4452070
 2:33 am on May 11, 2012 (gmt 0)

Anybody see anything unusual from Bing today?

Like 4-5 more (more than usual) requests from that broken obscured UA.

It all began mid-day with

65.52.111.40 - - [10/May/2012:16:51:27 +0100] "GET /Myfolder/CaseErrorFolder/MyPage.html HTTP/1.1" 404 194 "-" "Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1)"

I then made an adjustment for this UA, which I'd never seen before, and the nonsense began.

In less than three hours tonight, twenty-four requests, of which only three identified themselves as Bing and were let in. The rest ate 403's.

 

wilderness




msg:4452089
 5:13 am on May 11, 2012 (gmt 0)

three of eleven in the past two hours were 200's.

All different pages.
Various MS/Bing IP's.

lucy24




msg:4452108
 6:51 am on May 11, 2012 (gmt 0)

D'you mean the plainclothes bingbot, generically, or this precise UA? I've been blocking it for so long, I wouldn't even notice what it's up to.

wilderness




msg:4452111
 6:58 am on May 11, 2012 (gmt 0)

lucy,
this thingy been coming quite regular (the forum takes out the double blank spaces despite my adding a third blank space).

"Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.2; SLCC1; .NET CLR 1.1.4325; .NET CLR 2.0.40607; .NET CLR 3.0.04506.648)"

wilderness




msg:4452112
 7:01 am on May 11, 2012 (gmt 0)

The IP's are irrelevant, as they are all Bing IP's.

RewriteCond %{REMOTE_ADDR} ^65\.5[2-5]\. [OR]
RewriteCond %{REMOTE_ADDR} ^70\.37\. [OR]
RewriteCond %{REMOTE_ADDR} ^157\.[45][0-9]\. [OR]
RewriteCond %{REMOTE_ADDR} ^207\.46\. [OR]
RewriteCond %{REMOTE_ADDR} ^207\.[67][0-9]\.

lucy24




msg:4452120
 7:28 am on May 11, 2012 (gmt 0)

the forum takes out the double blank spaces despite my adding a third blank space


Make one or  both of them a  non-breaking  space. It works in Preview. Let's see if it's still there when I post.

wilderness




msg:4452246
 2:40 pm on May 11, 2012 (gmt 0)

still persists with an approximate one-in-four being valid and identified as bingbot/2.0;

Still getting some case errors.

wilderness




msg:4452686
 8:36 pm on May 12, 2012 (gmt 0)

FWIW,
After twenty-four hours these dwindled down to nothing.
In fact the unidentified requests have stopped almost entirely.

I have no idea what the long range effects are.

wilderness




msg:4452961
 7:57 pm on May 13, 2012 (gmt 0)

I've been doing a widget photo trivia on Saturday's.

When I reactivated this trivia, I was bombarded with tweet bots, which I posted in another thread.

The "tweets" had left me alone with the exception of that one instance, at least until yesterday.

That last request yesterday if the same UA that I started this thread with:

65.52.16.161 - - [13/May/2012:18:35:43 +0100] "GET /SpecialFolder/MyPage.html HTTP/1.1" 403 533 "-" "Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.0)"

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved