homepage Welcome to WebmasterWorld Guest from 54.237.125.89
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Visit PubCon.com
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
a new bot
bot
mojomike




msg:4269158
 6:56 pm on Feb 18, 2011 (gmt 0)

Ok guys it's been a while since I've posted so I am rusty

here is something that just showed up in my morning log files

bot[+:,\.\;\/\\-]
and
[+:,\.\;\/\\-]bot

I will update with the IP's later when I pull the raw files down

any clues ?

 

Mokita




msg:4269299
 12:14 am on Feb 19, 2011 (gmt 0)

I'm seeing that in Awstats for all my sites too, and I didn't find anything resembling that UA in the raw logs.

So I went to the logs for a site that gets very few visitors and selected all the visits for 6 Feb (the date of the "last visit" for bot[+:,\.\;\/\\-] as reported by Awstats). I then removed the requests for pages and supporting files, and was left with 15 requests for robots.txt by Googlebot, Bingbot, Baidu, SBider, Yandexbot, and Slurp.

Bing accounted for 9 of them, Slurp 2 and the rest 1 each. And all of them have been back since 6 Feb.

None of that is out of the ordinary, so I think that Awstats has somehow got itself in a tangle. It looks like a snippet of Regex code.

mojomike




msg:4269325
 1:14 am on Feb 19, 2011 (gmt 0)

I would happen to agree, it looks like an Awstats issue. But better safe than sorry.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved