homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

née sgcrawlerbot

 3:54 am on Oct 8, 2011 (gmt 0)

A name change but still "v0.01a" version; still crawling from Germany:
Mozilla/5.0 (compatible; suggybot v0.01a, http://blog.suggy.com/was-ist-suggy/suggy-webcrawler/)

robots.txt? Yes

Another UA from PHP for the IP [projecthoneypot.org...] and here (07-2010) [webmasterworld.com...] --

Mozilla/5.0 (compatible; sgbot v0.01a, sgcrawlerbot@gmail.com)



 7:29 pm on Oct 8, 2011 (gmt 0)

I had the range 93.159.96/19 as DSL but looking at a few IPs in the range for open ports it now looks more like servers or ill-used statics. Also got two blocked bots in the 111/24 range. Now blocked.

I am always very suspicious of email addresses at gmail, hotmail, yahoo etc. They crop up far too frequently, even in DNS reports. I tend to look more closely at reasons for blocking if registrations / abuse reports include public email addresses.


 8:05 pm on Oct 8, 2011 (gmt 0)

You found an e-mail address? I only got as far as

Dieser Index bildet den Pool für die Webseiten-Vorschläge für die Suggy-Nutzer.

Der Suggy-Crawler befindet sich aktuell noch im Entwicklungsstadium. Sollten Sie ein Fehlverhalten des Bots festellen, nehmen Sie bitte Kontakt mit uns auf:

[si-contact-form form='2']

That's the literal text, followed by "Bookmark It" and then a string of icons all suggesting "suggy empfehlen!" * and finally, in English,

Comments are closed.

Well, never mind then.

* My fingers typed "entfehlen" which is not actually a word, but is probably closer to what Pfui had in mind.


 6:07 am on Oct 9, 2011 (gmt 0)


If you read the last line of the OP, you'll see a GMail address. That is what dstiles was referring to ;)


 6:18 am on Oct 9, 2011 (gmt 0)


Not that there's much to choose among e-mail addresses. Can't think offhand of any roboticist who has ever responded to e-mail inquiries.

Global Options:
 top home search open messages active posts  

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved