homepage Welcome to WebmasterWorld Guest from 54.227.34.0
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
FDSE robot
bull

10+ Year Member



 
Msg#: 3299 posted 5:33 pm on Jun 19, 2006 (gmt 0)

194.150.248.20 - - [19/Jun/2006:00:00:39 -0500] "GET /robots.txt HTTP/1.0" 200 5338 "-" "Mozilla/4.0 (compatible: FDSE robot)"
194.150.248.20 - - [19/Jun/2006:00:00:39 -0500] "GET /foo/ HTTP/1.0" 200 1898 "-" "Mozilla/4.0 (compatible: FDSE robot)"

Some swiss hosting company. Denied.

[edited by: volatilegx at 7:09 pm (utc) on June 19, 2006]
[edit reason] examplified URI [/edit]

 

keyplyr

WebmasterWorld Senior Member keyplyr us a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



 
Msg#: 3299 posted 7:30 pm on Jun 19, 2006 (gmt 0)

FDSE (Fluid Dynamics Search Engine) is 'search your site' software which also includes option to search the internet if the user doesn't find what they're looking for at that website.

incrediBILL

WebmasterWorld Administrator incredibill us a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month



 
Msg#: 3299 posted 12:06 am on Jun 20, 2006 (gmt 0)

84.87.150.21 "Mozilla/4.0 (compatible: FDSE robot)"
202.157.186.70 "Mozilla/4.0 (compatible: FDSE robot)"
66.225.229.245 "Mozilla/4.0 (compatible: FDSE robot)"

It's also been spotted on theses IPs so it's a very busy bot as those are all over the world.

Mokita

5+ Year Member



 
Msg#: 3299 posted 1:13 am on Jun 20, 2006 (gmt 0)

[robotstxt.org...]

mack

WebmasterWorld Administrator mack us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 3299 posted 1:18 am on Jun 20, 2006 (gmt 0)

As well as being used for site search, the operator can also specify it to crawl an external page or site. Perhaps this is why it is hitting your logs.

Mack.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved