homepage Welcome to WebmasterWorld Guest from 54.226.191.80
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
appie/1.1
Froggyman




msg:397014
 9:40 pm on Jan 26, 2001 (gmt 0)

appie/1.1
[info.webcrawler.com...]

Got visited by this little critter today. Interesting (yet very small) search engine. I don't remember posting to it. It even list the .gif's it finds on each page it indexes.

BTW, if you're scared of spiders you might want to stear clear of my site cuz it's crawling with them! Sucking a ton of bandwidth from my server. Pages are loading at 40% of normal...

 

littleman




msg:397015
 10:23 pm on Jan 26, 2001 (gmt 0)

I haven't seen it. Say, would you mind posting the IP of the bot? I ust want to see if it is really spidering from a win98 platform.

Froggyman




msg:397016
 11:08 pm on Jan 26, 2001 (gmt 0)

You noticed that too, huh? Here's the log:

A visitor from ipd50a0a75.speed.planet.nl (213.10.10.117) arrived without a refering URL, and visited at 3:18:53 PM on Friday, January 26, 2001. This visitor used appie/1.1.

It didn't look for a robots.txt file although I may have missed it's first hit on the site sometime in the past.

littleman




msg:397017
 11:20 pm on Jan 26, 2001 (gmt 0)

As far as I could tell it may actually be a Win98 box. I tried a couple of tricks to test for the OS and they all came up blank.

Froggyman




msg:397018
 12:04 am on Jan 27, 2001 (gmt 0)
They're using Apache 1.3 Web Server so the support for W98 is there.
http://213.10.10.118/
Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved