homepage Welcome to WebmasterWorld Guest from 54.234.147.84
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
Speedy Spider
VAL@Amsterdam




msg:396889
 2:56 pm on May 21, 2000 (gmt 0)

My site is crawled by "Speedy"

On Sunday, May 21 2000, 3:56 PM, Search_Engines_Commander detects the following visit:
Browser: Speedy Spider ( [entireweb.com...] )
Host:
IP: 193.15.210.29
Domain: [lcd.projector.beamer.lcd-projector.beamers.v1.nl...]
Referer:


All sites for Altavista, Lycos and Infoseek were crawled. Any idea's who this might be?

 

Brett_Tabke




msg:396890
 8:47 pm on May 21, 2000 (gmt 0)

Have you ever heard of Worldlight...same folks.

http://www.entireweb.com/speedy.html

http://www.entireweb.com/info/faq/faq.html

VAL@Amsterdam




msg:396891
 9:40 pm on May 23, 2000 (gmt 0)

Tx B !

Kamikaze




msg:396892
 5:11 am on Jun 20, 2000 (gmt 0)

Yeah, these guys at European Regional Internet Registry have been really aggressive. I've been pounded by them. I don't mind it but it's so hard to tell which are spiders and which are not... since they are also an ISP. Anyone know which one is the "true" spider? And which one is a "keeper"?

Kamikaze




msg:396893
 5:58 am on Jun 20, 2000 (gmt 0)

Here is one of their aggressive IP:
213.219.19.148

Does anyone know what it is?

littleman




msg:396894
 6:45 am on Jun 20, 2000 (gmt 0)

Kamikaze
There isn't a host name lookup so I did a ripe.net whois for you:

inetnum: 213.219.19.144 - 213.219.19.159
netname: GL-LL-SEARCHWORKS
descr: Search Works Limited
country: GB
changed: akhan@globix.net
Check out [globix.net...]

Kamikaze




msg:396895
 3:17 pm on Jun 20, 2000 (gmt 0)

Thanks littleman. Yeah, I ended up in the same place. But does that conclude that 213.219.19.148 is a spider?

roscoepico




msg:396896
 7:32 pm on Mar 8, 2001 (gmt 0)

'193.15.210.29'

This bugger is still pounding my sites. Anyone have any more info?

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved