homepage Welcome to WebmasterWorld Guest from 54.224.53.192
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
LEIAcrawler?
Ulrike

10+ Year Member



 
Msg#: 163 posted 12:27 pm on Nov 2, 2000 (gmt 0)

This is spidering me very intensive since the 30th:

62.200.157.20 - - [30/Oct/2000:19:20:59 +0000] "GET /robots.txt HTTP/1.0" 200 363 "-" "LEIA/2.90"
62.200.157.50 - - [30/Oct/2000:21:20:15 +0000] "HEAD /main/disclaimer.htm HTTP/1.0" 200 191 "-" "LEIA/3.01pr (LEIAcrawler; leia@gseek.com; [gseek.com)"...]
62.200.157.50 - - [30/Oct/2000:21:20:16 +0000] "GET /main/disclaimer.htm HTTP/1.0" 200 5193 "-" "LEIA/3.01pr (LEIAcrawler; leia@gseek.com; [gseek.com)"...]

Who or what is this? And why always GET and HEAD?
(gseek.com demands password)

I also noticed this robot(?):
195.178.64.179 - - [30/Oct/2000:15:47:09 +0000] "GET /main/cat_wotages.htm HTTP/1.0" 200 12880 "-" "Morning Paper 1.0 (robots.txt compliant!)"

 

eljefe3

WebmasterWorld Administrator 10+ Year Member



 
Msg#: 163 posted 1:49 pm on Nov 2, 2000 (gmt 0)

Quietus Advice K&W nr 130 AB (GSEEK4-DOM)
Oxenstiernsgatan 33
Stockholm, - S-115 27
SWEDEN

Domain Name: GSEEK.COM

Administrative Contact, Billing Contact:
Hagstrom, Bjorn (HB1472-ORG) bjorn.h@GSEEK.COM
Global Seek AB
Arsenals gatan 2
Stockholm, - S-111 47
SWEDEN

Technical Contact, Zone Contact:
Sevaldsen, Morten (MSS1081) morten.s@GSEEK.COM
Globe Seek AB
Arsenals gatan 2
Stockholm
SE
S-111 47
SE

Record last updated on 20-Aug-2000.
Record expires on 13-Dec-2001.
Record created on 13-Dec-1999.
Database last updated on 31-Oct-2000 06:27:59 EST.

Domain servers in listed order:

2F222.GSEEK.COM62.200.157.22
2F121.GSEEK.COM62.200.157.21

Contact phone and fax number deleted. They've been doing a pretty thorough crawl of my sites also.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved