homepage Welcome to WebmasterWorld Guest from 54.198.224.121
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Subscribe and Support WebmasterWorld
Visit PubCon.com
Home / Forums Index / Search Engines / Alternative Search Engines
Forum Library, Charter, Moderators: bakedjake

Alternative Search Engines Forum

    
Exite filling my 404 logs
Is this spider Exited?
Macguru




msg:464231
 11:41 am on Jun 28, 2001 (gmt 0)

Some of my sites recently got hit by Exite in a strange way. More than half of what it request never existed.
Here is a clip from one error log. Does any one can tell of some reason for this?

199.172.149.193 - - [28/Jun/2001:00:13:03 -0400] "GET /support/os400.html HTTP/1.0" 404 207
199.172.149.206 - - [28/Jun/2001:00:22:49 -0400] "GET /contenu/Intelink_servers/Text_listing/index.html HTTP/1.0" 404 207
199.172.149.193 - - [28/Jun/2001:00:25:10 -0400] "GET /exec/obidos/subst/help/dataprotection.html/ HTTP/1.0" 404 207
199.172.149.204 - - [28/Jun/2001:00:32:53 -0400] "GET /exec/obidos/search-handle-url/index=books-de&size=25&field-author=Gysi,%20Gregor/ref=sim_artist_detail/ HTTP/1.0" 404 207

 

Brett_Tabke




msg:464232
 3:13 pm on Jun 28, 2001 (gmt 0)

Those are Amazon urls. But why? hmmm

Brett_Tabke




msg:464233
 3:16 pm on Jun 28, 2001 (gmt 0)

Have you got amazon affiliate links on your site?

Macguru




msg:464234
 3:20 pm on Jun 28, 2001 (gmt 0)

Hi Brett,

No links with amazon whatsoever. We have a "contenu" folder at root level. Can a spider get drunk? ;)
By the way, I am very curious on how did you find out about Amazon url...

jeremy goodrich




msg:464235
 3:12 pm on Jul 11, 2001 (gmt 0)

Does Architext still think you are amazon? Or at least, that you have their links? I'm curious because I haven't seen hide nor hair from Excite in months. I believe Architext might be going on one of it's many seasonal vacations.

Macguru




msg:464236
 4:06 pm on Jul 11, 2001 (gmt 0)

I have no answer. It is still doing it every day. Hard to concentrate on error logs with such a pollution. It is looking for hundreds of URL, have to edit out by IP numbers.

<added> The Web site is in French </added>

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Alternative Search Engines
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About
© Webmaster World 1996-2014 all rights reserved