Architextspider

Forum Moderators: bakedjake

Message Too Old, No Replies

Architextspider

WebSpinner

7:03 pm on May 23, 2001 (gmt 0)

Have not see this spider in a while..I joined FindWhat.com got a few #1 KW and now ARCHITEXTSPIDER is all over the site?

Anyone else see this or is it just a fluke??

TIA,
Spinner

Marcia

7:15 pm on May 23, 2001 (gmt 0)

No connection that I can think of. I've had Architext more than regularly, as well as several others, and I haven't even been doing any submissions. Might have been some links followed, or a cyclical thing.

jeremy goodrich

7:42 pm on May 23, 2001 (gmt 0)

I've seen architext around too. Perhaps they are coming out of hibernation?

They don't have any connection with Findwhat, aside from the showing of their pay per click listings at the bottom of their serps. Same as the relationship between goto and countless other engines :)

ifyouonlyknew

11:22 pm on May 23, 2001 (gmt 0)

ophelia.excite.com
germany.excite.com

I've got at least 5 different different architext spiders a day! what's the deal and they all just request the robots.txt and sometimes the index, and once a different page. thought excite was all about looksmart now.

ifyouonlyknew

11:26 pm on May 23, 2001 (gmt 0)

hunter.excite.com - - [23/May/2001:18:58:21 -0400] "GET /robots.txt HTTP/1.0" 200 35 "-" "ArchitextSpider"

this is straight from my log files, can you tell me why I don't have an IP address anymore? It seems to have been subtituted with the "hunter.excite.com".

jeremy goodrich

11:35 pm on May 23, 2001 (gmt 0)

Depending on the setup of your log files, it may resolve IP addresses to host names for you. Doing a trace route can give you back the IP. Or you can change the set up of your web server.

Without knowing more about your server setup, that's all I can help you with.

Son_House

9:42 am on May 26, 2001 (gmt 0)

Over the last few days ArchitextSpider has made 21 requests for pages at our site. Have not submitted to them in over a year.

JuniorHarris

1:40 am on May 27, 2001 (gmt 0)

ArchitextSpider requsted 162 pages this Month with the first two on 5/13 and remaining 160 pages during 5/20-5/23.

ifyouonlyknew

8:50 am on May 27, 2001 (gmt 0)

architext has been all over my site, but only requesting robots.txt

littleman

9:23 am on May 27, 2001 (gmt 0)

ifyouonlyknew
That has been the patter over the last several months.
First it hits the robots.txt, then it starts requesting pages after a couple of days.