Forum Moderators: bakedjake

Message Too Old, No Replies

Excite deep crawl

finally...

         

vis

9:20 am on Feb 9, 2001 (gmt 0)

10+ Year Member



So, there was a bit of action recently from the architext spider grabbing robots text a few times a couple of days ago but now the spider has finally grabbed a whole bunch of pages from a couple of my sites.

Cute names such as Ursula, Gretzky, Electra, Hera, Abraham, Bat etc. (they use a lot- they must have a lot of time on their hands and an interest in classical mythology.) ip. 199.172.149.135>

Anyway, they were well behaved with nice long intervals and following the robots text to the letter.

Does this mean that Excite is finally going to update? Will I finally be free of clients bugging me about getting on most engines but excite?

I hope so.

PeteU

4:22 pm on Feb 9, 2001 (gmt 0)

10+ Year Member



excite has been regularly spidering and updating since last october

Kamikaze

5:16 pm on Feb 9, 2001 (gmt 0)

10+ Year Member



vis- I too just got spidered near the end of last month. It hit a bunch of my pages... but now I'm just waiting. Haven't had much love with Excite this past 6 months or so.

PeteU- So you've experienced to see new pages get indexed in Excite since October? I've had no activity besides the spidering the end of last month. Hopefully all that spidering will pay off....

PeteU

6:27 pm on Feb 9, 2001 (gmt 0)

10+ Year Member



yes submitted a year ago, first spidered in September listed in October, regularly spidered and updated since then.

vis

9:32 am on Feb 12, 2001 (gmt 0)

10+ Year Member



You'll have to excuse my excitement above. The spidering was for two new domains one submitted in November and one in December. Both were spidered around the same time last week.

Does Excite have set times for adding new pages? (surely not every 4 months)

Thanks PeteU, Kamikaze- at least I know I can now look forward to regular spidering.