Forum Moderators: open

Message Too Old, No Replies

Spider visit after 42 days

         

pete

7:09 am on Nov 3, 2000 (gmt 0)

10+ Year Member



It has taken 42 days for fast to send a spider to a newly optimized and submitted site, hit the default page only:

FAST-WebCrawler/2.2-pre20 (crawler@fast.no; [fast.no...]

I.P 09.202.148.16

Air

8:28 am on Nov 3, 2000 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Fast has been hitting all my domains the last few days and taking more than just one page. Looks like a general crawl is in progress.

makemetop

1:06 pm on Nov 3, 2000 (gmt 0)



Same here been crawling deep for the past 48 hours.

Brett_Tabke

1:11 pm on Nov 3, 2000 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



me 3. And thank you Fast for turning down the page dl rate on that thing.

pete

11:07 am on Nov 7, 2000 (gmt 0)

10+ Year Member



Hmmmmm - Nothing yet :( , will wait and hope.

thanks for the input guys :)

pete

10:15 am on Nov 8, 2000 (gmt 0)

10+ Year Member



Always rely on the hombres and hombrets @ WMW to be one step ahead.

Fast hit this site this morning ( 8 pages in 5 hours and still steadily crawling :) )

Machiavelli

2:06 pm on Nov 9, 2000 (gmt 0)



I'm getting nothing useful - I am continually plaged by:

FAST-WebCrawler/2.2-pre9 (Multimedia Search) (crawler@fast.no; [fast.no...]

downloading .gif files only.

rencke

2:20 pm on Nov 9, 2000 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



This might explain it:
[fast.no...]

pete

11:00 am on Nov 10, 2000 (gmt 0)

10+ Year Member



Fast has been through the whole site now. picked up every page.

Same user agent and I.P (209.202.148.16)
as in the opening post.

Brett_Tabke

4:53 pm on Nov 20, 2000 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



Is anyone getting any appreciable traffic out of AllTheWeb proper? Mine seems to have dried up. hmmm. And it did it after this last round of spidering.

pete

6:28 am on Nov 22, 2000 (gmt 0)

10+ Year Member



Same here Brett. Dissapointing really. Thought that Fast would be making its way into the heavy weights.

Any states based public relations campaigns to promote the portal worth mentioning?