Forum Moderators: open

Message Too Old, No Replies

Deep Crawl

Just noticed a new deep crawl

         

MarkHutch

9:53 pm on Apr 2, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I just noticed a new deep crawl on one of our sites from Fast. They are going deep and getting about 4 pages per minute.

diddlydazz

10:11 pm on Apr 2, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I haven't seen any deep activity today, but fast normally crawls quite frequently, I also believe they have just updated their index so that might be a factor for the deep crawl.

Quite an active bot :)

Dazz

keywordbuys

1:04 am on Apr 3, 2002 (gmt 0)

10+ Year Member



yeah the past two days FAST has crawled about 50 pages.

lombard

1:52 am on Apr 9, 2002 (gmt 0)



I did not see any crawling recently on any of my clients sites.

I have a question.

One of my clients websites has only the first page indexed by FAST and no internal pages.
This is real bad.

Does anyone knows why this is the case ?

heini

11:23 am on Apr 9, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Lombard - you sure the inner pages are not indexed? There has constantly been confusion because Fast tends to show the index page, even when the query is related to content of an inner page.

keywordbuys

11:36 pm on Apr 9, 2002 (gmt 0)

10+ Year Member



just type in the name between "http://www" and ".com", you should find all of the pages that have anything to do with that name.

Also, make sure that FAST can actually find the other pages and they have readily accessible links to them. If you have links in javascript drop down menus they can't be read.

If there's a path FAST will find it.