All pages spidered by FAST except main/index page. Why?

[jamesyap]

I got a popular site that rank number 4th with google. I expect it to rank well with alltheweb too but it didn't. I do a search on alltheweb on my site and found that most of the pages are spidered (more than 40) and is in the database EXCEPT my main page! All my pages has a link to the main page (home) and so I see no reason why the inteligent spider can't see it. And I also have lots of inbound links to my site. When I search the exact title of my site (which will definitely unique) I see my site appears in many of other sites linking to my main page, but where is my main page in alltheweb database?

Any comment on how to make it index my main page?

[edited by: Rumbas at 6:06 pm (utc) on Dec. 17, 2002]
[edit reason] No specifics please - thanks! [/edit]

[Rumbas]

Hi jamesyap - Welcome to WebmasterWorld. Don't forget to read paynt's excellant Welcome Thread [webmasterworld.com] :)

Now on to your question:

FAST has indexed all your pages, but you can't seem to find your index page, right?

It does sound a bit odd. Have you tried checking if the default file (index.html, home, dafault etc.) is there?
Sometimes when you just check domain.com, it doesn't show. It should be there as FAST has probably found your other pages from the index page and, as you say, you have links to the index page from all the others.

[jamie]

hi james,

i had the same problem with our site. the only thing which helped was an email to fast. i believe they reinstated the page manually.

although i did not get a reason why it was dropped, the response was very quick. they have great customer service.

btw this was for a page using insite select - so must have been some sort of computer glitch.

[jamesyap]

My site is none comercial. Is not submited via inside select (no money, hehe). And it has been out there for a few years and is fair enough to be included with fast. I have great knowledge on Google but I really doesn't know much on Fast.

I actually check the database by typing "url.all:http://www.alwiz.com" in the search and 26 results return but none is my index file. :( Any more idea which can help me? I have resubmit the main side again yesterdat.

I was thinking on submitting my side through side select. Questions :
1. Does side select crawl only one single URL or it will crawl anything below the domain?
2. 2nd URL is cheaper, must I submit them together with the 1st or I can submit them few months later?

[Rumbas]

>1. Does side select crawl only one single URL or it will crawl anything below the domain?

It crawls all the pages you pay for. If you pay for only the index page, then only the index page will be crawled.

>2. 2nd URL is cheaper, must I submit them together

No, you can wait and add more pages later. You will get additional pages for the cheaper rates.